Mark Stimson, who was linked with post earlier this week having quit as manager of Stevenage Borough, has been ruled out along with Colchester United's assistant manager Mickey Adams.
The third name to be crossed off the list is that of Mike Newell, who was always going to find it tough with Heather Rabbatts on the selection panel after his remarks about female official Amy Rainer last season.
There has been no official confirmation but a spokesman for the Millwall Independent Supporters Association was quoted as simply saying "Fact" when asked about the rumours.