Steve Gritt has warned table-topping Albion they face more managerial uncertainty.
He believes the flurry of departures could continue until the new stadium at Falmer is built.
Gritt was the first of chairman Dick Knight's seven managers in six years. He was controversially sacked after rescuing the Seagulls from relegation from the Football League.
Gritt, out of work again after parting company with Millwall where he was assistant manager, said: "It is amazing how well Brighton have done considering the number of managers they've had.
"I think you have to give credit to those managers. A lot of them have gone on to bigger and better things.
"The players deserve a lot of credit as well. It isn't easy having managers thrust upon you.
"It is unlikely they are going to get any stability with managers until they actually get the stadium built.
"At the moment I am sure Dick must be thinking he doesn't want to appoint somebody else who gets them promoted and is then suddenly in the frame for a bigger job.
"He will want to keep hold of somebody for two or three years, but he will have to make it as enticing as he can contractually.
"It won't have been difficult attracting people, because of the success they've had and where they are in the League, but there will be some pressure. If it does go wrong there is only one way they can go."
The Millwall job is also up for grabs following the departure of Mark McGhee. Gritt, currently scouting for his old club Charlton, expects some of the same names to be mentioned.
"Steve Cotterill's name keeps cropping up," he said. "He has dealt with a club on a low budget. The years he spent at Cheltenham were a good grounding.
"Perhaps the move to Sunderland came along too soon. No doubt he will be put in the frame for Millwall as well.
"Bob Booker has done well so far and he must also have a chance of getting the Brighton job."
Gritt's hopes of returning to the game full-time have been put on hold by a nasty eye injury. The ball hit him in the left eyeball during a match for his Sunday side.
Albion midfielder Dean Hammond has joined Third Division Leyton Orient on a month's loan and utility player David Lee has moved to non-League Thurrock on the same basis.
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules hereComments are closed on this article