For Albion players like Kerry Mayo and Gary Hart, who experienced the groundsharing arrangement, it wasn't much fun playing home games at Gillingham.
Richard Carpenter, on the other hand, is really looking forward to Saturday's visit to the Seagulls' former landlords.
As far as the central midfielder is concerned there would be no better place than the Priestfield Stadium to make his first start since a summer knee operation.
It represents a return for Kent-born Carpenter to his footballing roots.
The powerhouse from Sheppey, 32 next Thursday, spent 12 happy years with the Gills, culminating in promotion from the old Third Division.
"I was at Gillingham from the age of 12," he said. "I was a schoolboy there and played all through the youth teams and then I was reserve captain of the South East Counties side.
"I also had six years as a pro. Damien Richardson signed me, then I played for Glenn Roeder, Mike Flanagan, Neil Smillie and Tony Pulis when we were promoted.
"It was like a revolving door in terms of managers, but I couldn't say a bad word about the club.
"It's obviously my local club and a lot of people I know support them. I always look for their results and going back there is always nice.
"They have done a lot to the ground since I was there and the chairman (Paul Scally) has done really well for the club.
"When he took over they were in a bit of a state. He has restored their pride and they are a decent First Division outfit now."
Whether Carpenter goes back to Gillingham on the bench or in the starting line-up remains to be seen.
The former Fulham and Cardiff servant made his comeback from cartilage surgery as a late substitute in last Saturday's home defeat by Queens Park Rangers.
He had another run-out in Tuesday's reserve team friendly at Littlehampton.
"It was nice to be back last Saturday," Carpenter said. "You don't realise how much you miss it.
"It's all right playing in these reserve games and getting yourself fit, but you cannot beat the atmosphere of playing in the first team.
"The gaffer hasn't really said too much. I am training now and playing games. He might give me the nod, he might not.
"I get little twinges and stiffness in the knee now and again, but apart from that it feels okay."
Gillingham were comprehensive winners of both League clashes two seasons ago.
Carpenter scored in a 4-2 defeat for Albion at Withdean under Martin Hinshelwood and was in the side beaten 3-0 at Priestfield, the Seagulls' second-heaviest defeat during the reign of Steve Coppell.
Carpenter expects it to be just as difficult for Albion this time, with or without him.
"It's always a hard place to go," he said. "They are having a mixed season at the moment, picking up a couple of results and then losing a couple.
"They have got a good, strong squad and it is one of those fixtures you look at as being tough, who ever you are in this division."
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules hereComments are closed on this article