Angry pensioners have formed an action group to lobby a development company they claim is ignoring their needs.
The campaigners live near the Gala Bingo Hall in Portland Road, Hove, which has been empty since it closed in August 2003.
The Gala Group now wants to knock down the building, which dates from the Thirties, and use the site for flats.
The firm's proposal includes 54 apartments, with 22 meeting Brighton and Hove City Council's affordable housing criteria.
But neighbours say the site should be used for sheltered housing and daytime facilities for the elderly.
The Gala Group has added a section to its proposal to deal with the provision of leisure facilities. However, this outlines giving money to a nearby YMCA centre rather than providing anything on the Gala site.
Derek Rist, 62, of Marmion Road, Hove, is heading the action group.
He said the reason they were lobbying for a centre for the elderly was because many older people did not want to use the YMCA as they saw it primarily as a youth club.
He said: "We don't have anything against young people but a lot of older people feel intimidated by them.
"All we are asking for is somewhere for older people to go. We have a growing older population and some feel very isolated."
He also said the planned building would not fit in with the local surroundings.
Don Brown, community development officer of the YMCA in Marmion Road, said there was a danger that, if the whole plan was rejected and Gala won on appeal, the community would get few leisure facilities from the deal.
He said: "The YMCA needs some work done and we also want to use it more during the day with older people's clubs.
"We want to get together with the action group so between us we can come up with something that works.
"We don't want it to be an us and them situation."
He has also written an action plan for the area which states: "Action is needed to reduce the elderly's isolation and associated high suicide rate in some wards. A meeting venue would be beneficial."
Denise Barraclough of Gala Group Limited said: "Gala is very conscious of local anxiety about the site, especially as the empty building has previously been the target of vandals and squatters.
"Our plans are carefully considered to ensure they are viable and would bring much-needed affordable homes for local people anxious to get on the housing ladder."
The Brighton and Hove Older People's Council is supporting a bid for sheltered accommodation and a community centre on the site. City council planning officers have recommended the application is refused.
At the last planning meeting on April 6 councillors deferred the decision to a meeting on Wednesday in order to visit the Portland Road site.
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules hereComments are closed on this article