Up to 150 people could lose their jobs if a travel company relocates to the north of the country.
Staff at Panorama and Manos Holidays in Vale Road, Portslade, part of the My Travel group, were called to a meeting on Monday and told there would be management structure changes as part of a cost-cutting plan.
Employees were given a statement which said the first consultation meeting would take place on August 2 and the consultation period would take at least 90 days.
A new management structure would be in place after that and it proposed the office in Portslade would eventually close.
The statement said the proposal had been made on the current volumes and size of the operation and that offices in Rochdale and Glasgow were better placed to take on the additional functions for Direct Holidays and Panorama Holidays.
It said: "The closure of our offices in Brighton will realise significant cost savings which will support our drive towards returning to profitability."
One employee, who did not wish to be named, said: "I think people had just got over the job cuts they had nearly two years ago so I think it is better that everyone is in the same boat rather than having to fight each other for jobs.
"But everyone is really upset. Out of all the parts of My Travel I think it is the one that has the best staff retention.
"There are people who have been here for years who are really gutted but I don't think people were that surprised.
"Most people here live in Brighton or Worthing and it is difficult to find a job in Brighton.
"One of my colleagues said, I wouldn't go to Rochdale even if they paid us double'."
A spokeswoman for My Travel said: "My Travel UK has announced to staff a proposed operational restructuring.
"Its highly successful charter tour operator brands, which include Airtours, Direct Holidays and Panorama, will continue to operate, supported by a single management organisation, located at My Travel's Rochdale head office.
"Crucial to the success of the reorganisation will be retaining the skills and experience of the Direct Holidays and Panorama workforce.
"In keeping with this, opportunities will be made available to affected employees through home working, relocation and the expansion of the Glasgow call centre."
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules hereComments are closed on this article