Tottenham and Leyton Orient have had their bids for a judicial review of the Olympic Stadium decision rejected.
The two London clubs contested the Olympic Park Legacy Company's verdict that West Ham and Newham Council should be the future occupants of the venue.
But Judge Mr Justice Davis told them there are no grounds for a review.
Spurs and Orient said they would consider over the next few days whether to renew their applications at an oral hearing in the High Court.
The statement on the Tottenham website added: "The club continues to hold discussions with both local and national government bodies in order to seek to determine a feasible stadium solution."
After Thursday's news was announced, the Olympic Park Legacy Company said: "We are pleased with the ruling and continue to make good progress in our negotiations with the preferred bidder in order to be in a position to agree the final terms for the stadium's lease."
Newham Council, who have arranged a £40m loan to finance West Ham's move to the stadium, said: "We are continuing to focus on securing a lasting legacy for the stadium and, together with West Ham United, are progressing well with the Olympic Park Legacy Company on bringing the matter to a commercial and financial close."
West Ham vice-chairman Karren Brady said: "We welcome today's news as a further endorsement of our strong and viable legacy vision.
"We hope we can now focus all our energy and passion on delivering a fantastic multi-use Olympic Stadium for the whole nation.
"We were honoured to be unanimously chosen as preferred bidder by the OPLC. Their decision, after a robust and diligent process, was subsequently backed by the Mayor of London and government.
"Our vision - in partnership with the London Borough of Newham - remains for a globally-recognised destination for all, with community at its core, capable of hosting world-class sporting events, including top-level football and athletics."
Spurs had turned their attention to the Olympic Stadium in Stratford, east London, after deciding their plans for a new development at Northumberland Park next to their existing north London White Hart Lane home were not economically viable.
Their plan was to rebuild the stadium without the running track and, by way of a commitment to athletics, rebuild the National Sports Centre at Crystal Palace.
But east London club West Ham, who were relegated from the Premier League last season, were unanimously chosen as the preferred occupant, having proposed to reduce the stadium's capacity from 80,000 to 60,000 seats after the Olympics for use it as a multipurpose venue, retaining the running track.