The bigger pitch at the stadium was often cited as a reason for the club's struggles compared to their record-breaking farewell season at their beloved Boleyn Ground.
Controversy has swirled around West Ham's occupation of the stadium ever since the deal was announced.
Indeed the club's 99-year lease as "anchor tenants" - where they officially only have the stadium under their control for around 26 days a season - is a major bone of contention for the club's fans.
General view outside the stadium before a match
Back in 2015 the stadium was used to host Rugby World Cup matches. And rugby will return next March after it was announced Saracens will play Harlequins there.
It comes after the stadium was used to host atheltics for the second consecutive summer which - due to a 15-day turnaround time on converting the ground back into football mode at a reported cost of £8 million - means the East Londoners had to get special dispensation from the Premier League to play their first three matches of the new season away from home.
The Saracens vs Harlequins match comes just a week before Slaven Bilic's side are due to face Southampton there.
Traditionally a Premiership rugby match is hosted at Wembley Stadium each season.
But in a somewhat ironic twist - adding insult to injury for those West Ham fans against the fixture being played at the ground in the middle of the football season - it is believed a key reason the fixture cannot be played at Wembley next season is because West Ham's fierce rivals Spurs will be playing at the national stadium while White Hart Lane is redeveloped.
Obvious concerns have been raised about the state the pitch will be left in as West Ham fans reacted to the announcement on Twitter.
Pitchside during a West Ham match at the Olympic Stadium, now known as the London Stadium
That's what happens when you don't own your own ground I suppose. Will they take down all reference to West Ham as well?!— Ian Tilbury (@Tillroll78) July 7, 2017
well thats the pitch ruined lol— #COYI (@dukstah_e6) July 7, 2017
When will people understand "its not our stadium" stop moaning ffs— Alf Robert Jones (@alfcarper) July 7, 2017
What happened to exclusivity during the football season?— Chris Sheppard (@chris_whu62) July 7, 2017
That is a joke. The pitch will be a mess— JODY MALLEY (@JODYALLEYCAT) July 7, 2017
a good thing for supporters in that neck of the woods. But its not a good stadium to watch football in— Stuart Turner (@OnlyOneT) July 7, 2017
The London Stadium? I've not been there for a football match yet. Not surprising, though. Often the way with athletics stadiums.— Alex Shaw (@alexshawsport) July 7, 2017
Yeah the banking is too shallow. Awful— Stuart Turner (@OnlyOneT) July 7, 2017
Partly Spurs, probably, but Saracens CEO (ex Wembley himself) has torn into Wembley for not matching the club's ambitions. May not go back.— #RugbySaracens (@RugbySaracens) July 7, 2017
The now traditional fixture of Saracens vs Quins at Wembley will be at London Stadium this season. Presumably due to Spurs being at Wembley.— Alex Shaw (@alexshawsport) July 7, 2017