The defender says the Villa squad must all be pulling in the same direction.
Villa are currently preparing for a season in the second tier next year following their relegation from the Premier League last season.
There is a wave of positivity around Villa Park at present, with a new owner and a new manager looking to turn their fortunes around.
It is a very different picture from the one last season, where the club was fractured to say the least.
And Baker says that they must all pull in the same direction next season if they are to make a quick return to the Premier League.
“You need a very together squad. That’s the key for me in the Championship,” he told the club’s official website.
“It’s a long, long season and you need everyone pulling in the same direction. We can’t let the disappointment and frustration of the previous season fester for any length of time into this season.”
It remains to be seen whether Villa can have bounce straight back in the Championship next season following the disappointment of last year.
They have certainly given themselves the tools to do so, especially with the appointment of Robert di Matteo as their new manager.
He has tasted success in the division before with West Bromwich Albion and will be keen to replicate that in his first season at Villa Park.