Villa are currently sat at the bottom of the Premier League table, and they look destined to be relegated this season.
The Claret and Blues have won just three games this term, and they are now sat 12 points adrift of safety.
The Sun have suggested that manager Remi Garde is set to lose his job, as a result of the Midlands side’s poor form under him.
However Lambert, who managed Villa between 2012 and 2015, believes that the players should be taking more of the blame for the club’s terrible form.
“I think the players are,” he said. “It’s not just all the manager’s fault. He picks the team who he thinks will win.”
Lambert also claims that he could see that Villa were set to go backwards during the time he spent at the club.
“I could see it coming, and it’s dead easy for me to say that,” the Scottish boss, who is now in charge at Blackburn Rovers, said. “But I could see it coming. I can only speak for my time, but that club deserves big players. I tried to bring in Lukaku and Bony, but we couldn’t go out and do that type of deal.
“I think they have suffered. The last good period they had was under Martin O’Neill.”
Lambert looks set to face off against Aston Villa next season, as his Blackburn side are currently lodged in a mid-table spot in the Championship.