The defender believes the language barrier is stopping their manager from really losing his temper.
The Frenchman replaced Tim Sherwood at the club earlier in the season, but has not managed to turn things around for the club.
Instead he has arguably seen things get worse, with them currently eight points from safety with 12 games remaining of the season.
Their last Premier League game saw them thrashed 6-0 by Liverpool, their worst home defeat for 81 years.
Garde has remained calm throughout all of that, which some have found surprising, and Lescott has explained that is because of the language barrier at the club.
"He [Garde] is calm," he told The Times.
"He's lost it a couple of times. He's trying to create a non-French-speaking environment, the reason why he hasn't lost it as much as he wants is because he doesn't know enough bad words in English.”
"It [the dressing-room language] is an issue but it's not the reason why we are bottom. There's something wrong with the whole foundations, team, players. Is it one person's fault? No.”
The decision not to hire an English-speaking manager seems to have been a disastrous one given how things have panned out at Villa Park.
A quick look at Sunderland will show the effect that Sam Allardyce has had, with them now just a point away from safety after beating Manchester United last weekend.
That is in stark contrast to the effect Garde has had since arriving, with many Villa fans glancing jealous looks to the manager their relegation rivals currently have at their disposal.