The Frenchman has endured a disappointing reign at Aston Villa so far.
The Frenchman replaced Tim Sherwood at the club back in November after a disastrous start to the season saw them struggling.
He failed to turn things around though having won just three of his 22 matches in charge, with relegation to the Championship looking like a certainty at this stage.
It has been a more than discouraging spell in charge, but Yorke says that the most disappointing aspect has been his failure to have an impact at the club.
"You expect some kind of energy in store when your new manager comes in, shows a little bit of passion and little bit of fight," he told Sky Sports News HQ.
" I feel that over the period of time that Remi Garde has taken over at Aston Villa he hasn't shown me anything that he can get Aston Villa out of this situation.”
"For me that is the biggest disappointment, when a manager comes in he tries to make an impact and Remi Garde has failed to do that so far and I feel that has generated throughout the team."
It will now be interesting to see if Garde keeps his job beyond this summer if and when the club are relegated.
At present it seems unlikely that he will be staying, with numerous stories having already appeared hinting that he will depart the club at the end of the season.
Who the club could replace him with would be equally fascinating, with many believing an experienced Championship boss, such as Nigel Pearson, is desperately needed.