The pundit feels the Frenchman has a big challenge ahead of him at Villa.
And the former defender believes a big problem for the Frenchman is the fact Villa simply have a 'poor group of players.'
Carragher told the Mail: "Remi Garde will take his place in the dug-out against the best team in the country right now, Manchester City. He will have to produce one of the best managerial acts in Premier League history to keep Villa up.
"This is not a side who were dragged down by a former manager, it is a poor group of players at a club who have seen Martin O’Neill, Gerard Houllier, Alex McLeish, Paul Lambert and Tim Sherwood come and go in just a few years, which shows where the problems lie. Where does Garde start with Villa? The attack or defence?"
As many recent managerial changes have shown, though, the right man in charge can sort a squad out.
Jurgen Klopp is making Liverpool's lacking squad look 10 times the side it was under Brendan Rodgers, while even Sam Allardyce has managed a win at Sunderland.
While Aston Villa's team has deficiencies - is it the worst squad in the Premier League? Sunderland, Bournemouth and Norwich City are arguably three teams that have worse sides than Villa and all Garde really has to do is ensure his team finish above at least three others.
Carragher is right that it won't be easy. But Sherwood's abysmal tactics and team selections were severely limiting Villa. Kevin MacDonald did the same with an awful starting XI against Tottenham Hotspur. As soon as he brought Aston Villa's actual best players on, they looked almost unrecognisable ...