The former Liverpool defender believes the Ivorian's presence will be missed if rumours regarding an impending departure are correct.
The Ivorian has been a major part of the City revival over recent years, guiding them to two Premier League crowns and being a stalwart of those title-winning sides.
However, his performances this season have been questioned, with doubts raised over his fitness and commitment to the side. That, in turn, has led to speculation over his future at the club, and Carragher says he will be missed should he decide to leave - with the Mail suggesting that Inter Milan are strong favourites to secure his signature.
“So, Yaya Toure’s agent has re-emerged to say it is ‘90 per cent certain’ the player is leaving Manchester City,” he said.
“If that is the case, we would be saying goodbye to one of the best midfielders we have seen in the Barclays Premier League. Toure has had a poor season by the high standards he has set, yet he is still the highest-scoring midfielder in the division.”
Speculation around Toure’s future has been bubbling since last year, following a bizarre incident in which there were complaints from the player and his agent after the club failed to recognise his birthday.
However, he stayed at the Etihad to aid City in their ultimately failed title defence, as Chelsea went on to reclaim the Premier League's grandest prize with some ease. And it is that person - a committed playmaker - that Carragher says he will remember, not the one whose agent is tarnishing a dignified figure.
“I want to remember Toure as being one of the finest players to grace our league, athletic and powerful and someone you knew would produce a special moment in a big game,” he added.
“If the stories that have come from Seluk over the past 12 months are actually a true indication of Toure’s feelings, it would be a shame. I don’t want to have my memory clouded by nonsense from Seluk [Toure’s agent].”