Gueye only arrived at Villa last summer, and he has been one of the better recruits that Tim Sherwood made during that transfer window.
Villa’s summer signings have mostly been failures, but Gueye has added some quality to their midfield. And Redknapp feels that the Senegalese international should not be blamed for the current situation that Villa find themselves in.
"All season they really have been so poor," Redknapp said. "This has been happening the last three or four years. There's no real surprise, and they've somehow got to change that flow.
"They were not strong enough defensively, apart from Gueye in midfield they've been really poor, and they've not scored enough goals."
Gueye has played 31 times for Villa in all competitions, but he has been unable to save the side from the drop.
Villa are currently sat at the bottom of the Premier League table, and they appear destined to be relegated.
Remi Garde’s side have been abject all campaign, and they have managed to win on just three occasions.
The Claret and Blues are currently 12 points away from safety, with just seven games remaining in their league season.
Villa are reportedly set to sack Garde in the coming days (The Sun), as they begin to plan for life in the Championship.