But, on the 10th time, the Aston Villa boss believes the Tottenham Hotspur winger is capable of magical moments...
Discussing the 23-year-old Tottenham man, the former manager of the north London side has explained his view of the young forward - encapsulating the feeling among the club's fans that he can be a very frustrating player.
Nine times out of 10, Sherwood says, Townsend will run straight into the full-back - and the Villa boss isn't wrong there.
On the 10th, however, the Spurs man is capable of a match-winning contribution, according to his former coach.
It is that paradox that Tottenham fans must simply get used to if current manager Mauricio Pochettino is to persist with the winger at White Hart Lane.
The Aston Villa boss told the Mail: "I think of Andros Townsend. He’ll run it into the full back nine times but then the 10th he’ll get past and put in a cross that wins the game, or stick it straight in the top corner like he did the other night."
Townsend did indeed score for Spurs against Swansea City on Wednesday night but supporters have expressed their increasing frustration with the 23-year-old throughout the current campaign.
Luckily for the winger, though, Erik Lamela appears slightly more out of favour after a similarly unproductive few weeks.