Villa have made one summer signing already in Manchester City defender Micah Richards, but now Sherwood needs to strengthen other areas.
The Sun believe that Sherwood is targeting a triple swoop on former club Tottenham with Andros Townsend, Emmanuel Adebayor and the aforementioned Carroll all on his radar.
Carroll, 23, has been away on international duty with the England Under-21's, but will now return to Spurs after Gareth Southgate's men were embarrassingly knocked out in the first round.
Having spent the season out on loan at Swansea, Sherwood now wants to take Carroll away on loan again, according to The Sun, having worked with Carroll during his time at Tottenham.
Perfect Cleverley replacement?
Aston Villa lost Tom Cleverley to Everton, as the on-loan midfielder penned a five-year deal with their Premier League rivals.
Cleverley gave energy and great passing ability to the Aston Villa midfield under Sherwood, and those are two attributes that Carroll also possesses.
It seems like a natural fit for Carroll to replace Cleverley in the Aston Villa midfield, and working under Sherwood again could be the perfect move for Carroll this summer.