The Villans boss is refusing to focus on speculation that he could be the next Premier League manager to lose his job.
Jose Mourinho’s side ran out 2-0 winners at Stamford Bridge in what had been a tight game until a costly mistake from Joleon Lescott allowed Willian to set up Diego Costa for the opening goal.
The champions gained confidence from there on in, with Villa looking unlikely to level the scores and get a positive result from the game, and Sherwood admitted afterwards that they gave themselves an uphill task by gifting Chelsea the first goal.
“The first goal in any match is so important, and Chelsea didn’t have to work too hard for that,” he told Sky Sports.
"I'll take the positives today - we took the game to them, we dominated them in the first period and we created a few chances of our own. But we gave ourselves an uphill task after the first goal.”
Sherwood refusing to become focused on sack speculation
The Villa boss has also said that he is not worried about the speculation currently surrounding him at Villa Park.
His side sit in the bottom three with just four points to their name after nine games, four points adrift of newly promoted Bournemouth in 17th place.
That has led to increased speculation that Sherwood could be set for the sack if things continue to go badly for the side, but he insists that he cannot worry about that gossip and will instead focus on fixing things in training.
"We have to move on and learn from mistakes, because they are costing us at the moment,” added Sherwood.
"Goalscoring has not been our problem, but not winning matches is of course a concern. We will continue to work hard in training to put things right. I can’t worry about speculation concerning me - this is business as usual. I am on Aston Villa's side, no-one else's."