Aston Villa have shipped six goals and scored none in two games.
The Villans were pumped at Wigan Athletic this past weekend in a dismal performance which yielded no shots on target for Smith's troops.
That came on the back of Swansea dumping Aston Villa out of the FA Cup by the same scoreline at Villa Park nine days ago.
Smith, a lifelong Villa supporter, took charge of his boyhood club back in October following the dismissal of Steve Bruce.
And the former Brentford boss admits that now he has to earn his money, with the West Midlands side winning two of their last 10 games across all competitions.
"I'm an Aston Villa fan and to lose 3-0 two weeks on the spin is very, very disappointing. That performance was rubbish - it was very poor," he told BBC Sport
"And I've got to earn my money now and make sure it never happens again. Overall I thought they ran harder than we did and that's the disappointing thing."
As long as Villa have a 16-goal striker in Tammy Abraham then there's always a chance to turn around their dismal run of form.
And if January loan signing Kortney Hause has the desired effect then they could, in theory, stop leaking goals at the back.
And although the Wolves defender didn't have a brilliant debut at Wigan, he is bound to be a bit rusty after not making a senior appearance since September.