Indeed, the Black Cats face the north London side this weekend and Allardyce believes title talk is premature for the current Tottenham squad.
But the Sunderland head coach says there is nothing unrealistic about the White Hart Lane outfit aiming for the top four.
Big Sam told reporters ahead of this weekend's game: "Listening to my old mentor, Sir Alex, the hardest one is always winning the first one for your players, and particularly the players who are as young as Tottenham's, so it would be nice if they did.
"But I think their main aim would be to finish in Champions League and if the title came around, that would be one of those seasons they dream about."
Pochettino told reporters: "A great player, a top goalscorer. His quality is great. It's not new for us."
Tottenham fans will remember Defoe's goalscoring ability, of course. He didn't always delight supporters but the 33-year-old did leave White Hart Lane having scored plenty of goals.
Sunderland fans will certainly be pleased with his recent exploits and, considering the fact Spurs lost to Leicester City, three points for an in-form Sunderland side aren't out of the question.
It should be an intriguing return for Defoe and a good test for Pochettino's men. For once this season, Sunderland are on a winning run but Tottenham aren't.