'Biggest mistake of my career': £6m man wishes he hadn't left Tottenham