But his thoughts are never too far away from Carrow Road and he was at Saturday's 1-1 draw with Everton.
Ogogo's boxing career has suffered lengthy setbacks after he was ruled out for a year following surgery on an achilles injury before dislocating his shoulder in his comeback fight against Ruslan Schelev in July.
He showed great courage in that fight to battle through and take a unanimous points decision after six rounds.
'I think there's three worse teams than us'
"I was at the game (against Everton) and I thought the first half was diabolical to be honest, the worst I've seen," Ogogo told talkSPORT.
"But whatever Alex Neil said to them at half-time, or a kick up the backside, it worked and we need to play the way we did in that second half.
"I think there's three worse teams than us this season.
"But nobody is too good to go down.
"You only have to look back at that West Ham side that went down 10 years ago.
"Everybody said they were too good to go down.
"They should have been challenging for Europe but they ended up getting relegated."
Hammers horror is timely reminder
Ogogo makes a very salient point with the Canaries slipping into the bottom three as a result of Newcastle's shock 2-1 win over Tottenham Hotspur at White Hart Lane on Sunday evening.
West Ham's relegation in 2003 saw them drop into the Championship with a record 42 points.
The club, then managed by Glenn Roeder, boasted several players who were regulars or would be future regulars for the England team including David James, Trevor Sinclair, Joe Cole, Jermain Defoe, Glen Johnson and Michael Carrick, not to mention quality players such as legend Paolo Di Canio and Mali star Fredi Kanoute.
Even Hammers fans felt their side, which had finished seventh the season before, would be too good given the talent at their disposal.
And West Ham's fate that season should serve as a timely reminder of just what can happen in this most open of Premier League seasons.