The German is expected to be busy in the January transfer window.
As under Brendan Rodgers, Klopp’s side have struggled for goals this season, with their strikers so far failing to impress.
Daniel Sturridge has once again failed to maintain his fitness, while Christian Benteke has, as yet, not proven worth the money they paid to secure him from Aston Villa over the summer.
That has led many to believe Klopp will look to fix that in the January transfer window, but Cottee says he must first look to improve the defence.
“Defensively it’s been a problem for Liverpool for a couple of seasons now,” he told Soccer Saturday.
“You’ve got to build from the back, the goalkeeper is not up to it and the defence is not up to it.”
“Jurgen Klopp has got to build from the back, we keep talking about going forward, but you have to have a good goalkeeper and a solid back four before you’ll go anywhere.”
While Liverpool fans are keen to see new faces arriving at Anfield, Klopp is sure to be determined to work with what he has.
Chief among them must be Dejan Lovren, who has continued to struggle but has shown glimpses of improvement at times under the German.
A run in the side could see him start to return to the kind of form he showed at Southampton previously, as well as Klopp’s influence continuing to help him build the confidence he needs.