The Canaries secured a massive three points before they face huge fixtures against relegation rivals - Crystal Palace and Sunderland.
"We've got more big games coming up. We want to take points from those as well. We have to keep playing well in order to keep this going."
The Swiss centre-back, signed from Wolfsburg in January, went on to say how they had luck on their side for a change:
"Some games before we've not had luck on our side. This time we did, and it felt fantastic to win the game. I'm very happy at the moment because we've got two big wins in our last two games."
The 27-year-old has appeared nine times in the Premier League for the Canaries, and has been an integral figure in helping them keep two clean sheets in their last three outings.
The win over Newcastle took them four points clear of Sunderland in 18th place, with Alex Neil's men due to host the wear-siders in two weeks time.
Klose finished off by saying how his lack of pedigree in front of goal hampered his ensuing celebration:
"I hardly ever score, so it was a great feeling. I didn't know how to celebrate so I just ran around like a headless chicken."
With six games to go, Norwich will be hoping to keep the feel-good feeling going, and in turn, ensure they retain their Premier League status, on their first season back in the top flight.