The victory was part of their Euro 2016 qualifying campaign - not a friendly - and Origi netted for his side, while Tottenham's Nacer Chadli also found the scoresheet.
The 19-year-old is currently on loan at former club Lille, after his summer move to Anfield came with an agreement that he would be loaned back to the Ligue 1 side.
But Reds boss Brendan Rodgers is excited about his future nonetheless and another goal last night shows just why.
Origi has been scoring for Lille back in France but to score for his country is 'always an honour,' he said on Twitter after the match:
Belgium's next game comes against tough opposition in Bosnia & Herzegovina on Monday night.
The Bosnians, however, drew with Wales yesterday, meaning the Belgians will certainly go into the tie with more momentum than their opponents.
Origi, meanwhile, will be hoping for more of the same - a goal and a win for his country.