Goals from man of the match Manuel Lanzini, Mark Noble and Diafra Sakho sealed an unforgettable first win at Anfield since 1963.
It has taken 43 attempts to rewrite the history books, Lanzini's goal after just over two minutes was the east London club's first in Liverpool since Bobby Zamora scored there in 2006.
But it was the little Argentine, who was making his first Premier League start since a summer loan move from the footballing backwater that is the UAE league, who stole the show.
He scored one, set up a second and thwarted Liverpool attacks time and time again before they could build any momentum, robbing the likes of Roberto Firmino and Phillippe Coutinho of the ball in dangerous areas.
Here's how West Ham's players fared at Anfield.
Randolph - 8
Tomkins - 9
Reid - 9
Ogbonna - 9
Cresswell - 9
Lanzini - 10 STAR MAN
Mark Noble - 9
Payet - 9
The Frenchman has had West Ham fans excited to go to games again and this is why. Every touch is sublime and when he has the ball you always feel something will happen. His ball in put the wheels in motion for the first goal while his audacious skill saw Coutinho sent off.
Kouyate - 10
Unlucky to lose out to Lanzini for man of the match. A real fan favourite, he was absolutely everywhere. In the first half he had a very specific job to sit in front of Benteke and cancel out the ball to his head which could have caused the Hammers trouble. Kouyate was running up and down from box to box as hard and fast in the 97th minute as he was in the first. Heroic performance and just as crucial to the win as Lanzini.
Sakho - 9
Sakho was a big doubt for the game due to injury and his recent off-field problems would have been weighing on his mind too. But given the fact West Ham have no other senior strikers fit, it was vital they got the Senegal star patched up and on the pitch at Anfield. And what an important role he played, leading from the front, chasing, harrying and providing a target and outlet to build West Ham's counterattacks. He was rewarded when he got the goal he deserved in the 93rd minute as he slotted home just inside the box.
Oxford - 8
The youngest player in West Ham's history has sat out the last match and a half after being at fault for two goals against Leicester City. But he showed he is no flash in the pan following his stunning display in the opening-day victory at the Emirates when he came on for hero Lanzini. Bilic trusted the youngster to come in for the last 15 minutes when Noble was dismissed and he helped shore things up and see out the win.
Jarvis - 7
The out-of-favour winger came on as a very late sub for Payet and did a job, offering fresh legs and helping relieve some late pressure from the home side.
Cullen - 7
Only played four minutes as a time-wasting substitute. But it was a nice touch from Bilic as the game was wrapped up and Cullen is a homegrown player rated highly by the club - so it was ideal for him to make his Premier League debut in such a historic victory. Had some neat touches.
SUBS NOT USED: Spiegel, Lee, Samuelsen, Knoyle.