The Frenchman made headlines for two different reasons.
The Frenchman stole the headlines at Old Trafford after sending a 30-yard free kick past David de Gea for what looked to be the goal that took the Hammers into the semi-finals, only for Anthony Martial to equalise on 83 minutes.
But prior to that stunner the in-form 28-year-old also made headlines for another reason after appearing to go to ground relatively easily inside the Red Devils' penalty area, while he was already booked.
Former Irons striker John Hartson pulled no punches in his assessment, insisting that Payet should have picked up a second yellow card for what he felt was a dive, but Bilic has stressed that it should have been a penalty.
"Come on. If you have a screen, show me.... There is more than a contact. It is definitely not a dive," the Croat is quoted as saying by The Star.
"Nobody in the world can say there wasn't a touch. Then if it was a touch, and it is more than a touch, it is a penalty. When you are sliding in the box from behind, I am not saying it was nasty, but it was mistimed.
"Rojo slides and when you are sliding in the box and the ball is nowhere near you, you are taking a big gamble and a big risk. It is a penalty."
Controversy aside, Payet continues to be a revelation following his summer move from Marseille, with that being his 11th goal of the season in all competitions.