The Frenchman recently struggled to impress in the FA Cup loss to Manchester United.
The Frenchman has been in sensational form this season, fast becoming the key man in the Hammers' midfield.
Indeed, of such high standard have his performances been that he could have his own highlights reel at the end of the campaign.
Last week saw him struggle against Manchester United in the FA Cup though, and Merson says he worries that Payet may be a highlights player.
“When I watched the whole game the other day he was very poor, I don’t know if he’s a highlights player.
“I haven’t watched him a lot, but when I see him [in highlights] he bends free kicks in the top corner and he does things in games. It worries me.”
The Hammers will certainly be hoping Payet can get back to his best as the season draws to a close.
After the weekend draw with Leicester City, they now sit sixth in the table and seven points behind Manchester City in fourth.
With a number of points left to play for, and in a very unpredictable Premier League campaign, the race for the Champions League is far from over yet.
If they are to make it in though, they will need Payet producing more moments of magic, starting with the clash against Watford at Upton Park on Wednesday evening.