In his post-match press conference Burnley boss Sean Dyce blasted the ref's performance saying it had cost his side the game after his decision to send off Michael Duff when he brought down West Ham's Cheikou Kouyate for a penalty.
Now, despite the Hammers getting their crucial goal thanks to the correct penalty award from Moss, Downing - who scored nine goals in 63 games at Villa Park between 2009-2011 - has also rounded on the official saying he was far from happy with his decision making.
The 30-year-old former Liverpool and Middlesbrough playmaker had wormed his way into the Burnley box in the second half of the tight win when he went down as he passed the away side's Ben Mee.
But instead of pointing to the spot, Sunderland-born and West Yorkshire-based Moss booked the Hammers player much to his anger.
Downing told West Ham's official website: “The referee made some decisions – he gave the red card and I thought mine was a penalty – and he had a mixed day."
In 28 Premier League matches this season Moss has dished out more than 110 yellow cards and nine reds.
Arsenal and Villa fans will be hoping Moss doesn't make any mistakes which cost their team silverware when he takes charge of the FA Cup final at Wembley on May 30th.