The Liverpool midfielder was delighted to get the equaliser, but would like to see the defence tighten up.
Allen's injury time strike salvaged a point for Jurgen Klopp's side after Roberto Firmino had twice given Liverpool the lead but were pegged back twice by Aaron Ramsey and Olivier Giroud - with Giroud then going on to give the Gunners a second half lead.
The two equalisers in particular, could have been prevented from a defensive point of view in the eyes of a lot of people, and Allen, along with his teammates, would like to see the side tighten up.
He told the club's official website: “I was running onto it and just tried to get anything on it – thankfully it ended up in the back of the net. It was a nice feeling to come on and make an impact. Thankfully we ended up coming away with a point.
"Some of the goals we have given away, sometimes we make it difficult for ourselves. So that’s one area that’s in need of improvement in some ways.
“It’s not an issue of quality, it’s more of a concentration thing. Hopefully we can eradicate that from our game and I’m sure we’ll keep improving.”
Having been something of a maligned figure among Liverpool fans, his past two performances have been key to the outcome of the result.
He played very well in the first leg of the Reds League Cup semi-final against Stoke City, where he set up the goal for Jordon Ibe to allow Liverpool to take an advantage into the second leg, and his late equaliser will undoubtedly give him a few more brownie points.
This has come after saying things have gone quiet when it comes to a potential new contract, so Allen is going about things in the right way in order to try and earn that new deal, and seems to relish the responsibility of being pushed further forward since Jurgen Klopp's arrival at the club.
Liverpool will be keen to address their defensive issues ahead of this weekend's huge clash with Manchester United, which has the feeling of a must-win for the Klopp's side if they are to keep their Premier League campaign with something to play for in terms of a top four finish.