The winger has signed for the Foxes on loan from Swansea City, where he had fallen out of favour and away from Garry Monk's starting line-up.
His class has still been evident in training, though, and Albrighton was not surprised to see the rapid winger make such an impact on his debut - where he scored a last minute winner to see the side to 3-2 victory against Aston Villa.
"He has looked sharp in training already considering he hasn't had too many games back at Swansea," Albrighton said to the Leicester Mercury.
"He will be a massive part of what we are doing here. It will be a massive season for him and us. There are places up for grabs and that is football. We are a squad, a team, and you need that in the Premier League.
"If he is playing one week and I am on the bench then I will be right behind him. Vice-versa I am sure he will be the same."
Dyer's dream goal capped off a fantastic display from Leicester, which saw them come from 2-0 down to claim victory and extend their run of good form.
Claudio Ranieri's men are currently in second place in the table, and they have won 10 of their last 14 games - carrying over from last season.
Dyer's addition should give them added pace in attacking situations, and he gives them vital Premier League experience - having playing a number of games for Swansea, before falling out of favour.
Leicester's next game comes against Stoke City at the weekend, where Dyer could be in line to make his first start.