Celtic will take on Stranraer away from home in the fourth round of the Scottish Cup on Sunday afternoon.
With first-choice goalkeeper Craig Gordon suspended for the tie at the Stair Park, Bailly is likely to start in his place.
The 30-year-old former Genk and Borussia Monchengladbach goalkeeper has been a largely peripheral figure at Celtic since joining the Scottish Premiership giants in the summer of 2015.
Former Celtic midfielder and manager Hay has urged Bailly to take his chance against Stranraer.
“The team itself will be slightly changed at least for the game against Stranraer with Craig Gordon suspended for the tie after being sent off in last season’s Scottish Cup semi-final,” Hay has written in The Glasgow Evening Times. “That gives Logan Bailly his chance and as a back-up keeper he has to be ready to take it.
“When you are in that position then you can’t pick and choose when you get to make your way into the team and he will desperately want to avoid being part of any Cup shocks. He was signed for this very reason and it is up to him now to go and show his worth.”
Celtic will head into the tie against Stranraer on the back of a 1-0 victory over Partick Thistle at Celtic Park in the Scottish Premiership.
The Bhoys will be favourites to win against Stranraer, although one suspects that manager Ronny Deila is likely to make changes to his team.