Sunderland take on Everton at the weekend.
O'Shea, Toivonen and Kaboul all picked up injuries during the Black Cats' 3-0 win over Newcastle United, and it seems that they could be out for over a week.
Although none of the injuries are expected to be long-term, there are concerns that the trio could be out for next weekend's match.
And Allardyce admits that Toivonen's absence could cause a problem for the side, as he feels that they are short of cover in the midfield area.
"We’ll know more on John O’Shea when we can scan him,” he said. “He feels it’s not a serious hamstring, more of a tweak.
“Hopefully that’s the same with Younes Kaboul and Ola. We’ll be lucky to get anyone back for next week, but hopefully they’ll only miss one game.
“Certainly from a defensive point of view, we’ve probably got enough centre-halves. But from a midfield point of view, we lose an important player.”
O'Shea, Kaboul and Toivonen's will all be hoping to make it back for the weekend, as Sunderland finally have some momentum behind them.
They have waited a long time for their first win of the new campaign, but now they have beaten Newcastle, they will be wanting to build on that result.
If Sunderland can beat Everton at Goodison Park, they will have a chance of moving out of the relegation zone, and that will only increase the optimism surrounding Sam Allardyce's appointment.