The Gers striker syas the club have to stop making life so difficult for themselves by conceding so many goals.
The runaway Scottish Championship leaders missed the chance to secure promotion this weekend despite scoring three times against Raith Rovers as poor defending saw them held to a 3-3 draw.
That has given them the chance to seal the title in front of their own fans at a sold-out Ibrox against Dumbarton on Tuesday night, but even if Mark Warburton's side win that match they still face a defining fortnight ahead of them.
The Glasgow side face Peterhead in the Challenge Cup final next weekend before an Old Firm clash against arch-rivals Celtic in the Scottish Cup semi-final at Hampden Park the following week.
The six-goal thriller with Raith leaves Rangers having won just one of their last three matches and having conceded nine goals across that period, a record which Miller acknowledges is simply not acceptable.
The 36-year-old told the Scottish Sun: "It’s bitterly disappointing. We worked hard to get back into the game initially and get our noses in front twice. But it is another three goals lost and an opportunity to win the league obviously gone.
Listen, we’ll move onto Tuesday night, look at this game and see where we can get better because losing the amount of goals we are at the moment is not what we are about. We had corners to defend and we need to defend better.
It’s a hard one to take because it is another three goals lost and we are coming into a crucial period of games — a cup final, a cup semi-final and winning the league, hopefully — and we have won one game in three. That will be levelled at us. Yes, we maybe deserved more, but the facts are there. We need to find a way to stop conceding goals."
Despite the recent setbacks it is still simply a matter of when rather than if Rangers will win the league title, but given how dominant they have been in all competitions anything less than two trophies would be something of a disappointment.
Miller and his teammates will be desperate to seal the title on Tuesday night to allow them to focus entirely on their cup exploits and adding as much silverware as possible before their return to the big time next season.