But the Scotland Under-21 international was soon picking the ball out of the net after Considine levelled matters on 36 minutes.
The Dons defender rose above Jim Thomson to guide a header inside the post after Scott Severin had nodded Nicholson's free-kick back into the six yard box.
Chisholm's team were dealt another blow three minutes from the interval when top-scorer Stephen Dobbie limped off to be replaced by another ex-Aberdeen player, Stewart.
However, match-winner Stewart played a key role in Queens' second goal just four minutes into the second half.
Burns gathered a pass from Stewart at the back post and, with the goal at his mercy, sent an awkward shot against Severin, but the midfielder got another opportunity and managed to slam the loose ball home.
Queens will be back at Hampden next month
MacDonald made a fingertip save to deny Chris Maguire and Burns squandered a golden chance when he sent a shot over the top from eight yards as the game raged from end to end.
Parity was restored when Nicholson was on had to finish after MacDonald had done well to keep out Miller's header from a Maguire cross.
Fans of the Dons barely had time to celebrate before they were behind again.
Considine misjudged a long upfield punt and O'Connor did well to slip the ball past Diamond before slotting a neat shot beyond Soutar from 18 yards.
This time the supporters from Dumfries had their joy cut short with Considine making up for his blunder with a second goal.
Nicholson's cross from the right was helped on by Miller and the young defender found himself alone at the back post with the easiest of tasks to head home.
A breathtaking sequence of five goals inside 11 minutes was complete when Queens scored an almost identical goal to the one they had just lost, Stewart picking up a header from Thomson and powering a shot past Soutar.
The Dons swarmed forward for the remainder of the game and Zander Diamond was incredibly unlucky to hit the bar with a header then the post with a shot from the rebound.
Queen of the South: MacDonald, McCann (Paton 90), Thomson, Aitken, Harris, Burns, Tosh, MacFarlane, McQuilken, O'Connor, Dobbie (Stewart 42). Subs Not Used: Grindlay, O'Neill, Gilmour.
Goals: Tosh 22, Burns 49, O'Connor 56, Stewart 60.