"I said before the game that Reus would score", said a beaming Dieter Mann, a 60-year-old tour guide with Germany flags stuck to his head.
Sweden did take the lead in the 32nd minute though with a well-taken goal by Ola Toivonen who took the ball down on his chest before chipping it over Manuel Neuer.
Kroos was heavily involved as Germany pushed for a victor, completing 15 passes after Jerome Boateng was sent off - as many as Sweden's entire team in that time.
Tunisia captain Wahbi Khazri got his team's second with nearly the last kick of the match.
After losing their opening match to Mexico, Germany must now beat South Korea in Kazan next Wednesday to keep alive their hopes of reaching the knockout phase from Group F and hope Sweden do not achieve a better result against Mexico.
Ex-Germany stars Lothar Matthaeus and Stefan Effenberg said Khedira should be dropped after his woeful display.
It also created chaos in Group F. What seemed straight forward deep into stoppage time was turned upside down.
The reigning champions lost 1-0 to Mexico in their opening match, and have not lost back-to-back matches in the same World Cup finals since 1958 - when they lost to Sweden in the semi-final and France in the third-place match.
"We have to put our foot on the gas and take our chances", Kroos said. Germany forced Sweden to play defensively for nearly the entire second half and eventually the attack paid off.
Germany are unbeaten in their last 11 games against Sweden and are confident of continuing their dominance over the Swedes.
Should head coach Joachim Loew opt to drop Khedira from his starting line-up, the 2014 World Cup victor can take it. Loew made four changes to the lineup against Sweden, including benching Mesut Ozil for the first time in his senior team career in a major global tournament. South Korea, with zero points, could even advance. Boateng's absence is especially bitter for the Germans with fellow central defender Mats Hummels having missed the Sweden game with a neck injury.
Belgium scored three times in the first half, and both Romelu Lukaku and Eden Hazard finished the game with two goals.
"We've talked about what happened", Gomez said. "We will probably require a day of rest and then we will start preparing for South Korea".