Son Heung-min made it 2-0 in the sixth minute of injury time after Germany goalkeeper Manuel Neuer came up the field to help his teammates outside the South Korea box.
The defending champions went into the final game of the group stage knowing a win against South Korea would likely see them through to the last-16 if the other result went their way.
But the late changes failed to spark Germany into life as Korea hung on for a famous win that, unfortunately for the impressive Asians, saw them bow out after Sweden beat Mexico 3-0.
Mexico take on the mighty Brazilians in Samara on Monday, hoping to progress to the quarter-finals for the first time since 1986.More news: Drake's 'Scorpion' Breaks Spotify Opening Day Streaming Record
Mats Hummels witnessed Germany get eliminated from Russian Federation 2018 and then declared the last time the World Cup holders delivered a "convincing performance" was a year ago. "But the ball is round so I think there will be opportunities for us as well". You'd imagine many Germans will be needing a holiday after the horror of seeing their team humbled by already eliminated South Korea. As it turned out, South Korea's win kept Mexico in the competition. The official had to check with the Video Assistant Referee (VAR) before confirming the goal, but it was good.
Prior to the World Cup, Jo was the least experienced of the three custodians on the national team with five caps.
Germany's team manager Oliver Bierhoff, also a director at the German football federation (DFB), said he believed Loew would not resign following their shock elimination in the group stage.
It's the third consecutive World Cup in which the holders have crashed out in the group stage, with Germany following the example set by Spain and Italy in 2014 and 2010 respectively.
"It is a really, really bitter evening for us", admitted Hummels, who squandered a late chance when he headed over. South Korea went down 2-1, with the first Mexican goal coming on a penalty and the second one on a breakaway followed by a defensive lapse.