The duo attempted to continue before eventually leaving the stage, creating one of the most infamous moments in live music history. Before the Lake Compounce concert, Milli Vanilli seemed unstoppable.