One of Apocalyptica's trademarks is their instrumental songs, and this is one of them. "Eicca" Toppinen from Apocalyptica explained to the French Rock Hard magazine what is the determinant factor regarding whether a song should have vocals or not. Said Toppinen: "Generally, it's quite obvious. When we composed 'I'm not Jesus', it was evident that this song had a lot of potential and was getting particularly well with the addition of vocal lines. In most cases, instrumentals express themselves, but sometimes, some of them require a particular type of voice. When we can't find the perfect fit, we prefer to put the stuff aside rather than record it with an inadequate singer or release a half-way instrumental."
The chorus of "Voulez-vous coucher avec moi ce soir" in "Lady Marmalade" is French for "Do you want to sleep with me tonight?" When Labelle performed it on television, they had to change it to "Voulez-vous danser avec moi ce soir" (Do you want to dance with me tonight?).