Two different covers were released on the CD version - a 'boy' version, with the cover being a suggestive photo of a crotch with jeans unzipped and undergarments showing, and a 'girl' version, with the cover being a shot of a woman's cleavage in a red bra.
Jarvis Cocker explained the meaning behind the song in an interview with Dave Simpson for Melody Maker magazine around the time of the single's release: "It was originally written about 12 years ago. My sister sang an early version, but it had different words. It never got used, and then I just remembered it. Because it had been written such a long time ago it made me wonder what I was doing then. And I worked out that it must have been written quite near to me meeting this girl. It's just wondering, really. If I hadn't gone out and met this particular person in this particular nightclub, and formed a relationship with her, how different would my life have been? So it's not really about fate, it's more about the randomness of things. Which I like. As I've said before, that's the main thing I feel is missing from my life. The worst thing about having a schedule and a timetable is that there's less chance for unexpected things to happen."
The song on the B-side of the single, "Mile End," was featured on the soundtrack to the cult film Trainspotting.
In The Beatles "When I'm 64," Paul McCartney asks a woman if she'll still be there for him when he's 64. In 2006, he got his answer when shortly before his 64th birthday, he and Heather Mills separated.
Michael Jackson's "Liberian Girl" opens with the South African female singer Letta Mbulu saying the Swahili phrase "Naku penda piya-naku taka piya-mpenziwe." There was some geographic liberty here, as Swahili is not spoken in the West African nation of Liberia.
The lyrics for "Mary, Did You Know?" were written by Christian singer and comedian Mark Lowry, after his pastor asked him to write a Christmas musical for their church. Southern gospel musician Buddy Greene later added music to his words.