Asked during a Reddit AMA who are the "s---ty Indianapolis band" on this song, Loveless replied: "That band is made up. It's about drinking in a bar you hang in often and having to pay a cover to talk over the band playing that night. (Some people do that)."
Geffen Records made history on June 27, 1994 when Aerosmith's "Head First" became the first major label song made available for exclusive digital download. Download speeds at the time were so slow it took around 75 minutes to download the track.