This was released as the fifth single from Kimbra's debut studio album, Vows. Asked by American Songwriter if she writes the instrumentation or lyrics first on her songs, Kimbra replied: "Music generally comes first. A groove or melody will trigger images or an emotion, then I'll go from there."
The song's music video was directed by Matthew Rolston (TLC's "Creep," Paula Abdul's "Crazy Cool").
The line in John Mellencamp's "Cherry Bomb" that sounds like "that's when a smoke was a smoke" is actually "that's when a sport was a sport," according to the published lyric. In that sense, "sport" is an endearment for someone of good nature.