This song appears to be about how society has lost its way, however Kaiser Chief drummer and co-songwriter Nick Hodgson told Q magazine April 2009 that he feels people read too much into their songs. He explained: "People say our songs evoke a long lost Britain. That's never occurred to me. It's not like we've ever written a manifesto on what we're about. The lyrics just pop out." He added that people seem to think that this song, "is about other bands, but really it's about (British pub chain) Wetherspoon pubs."
Bruce Springsteen wrote "Blinded By The Light," which was a #1 hit for Manfred Mann's Earth Band. The "Madman Drummers" line is a reference to Springsteen's first E-Street drummer, Vinnie "Mad dog" Lopez.
Kacey Musgraves originally offered "Follow Your Arrow" to her friend Katy Perry. However, Perry thought Musgraves should record the song herself as it seemed, "like something that you would totally say."