Singer/songwriter/guitarist Daniel Rossen recalled to Drowned In Sound: "I remember that even before we started recording this song we talked about how it seemed like a great opening track. It had a positive spirit to it that reminded me of the end of 'On A Neck, On A Spit' (from the 2006 album Yellow House). Both those songs involved some time wandering around near the beach up at the Cape (Cod), strumming the guitar line over and over in order to find a melody."
Ed Droste (also Singer/songwriter/guitarist) added that this was recorded at both Cape Cod, Massachusetts, and in a New York church. He explained: "Actually the last song to be recorded and written. Started on the cape and finished up in the church and went through various different permutations."
Kid Rock's "All Summer Long" is a mashup of "Werewolves Of London" and "Sweet Home Alabama." The album it came from was released in October, 2007, but they held off until summer, 2008 for a more seasonable release.