Kaiser Chief bassist Simon Rix told Drowned In Sound about this song with the subject of being tongue-tied: "It sounds like the very first songs we wrote together. It's got a bit of a sixties sound. On this album we recorded to tape a lot, especially vocals. We did the Sgt. Pepper tribute album last year, recording on the original desk. We enjoyed the restriction of that but also the sound of it and wanted to try and recreate a bit of that on our album. It's a very up tempo song that pounds along and I think it'll become a bit of a live favorite when the album comes out. This meant we wanted to record it just like we play it. We didn't use a click or metronome as we wanted the songs natural speeding up and slowing down to stay as that is part of the character of the song. So one evening we went into the live room and played it about three times together exactly as we would on stage, to capture the energy. Mark (Ronson, producer), had his top off and declared it his favorite Kaisers song ever."
"Big Love" is a showcase song for Lindsey Buckingham and the first single from Fleetwood Mac's 1987 album Tango In The Night, but he left the group soon after the album was released and the band didn't perform it live until he returned 10 years later.