The Rapture are a New York based dance-punk outfit comprising guitarist/vocalist Luke Jenner, drummer Vito Roccoforte and multi-instrumentalist Gabriel Andruzzi. They are recognized as forerunners of the post-punk revival of the early 2000s. This is the first single from their fourth studio album In The Grace of Your Love.
In The Grace of Your Love was released on September 6, 2011 following a five year hiatus during which Jenner attended church regularly and sang in its choir. He explained to Spin magazine how his ecclesiastical experiences influenced his songwriting. "I got really into gospel and its big, uplifting vocals. That's what I'm trying to do on 'How Deep Is Your Love' or 'Come Back to Me,' or even 'In the Grace of Your Love' - it's my interpretation of gospel music. Some of those songs are prayers, literally. The subject matter is bigger than myself and trying to communicate with that universe, or whatever you want to call it: God. Being in the church choir was really cool -- I got involved with some cool music."
In The Grace of Your Love was produced by Philippe Zdar. Jenner told Spin how the Phoenix producer's experience proved vital in the recording of this song: "It came together in the studio. It wasn't really working at first - the rhythm wasn't working. We couldn't find the missing piece. Philippe got in the room with us and then we added a part at the end. I wanted a piano part all the way through the song, and the other guys were like, 'No, that sucks.' But Philippe was like, 'No, totally do that. Follow your instincts.'"