This song features a guest vocal from Australian pop star Kylie Minogue. Singer Theo Hutchcraft explained to the NME how the collaboration came about: "A few weeks ago we finished our album, but it did not feel complete. We have written an album, mainly about women, which felt lost without the salvation of a woman. We wrote a song about infidelity called 'Devotion'. Since we have enjoyed an illicit life-long love affair with Kylie Minogue, we mustered up every ounce of courage we had and asked her if she would like to sing the song with us. She said yes. The delicate yet powerful way she expresses the fragility of female emotion has added a magical missing ingredient to an album about love, loss and happiness. If you don't ask, you don't get… I guess."
Keyboardist Adam Anderson told 69 Degrees magazine about recording this song with Kylie: "It was a pretty surreal moment, very surreal. I kind of laughed my way through it, really. What we wanted to do with Kylie is – she was known in her career in the nineties where she revealed a bit more of herself, she did the Nick Cave collaboration, she worked with the Manic Street Preachers, I think it revealed a different side to her personality, which you don't often see. So, we chose that track and the vocal she does is kind of like Kate Bush, really – it's dark and we got her to sing in a certain way… our music is about context about putting something massively commercial on an atmosphere so far away from that is what gives it the beauty."