"Only To Be With You" is lifted from Permanent Shade of Blue
, Roachford's third studio album, released in 1994. The album was a particular hit in Australia, where it was certified Double Platinum.
Andrew Roachford explained to Songfacts
that the song was musically and lyrically inspired by Thin Lizzy, which he was listening to a lot of at the time: "I loved Thin Lizzy, and just wanted to write a song that had a little romantic lyric but is slightly tongue-in-cheek on the verses, and it became one of the main live anthems for us. It still is."