Frontwoman and lyricist Hayley Williams said on the deluxe version of the album that this stripped down closing track was written about her boyfriend New Found Glory guitarist Chad Gilbert. She said that Gilbert was leaving to tour for the first time since they started their relationship and as a consequence all sorts of insecurities were bubbling to the surface.
Hayley Williams told Alternative Press: "I wish there was an actual story for this song. The whole time we were writing and rehearsing at home, I was in this state where I wouldn't come out or go out unless it was to write with the guys. I spent so much time alone in my apartment that I think it started to mess with me and just make me really sad. One day, I went to practice and Taylor [York, rhythm guitar] was playing this song. It was another one of his. It hit me and I just started writing whatever came to mind. 'All I Wanted' almost didn't make the record. I can't remember why we didn't think it would work. We would've been pissed right now if it wasn't there."
"Bittersweet Symphony" by The Verve samples an obscure orchestral arrangement of the 1965 Rolling Stones song "The Last Time." The Verve had to sign away most of the royalties before they could release the song.