"Taking All The Blame" revisits the breakup of Lunn and Cooper's relationship which colored so much of the lyrics on second album All Or Nothing
, but with a more distant, reflective theme. Lunn explained the song's genesis to clashmusic.com
: "I'd been playing around with the chorus riff for a while, but I just couldn't find the right lyrics to match. I then somehow started writing an apology to Charlotte for how I'd behaved when we were breaking up. I was young; we were both really young. At the time of writing I felt like I'd been a bit of an arsehole to everyone. Eventually I came up with an idea: Charlotte and I could talk about our relationship and our eventual breakup from dual perspectives. I recorded my verse and sent it over to Charlotte, without telling her what it was about, but I think she knew…she sent me back her verse lyrics and we recorded them for real the next day. I'm really pleased and proud of what we both came up with, and how honest we can be with each other."