The first single from Miles Kane's second album was written by him with Nu-folk singer-songwriter Kid Harpoon, who has also worked with Jessie Ware. It was produced by former Lightning Seeds frontman Ian Broudie. Said Kane: "I wanted the energy and positivity that I've felt in the past 18 months to be reflected on the new album - to make it upbeat and uplifting, and to me that's exactly what 'Give Up' does. It doesn't mess around." The song was released as part of a 4-track EP digitally via iTunes on February 24, 2013, with a 7" format made available the following day.
The song is about the frustrations of dating his catwalk superstar girlfriend, Suki Waterhouse, and the heartache of breaking up with her. "'Give Up' is quite an angry tune," he told NME. "At the time it didn't feel like it but you look back and think, 'that's an angry little f---er.'"
The lyrics for Lesley Gore's "It's My Party" were based on actual events relating to his daughter Judy's sweet 16 party. The teenager threw a tantrum and burst into tears when her mum and dad insisted that her grandparents had to be invited.