Mumford & Sons fourth album Delta was recorded at The Church Studios in London with producer Paul Epworth. The band spent a couple of years accumulating songs, and were still in the "courting phase" with Epworth, hoping he would be a good fit for the project. They recalled that this song was the Eureka moment.
"The date that went really well was 'Slip Away', and it was when we knew we wanted to make the whole album with him is when we nearly finished that song."
The bedrock of David Guetta's Nicki Minaj-featuring single "Hey Mama" is a sample of "Rosie," a 1940s prison recording from folk archivist Alan Lomax that songwriter Esther Dean first showed the French DJ on YouTube.