This is the title track of Warpaint's third studio album. Bassist Jamie Lee Lindberg explained to HMV.com why they chose to name the record after this song:

"We went down the list of song titles and it's always really easy for us to choose those and we're usually quite happy with them, but this time we were having a little difficulty deciding what the album would be called. By Your Side was in contention, but it was already taken by another band and Heads Up was next on the list. It felt cohesive with the overall message in each song, we're focused on being positive and forward motion from here on out."