Vocalist Jeremy McKinnon explained the song's meaning in an interview with Alternative Press. "It's about trust and being there for people when you say you will be," he said. "I'm the kind of person who says what I mean, and this song is about keeping your word."
Jeremy McKinnon wrote the song with his mother in mind. He told Kerrang!: "I used to call my mum every night and she'd be like, 'When are you going to play some softer songs, 'cause I love it when you sing more.' So, I wrote 'Have Faith With Me,' an acoustic song, especially for my mum."
This was the first A Day To Remember tune to enter a Billboard chart, peaking at #40 on the Alternative Songs chart.
Bruce Springsteen wrote "Blinded By The Light," which was a #1 hit for Manfred Mann's Earth Band. The "Madman Drummers" line is a reference to Springsteen's first E-Street drummer, Vinnie "Mad dog" Lopez.