This song features a vocal contribution from Jakob Dylan. Bowersox told Billboard magazine: "He was wonderful. He said it wasn't a song that he would have typically done, but he loved it. He liked what it was about as he's a father himself. He's got four boys, and I'm sure each of them have had stitches. He came in, knocked it out, and that was that."
Bowersox wrote the song with her musician husband Brian Walker. It was inspired by the emotional and physical bruises of her own little son, Tony. She told Billboard magazine: "It just wrote itself. It came out in a short amount of time." Bowersox added: "I think anyone who has a child, or anyone that they care about - understands the idea of wanting to make things better when something isn't right - can relate to the song."
Kacey Musgraves originally offered "Follow Your Arrow" to her friend Katy Perry. However, Perry thought Musgraves should record the song herself as it seemed, "like something that you would totally say."