Steve Berlin of Los Lobos plays the saxophone on this track. Berlin was a friend of the band since their early days: in 1982, R.E.M. was a supporting act for the Chicano-Punk band "The Plugz," which Berlin was a member of at that time.
The lyrics come from an excerpt of a speech of Mother Ann Lee, leader of the American Shaker sect in the 18th century. (source: Inside Out by Craig Rosen, thanks, Martin - Rostock, Germany)
The bedrock of David Guetta's Nicki Minaj-featuring single "Hey Mama" is a sample of "Rosie," a 1940s prison recording from folk archivist Alan Lomax that songwriter Esther Dean first showed the French DJ on YouTube.
Kacey Musgraves originally offered "Follow Your Arrow" to her friend Katy Perry. However, Perry thought Musgraves should record the song herself as it seemed, "like something that you would totally say."