The Byrds recorded this song on their 1968 album Sweetheart of the Rodeo
at the suggestion of their guitarist, Gram Parsons. Parsons originally recorded the song himself but due to contract problems preventing him singing on the album, his vocals were replaced by guitarist Roger McGuinn
McGuinn has claimed that the Louvins song was the only one on the album where he was tongue-in-cheek. The Byrds bassist Chris Hillman was unhappy about McGuinn's re-recording. He told Uncut
magazine March 2008: "I found the song on the borderline of being offensive. Gram's vocal is more sincere. He was very religious, underneath it all. Even with his excesses. There's an undercurrent, I guess because of his Southern upbringing. He was like a little Christian boy who went backsliding."