Rival Sons' lead vocalist Jay Buchanan and guitarist Scott Holiday took a writing trip to a remote shack deep in the woods of south Tennessee to come up with songs for their Feral Roots album. This song started with a riff that Holiday came up with during their time there.
The guitarist recalled to ABC Radio that he came up with the idea of setting the amps and everything else out on the porch. Once they cranked up the amps, he came up with "this really dirty, menacing tone, going out over the water, over the entire holler."
While that riff was echoing through the woods, Buchanan took a solitary walk during which he thought up lyrics. The singer eventually came up with some religious imagery that fitted like a glove with Holiday's guitar work: "The song needed to be me, the devil, and then a woman between us," he said.