Songfacts®:

• "Go Back To Your Woods" is part of Robbie Robertson's concept album Storyville, which is set in the Storyville district of New Orleans around 1910, when it was a safe haven for prostitution and other vices. Music thrived in the area, building on the blues and jazz that was developing in New Orleans.
  
  In the song, Robertson sings about this time, even mentioning the "House Of The Rising Sun," a brothel in the area made famous in a song.
• Robertson wrote this with Bruce Hornsby, who also sang backing vocals. Hornsby recorded his own version on his 2003 release Greatest Radio Hits. The lyrics on Hornsby's version are different from Robertson's, except for the chorus. >>

  Suggestion credit:
  Justin - Felts Mills, NY
• New Orleans mainstays Art Neville (organ), Cyril Neville (percussion), Leo Nocentelli (guitar), George Porter, Jr. (bass) and Russell Batiste, Jr. (drums) played on this track.
  
  Members of the Wild Magnolias, a Mardi Gras Indian tribe in New Orleans, added vocals.
• True to form, Robertson recorded this in New Orleans at Kingsway Studio, which was owned by his fellow Canadian, Daniel Lanois. They both were fascinated with American music that came out of places like Louisiana, Arkansas and Mississippi. "I appreciated that he came there and got to work with some of the greats that were still around with us at that time," Lanois told Songfacts. "I appreciated that Robbie and all his knowledge would decide to come to my place and garnish it with all of his research and development."
• The video begins with a spoken intro:
  
  "Storyville. A section of New Orleans once dedicated to fast living, hot music, and moon-burnt nights. Man, if these walls could talk."