This was on Devendra's Banhart first set for XL Recordings after he'd recorded three albums and an EP for Michael Gira's Young God label. In an interview with Mojo Magazine January 2008, Banhart was asked how much Michael Gira helped in getting him up and running. He replied: "With the song 'I Love That Man,' people thought it was about what I think of groupies, or people in audiences think of me. It was actually a song about Michael Gira. I would definitely 100% not be sitting here now (if not for him). I'll never forget the day I was sitting in this piece of s--t place, no electricity or heat in the winter, reading Mojo, shivering and reading a quote with my name on it - what a feeling. It was amazing. It was the best feeling."
Originally a chart-topper for Steve Lawrence in 1962 chart-topper, "Go Away Little Girl," became the first song of the rock era to be taken to #1 by two different artists when Donny Osmond's cover version also reached the summit in 1971.