Michael Stipe of R.E.M. sings on this track and appears in the video. In a Songfacts interview with Hersh
, she explained how it happened:
"Michael took the demos for my first solo record off my manager's desk, so he knew the material and was keeping up with me while I recorded to make sure I don't wreck the songs. When he called the studio, his voice blended so well with the material that I asked him to sing backups, promising him that:
1) The record wouldn't be released.
2) That if it was, there'd be no single.
3) That the single would never be "Your Ghost."
4) Even if it was, there'd never be a video for it.
So he was basically off the hook. I believed all these things to be true and none of them were."