I Love You, Honeybear is a loose concept record about Father John Misty's love for his wife, filmmaker Emma Garr. Q magazine commented that the album is very romantic in places. He replied: "I was terrified that I was gonna trivialize the experiences I was trying to write about. Emma told me that I couldn't be afraid to let the songs just be beautiful. 'When You're Smiling And Astride Me' was one of those songs that absolutely benefited from that realization."
Originally a chart-topper for Steve Lawrence in 1962 chart-topper, "Go Away Little Girl," became the first song of the rock era to be taken to #1 by two different artists when Donny Osmond's cover version also reached the summit in 1971.