This song was influenced by French 1940s and '50s popular singer Edith Piaf. Elson borrowed the title from an old book of parlor songs and combined it with her own words. "I love the vaudeville feel to it," she told Spinner UK. "I love that sort of music. Not to sound biased, I'm sure there's room for computer gadgetry but I felt very proud that we just went in there did it. That's why the influences were so varied."