Robyn told the Metro newspaper October 25, 2007 about this song: "It's a fun song about any guy who thinks he's really cool but really isn't and I've got to tell him. There are a lot of rubbish men throughout the world but that doesn't mean every man is bad. The song applies to both romantic situations and also professional ones. There are a lot of men in the music industry that this song could apply to."
The song was criticized by the UK music press for including the word "Izan," which is "Nazi" backwards, in the chorus.
Some of Robyn's label executives wanted her to re-shoot the song's music clip. "When I did the video for 'Handle Me,'" she told The Guardian, "I had quite strong eyebrows, which now isn't a weird thing at all – everybody has eyebrows – but back then it was, like, considered being super unsexy, and I remember my American label wanting me to redo the video." Robyn refused.
Bruce Springsteen wrote "Blinded By The Light," which was a #1 hit for Manfred Mann's Earth Band. The "Madman Drummers" line is a reference to Springsteen's first E-Street drummer, Vinnie "Mad dog" Lopez.