Songfacts®:

• The song's title is lifted from a line in Guys and Dolls said by the character Sarah Brown. Amos explained to The Canadian Press why she chose that particular quote for both this song and the album title: "Musical theatre has entered my life because I'm working on something called The Light Princess and have been for a while... So I just happened to be watching a lot of musicals, and Guys and Dolls was something that was on replay. So when I heard (key character) Sarah Brown, someone else who has been influenced by religion... say, 'abnormally attracted to sin,' I know that very well. And that became the title of then project."
• On the album Amos explores the relationships between women and power. She explained to Billboard magazine: "I am kind of fascinated with the idea of erotic spirituality. But first, I wanted to investigate what people are attracted to. Some of the songs are about situations where people are struggling with their power, and find themselves attracted to people that have power over them. Dominance has become an aphrodisiac for some women. But there are also songs about women finding their inner strength."
• Photographer Karen Collins shot the album artwork. Amos told Billboard magazine that she loves the way Collins shoots women. The singer-songwriter explained: "It's not vulgar or demeaning, but I find it just sexy. They look empowered to me and I like her style. I felt that if we were gonna walk this line of erotic spirituality, which is quite a line to walk, I realized the two words don't necessarily usually end up on the same table together in the same sentence. But it was a delicate line to walk."
• Instead of filming traditional music videos for the album, Amos opted to create a series of "visualettes" for 16 of the 17 tracks (excluding "Mary Jane"). With director Christian Lamb at the helm, they used footage from an unreleased documentary of the singer's 2007 American Doll Posse World Tour and shot new material to help express the meaning of each song. She explained in a promotional interview: "I began to really think about the idea of a story being told through the visuals and yet the song itself giving us all the information - that's our dialogue. I didn't want any lip-syncing." The new footage was shot in 8mm to reflect the "late '60s, indie kind of feeling and that began the visualette world."
  
  In the visualette for this tune, Amos does the very thing she warns us not to do in the song: She goes to church. Despite singing, "Don't go in if you're abnormally attracted to sin," she visits the chapel and kneels at the altar.
• Her tenth solo album, this is somewhat of a return to form for the singer, whose past four releases were more conceptual - from the overarching story of a cross-country traveler on Scarlet's Walk to the exploration of her alter egos on American Doll Posse. This time around, she's back to being Tori Amos using her personal experiences to fuel her confessional stories. "It is not a concept album," she explained. "It is a red-headed woman singing songs."