This track was originally titled "Bomb the Pentagon," and debuted as part of Primal Scream's live set in summer 2001. In light of the September 11, 2001 attacks, both the lyrics and title of the song were reworked, and the revised version appears on Evil Heat. Frontman Bobby Gillespie explained to Q magazine: "It was about the kind of pornographic images of war and how it's sold to people. So it's not an anti-American song. It's an anti-military industrial, anti-war song."
Mike Campbell from Tom Petty & the Heartbreakers played the slide guitar on "Sixth Avenue Heartache." There is a connection here - Wallflowers lead singer Jakob's dad, Bob Dylan, played with Tom Petty in The Traveling Wilburys.