Devil's Island was a penal colony in French Guiana active from 1852-1946. Even by island prison standards, it was notoriously brutal, and most inmates died there (the book Papillon, made into a movie in 1973, is written by Henri Charrière, who escaped from the island and told his story).
Dave Mustaine of Megadeth wrote this song from the perspective of a prisoner on the island, hopeless and confronting his inevitable death there.
Phil Oakey recorded his vocals for "Don't You Want Me" in the studio bathroom. The recording was disrupted by guitarist Jo Callis reaching through an open window from outside to repeatedly flush one of the toilets.