This was a very important song for Sparks, as it got them over a creative hump. "It came at a time when we had written a whole album worth of songs and we weren't 100 percent enthused," Ron Mael said in a Songfacts interview
. "We had good songs, but it seemed like just doing good songs at that point wasn't enough to inspire us. So, it was really attempting to start from zero.
The song 'Rhythm Thief' was working in a way that had worked before and it really pushed us to do a whole album that felt more motivated. I really like that song, and really what it meant creatively to what came after that."