Shovels & Rope's third album has a recurring aquatic motif running through it, which is why they decided to title the record after this song. The duo explained to Uncut magazine: "It became clear that there were variations of the underlying theme as we assembled the song lists for possible record cuts.; We just surrendered to the whole damn thing. 'Oh, look dear! They are mostly all about water! Well, that will do I suppose. How 'bout we call it Swimmin' Time?!'"