One of the themes of Artwork is the concept of mortality. Frontman and songwriter Bert McCracken told Alternative Press that having previously lived a "reckless life," he came to terms with how easy it is to accidentally die after the tragic passing of Heath Ledger. This song is loosely based on the death of the Australian actor and not being able to say "sorry," or "I never meant to die" after an accidental death.
The Four Tops' "I Can't Help Myself (Sugar Pie Honey Bunch)" was written by the Motown team of Lamont Dozier, Brian Holland and Eddie Holland. The phrase "Sugar pie, honey bunch" was something Dozier's grandfather used to say when he was a kid.