Several songs on LP1 were written by Stone about her boyfriend, whom she's known since schooldays when he was one of her brother's pals. She penned this song about the time she realized that she was falling for him. Said Stone to Mail On Sunday's You Magazine: "Sometimes everyone else can see what's happening but you're in denial and really are the last one to know. You're like, 'Go away from me. Go away!' But they just keep coming towards you like it's inevitable and there's nothing you can do."
Eddie Vedder often changes the words when he sings "Yellow Ledbetter." The basic story is about a guy whose brother dies in the first Gulf War. Apparently, bad news in the army is given in yellow envelopes.