This acoustic song is the first track to be released by Kele Okereke under his full name; the Bloc Party frontman had previously gone by the moniker Kele for his solo material.
The song was inspired by Okereke becoming a father. He explained: "In the west African Yoruba religion, Yemaya is the mother goddess of the ocean, she is kinda the patron saint of pregnant women and fertility. According to myth, when her waters broke, it caused a great flood creating rivers and streams and the first mortal humans were created from her womb. When I knew we were having a baby she started to be appear in my thoughts and dreams a fair bit."
The TV show Cheers was nearly canceled after its first season, but the theme song, "Where Everybody Knows Your Name," was very popular. To satisfy viewer demand, the theme was made into a full song and released as a single.