This acoustic song is the first track to be released by Kele Okereke under his full name; the Bloc Party frontman had previously gone by the moniker Kele for his solo material.
The song was inspired by Okereke becoming a father. He explained: "In the west African Yoruba religion, Yemaya is the mother goddess of the ocean, she is kinda the patron saint of pregnant women and fertility. According to myth, when her waters broke, it caused a great flood creating rivers and streams and the first mortal humans were created from her womb. When I knew we were having a baby she started to be appear in my thoughts and dreams a fair bit."