This is the oldest song on The Civil Wars album and was penned by the duo before their debut set, Barton Hollow, came out. Joy Williams of The Civil Wars recalled: "Even though we didn't have our own recording of it, we started performing it live and it became a fan favorite. It made sense to finally put it on an album. One of my favorite moments on stage every night was singing the a cappella part together."
This won the 2013 Grammy Award for Best Country Duo/Group Performance. White accepted the award on behalf of the duo as The Civil Wars were on hiatus due to irreconcilable professional differences. He thanked his wife, four children and even their plumber during his acceptance speech but pointedly did not mention Williams at all.