In his 2012 book Carpet Burns..., lead vocalist Tom Hingley says this uptempo number was the first single he cut with the band. Hingley was brought in to replace original vocalist Stephen Holt, who would replace him in 2011.
Running to 3 minutes 23 seconds, "Joe" was released on the Cow label in 1989 as a four track maxi-single. The following year saw three more releases including as a CD single.
Who is Joe? Apparently he was a tramp who used to hang out near their rehearsal studio.
Suggestion credit: Alexander Baron - London, England, for above 3