Al Kooper played piano and organ on this track. In his memoir, Backstage Passes and Backstabbing Bastards
, Kooper says that after the release of the Highway 61 Revisited
album, he was suddenly in demand for session work as an organ player. Strangers would call him up and offer him work constantly, even agreeing to pay him triple-scale. However, it turned out that all they were after was "the Dylan sound." The tip-off, he states, was that they would ask him to play the organ, even when he countered that he was far better on a guitar.
Al Kooper's memoir further tells a hilarious anecdote that happened on the road while Dylan and company were touring with this album. Apparently Bob Dylan was interrupted by a phone call in the middle of lunch, and tried getting the caller to try back later, but the caller was unmoved. So Dylan proceeded to cram his egg salad sandwich into the receiver of the phone, all the while explaining that it was lunchtime. He followed this by pouring milk into the phone, then thanked the caller for having lunch with them and hung up.