In an interview with the UK-based Soul singer Doris Troy on Spencer Leigh's On the Beat
radio show, Troy said that Stephen Stills was at a party in London and feeling lonesome as his girlfriend was back in the States. Troy got talking to him and said "Love the one you're with, Sugar!" Stills loved the expression and asked if she minded if he used it in a song. She readily agreed.
Bill - Liverpool, England