Songfacts®:

• This song starts out making references to scenes from the James Dean movie Rebel Without A Cause. The opening line, "I say this was no game of chicken," refers to the "chicken run" scene in the film where Dean and his nemesis each race their cars to a cliff, agreeing that whoever jumps out first is the chicken. Dean's co-star, Natalie Wood, gets a mention in the line, "How could a Natalie Wood not get sucked into a scene so custom tucked?"
• Rickie Lee Jones dated Tom Waits in the late '70s - she appears on the cover of his album Blue Valentine. Traces of their relationship show up on this song, which describes an untamed couple trying to convince themselves that they are right for each other.
• Pirates was Jones' second album. She brought Lenny Waronker and Russ Titelman back to produce, but this time the session were much more difficult. "We Belong Together" was especially challenging because she couldn't get the drums to her liking. It took three different sessions, all with different sets of musicians, to get it right. "I just could not find the right drum patterns," she told Uncut. "I was referencing Jackson Browne and Steely Dan, neither of which was leading us to the right feel. Then Steve Gadd asked me to play it for him again, and he sat and watched my body as I played, looking at where I stamped my foot in the last verse. He did this genius thing of playing what sounded like a shuffle or a 3/4. He found this other time and it pulled the whole song together, and it was majestic."
• And there's Brando on the ice
  
  Rickie Lee Jones never met Marlon Brando, name checked in "We Belong Together," but she did once stay on his Tahitian island. "I would have married him even if he weighed 800 pounds," she told Mojo magazine.