After recording Atlantic in Minneapolis, Rainer Maria and engineer Mark Haines returned to Madison, WI and the familiar confines of Smart Studios to begin work on their third album, A Better Version of Me.

During the recording session, the band recorded Hell and High Water and the single's exclusive B-side, "Paper Sack" (with Kaia on vocals).

As the predecessor to A Better Version of Me, this 7" was released in Fall 2000 and the front and back cover art are pieces of the front cover image that would later appear on the album.