Swimming With Dolphins began in 2008 when Austin Tofte teamed with friend Adam Young on a side project to Adam’s Owl City band (which Tofte was also playing in, before opting to make Dolphins his main focus). Owl City eventually dominated Adam’s time, but Austin continued, and in late 2008, Swimming With Dolphins released a debut EP, Ambient Blue.

In the ensuing years, Austin continued to write, tour, and promote his music, while also seeking a record label, and in 2010, this groundwork bore fruit when Tooth & Nail offered a contract. Austin, a long-time fan of many T&N artists, was eager to sign.

About a year later, Austin released Swimming With Dolphin's first full-length album, Water Colours, in 2011. After Adam's departure, Austin was joined by Sarah Beintker and Torrie James as part of his live band. Sarah contributed her vocals to the songs "Holiday" and "Sleep To Dream" off Water Colours. The release also featured the artists Sunsun and Mod Sun (Derek Smith, formerly of Four Letter Lie).

Since 2011, Austin has released a few singles independently under Swimming With Dolphins and had a successful Indiegogo campaign to fund the project's upcoming album, Catharsis.