At the completion of the Limbo tour, Hersh disbanded Throwing Muses, claiming that it was no longer economically feasible to continue with the band. The acoustic-based Strange Angels, her first post-Muses album, was released by Rykodisc in February 1998. That year, she also released Murder, Misery and Then Goodnight, a collection of lullabies and Appalachian folk songs, as a Throwing Music exclusive. In 1999, Hersh and Throwing Music returned to her original label, 4AD, for Sky Motel, 2001's Sunny Border Blue, and 2003's The Grotto. Hersh also established the Works in Progress series, a subscription service of exclusive rarities, through Throwing Music's website, www.throwingmusic.com.
Hersh also released another Throwing Muses album in 2003, then collaborated with Muses bassist Bernard Georges in 50 Foot Wave, a more rock-oriented expression of her sound, for 2004's self-titled EP, 2005's Golden Ocean, and 2006's digitally released Free Music EP. In 2007, Hersh released another solo album, the intense Learn to Sing Like a Star. Cats and Mice, an unedited performance recorded at Yoshi's in San Francisco, was issued in 2010. That same year, Hersh published her memoir, Rat Girl, which focused on events in her teens from 1985 to 1986. Also in 2010, she released the album Crooked via her website. 2013 saw the release of a new Throwing Muses LP, Purgatory/Paradise, and in 2015 Hersh published a new semi-memoir titled Dont Suck, Dont Die: Giving Up Vic Chesnutt, which focused on her long friendship with the late singer/songwriter. Wyatt at the Coyote Palace, Hersh's first new collection of solo recordings in six years, dropped in November 2016. ~ Stephen Thomas Erlewine, Rovi