According to reports, the singer also performed covers of Vic Chesnut's "Lucinda Williams" and Smith's "Wing," as well as renditions of "New York, New York" and Perfume Genius' "Hood."
R.E.M.'s Michael Stipe on Being Queer for 20 Years: 'Love Isn't Just Black and White, or Simple, At All'
The set represented Stipe's first major solo performance since R.E.M disbanded in 2011 and comes a few weeks after he told CBS This Morning that he would "sing again soon."
"I love my voice and I think it actually got better as I got older," Stipe told host Anthony Mason during the interview in which he admitted to maintaining his vocal chops by singing in shower. ''And I'm not bad. You would be surprised at my play list," joked the singer.
However, fans anticipating a R.E.M. reunion to happen any time soon shouldn't hold their breath.
"There's no point," Stipe said. "I love those guys very much and I respect them hugely as musicians and as songwriters and everything. But I just don't want to do that thing that people do. Total respect for those that do it. [But] I despise nostalgia."