Watch The Mountain Goats Play “Sicilian Crest” on The Late Show, Sing “This Year” Live with Stephen Colbert

The Mountain Goats visited The Late Show with Stephen Colbert Tuesday night, playing a song off their most recent album, as well as a fan favorite from their past.

Colbert himself joined in, surprising the audience and contributing vocals to the second performance.

The acclaimed indie-folk group, composed of frontman John Darnielle (vocals, guitar, keyboard), Peter Hughes (bass, backing vocals), Jon Wurster (drums) and Matt Douglas (flute, saxophone, clarinet, guitar, keyboard, backing vocals), kicked off their set with a spirited and soulful live rendition of “Sicillian Crest” off In League With Dragons.

The Mountain Goats released In League With Dragons, their 17th full-length studio album, via Merge Records in April.

In a web-exclusive extra performance, Colbert sang along with The Mountain Goats on their song “This Year.” Before joining in with the band, Colbert said to the audience:

The Mountain Goats’ new album is called In League With Dragons. This next song is not on that album. It’s a great album, but this song is not on that album. I asked them to play this song for me because it’s one of my favorite songs of theirs. Ladies and gentlemen, The Mountain Goats.

The folk-rockers then began strumming the intro chords to “This Year,” off their 2005 album The Sunset Tree, a beloved fan-favorite song that now has over 13 million Spotify streams.

A little over one minute in, Colbert jumped onstage, harmonized with Darnielle and danced to his favorite Mountain Goats track, garnering cheers and applause from the crowd.

Watch both performances below and revisit a 2009 Mountain Goats performance from the Paste archives further down.