By Dana Rose Falcone
Updated January 08, 2016 at 05:15 PM EST
Credit: Myrna M. Suarez/WireImage

Billy Joel is a man of his word. After inviting Jimmy Fallon to join him on stage during an appearance on The Tonight Show earlier this week, Joel brought the late night host out at Madison Square Garden Thursday night.

The two New Yorkers dueted on “Sherry,” “The Lion Sleeps Tonight,” and “Unchained Melody” at Joel’s January show during his residency at the iconcic New York City venue. Fallon also rocked a New York Rangers hockey jersey during “Start Me Up.”

WANT MORE EW? Subscribe now to keep up with the latest in movies, television, and music.

On the Tonight Show Wednesday, Joel and Fallon sang “Beast of Burden” together on air, and during a commercial break, broke into “For The Longest Time” with special guest J.K. Simmons.

See the late night performances here, and watch Fallon and Joel together at MSG below: