By Ariana Bacle
May 20, 2015 at 10:09 PM EDT
Jeffrey R. Staab/CBS

UPDATE: Foo Fighters confirmed via Twitter that they’ll be playing tonight’s show.

EARLIER: Back in 2000, David Letterman had the Foo Fighters on The Late Show for his first episode back after being away for surgery. “My favorite band playing my favorite song,” he introduced them, “Foo Fighters.” Now, 15 years later, his favorite band is coming back for one last hurrah: The Dave Grohl-led group will play Letterman’s final show Wednesday night, Rolling Stone reports.

“There’s something rock ‘n’ roll about Letterman,” Grohl told EW. “He’s just America’s number one smart-ass. He’s shaped generations of people. Everybody at some point has wanted to be like David Letterman.”

Foo Fighters latest album, Sonic Highwayscame out in November, but they might be performing something a bit older: Letterman’s been candid about how much 1997’s “Everlong” and 2006’s “Miracle” mean to him—and the longtime late-night host hasn’t been shy about getting sentimental in his last shows: He had Swedish folk duo First Aid Kit on the show May 7 to perform Simon and Garfunkel’s “America,” a song he used to sing to his son Harry.

The Late Show with David Letterman‘s final episode airs Wednesday at 11:35 p.m. on CBS.