By Madison Vain
Updated March 11, 2015 at 10:24 PM EDT

Arcade Fire’s younger Butler sibling’s solo effort, Policy, officially released on Tuesday, and the artist brought his brand of indie rock to the Late Show with David Letterman to perform his 60s-tinged single, “Take My Side,” quashing any question as to whether he’d be able to handle the stage all his own. Butler, clad in a tuxedo and holding the only guitar on the stage, rocked it out. Check the performance out below.