Lady Antebellum closed Thursday night's episode of CBS's 'Late Show With David Letterman' with a performance of their most recent No. 1 hit, 'Just a Kiss.' The trio recreated the version fans will find on their album 'Own the Night' when it hits stores on September 13.

After the song finished, Letterman thanked Charles Kelley and Hillary Scott before beginning to promote their new CD. It took Dave Haywood a moment to walk around his piano and join his bandmates, and the talk show host didn't miss a chance to joke about his late arrival. "Are you with the band?" Letterman asked jokingly. "I'm joining today," Haywood shot back.

'Just a Kiss' is the first release from 'Own the Night,' with 'We Owned the Night' being Lady Antebellum's current single. They'll be making frequent television and radio appearances in the coming weeks to promote the album, including the NFL kickoff concert on September 8 before the first game of the year. Their set -- along with Kid Rock and Maroon 5's -- will be partially aired during NBC's pre-game coverage.

Watch Lady Antebellum Perform 'Just a Kiss' on 'Letterman'