Billy Joel helped close down Nassau Coliseum in Long Island, New York earlier this week, but he wasn’t the only native New Yorker in the house. 

Seems, during Billy’s concert Tuesday night he brought out his good friend and “fellow Long Islander” Paul Simon (although he’s from Queens), to perform Simon’s hits “Me and Julio Down by the Schoolyard,” (which may be the best sing along song ever!!) and “Late in the Evening,” as well as the Simon & Garfunkel tune “Homeward Bound.”

Meanwhile, in addition to his many hits, Billy's set list also included covers of The Beatles' “Hard Day’s Night” and Led Zeppelin’s “Rock and Roll.”

Nassau Coliseum is set to undergo a $261 million renovation, and is expected to reopen December 16th.