Christian Kuffner and Eve met one day in early 2000 and a night of inspired followed. Kuffner then recruited local violinist Joe McGinty who fell in love with the Irish and Cajun tunes Christian was busting out. Eve began teaching the others some of her Klezmer repertoire, and together the three-piece began performing under the name "The Zydepunks".

In early 2004, Christian convinced Joe Lilly, an old friend and a brilliant drummer used to playing in punk and heavy metal bands, to add his talent to the group. The Zydepunks took the New Orleans underground music scene by storm with their speedy and amped-up versions of European and Louisiana folk songs. Their diversity translates into the crowds the attract; at a Zydepunks show, youngsters can be seen throwing their bodies around the front lines, while the older generations soak up the tunes in the back.