Most places that I've used wristbands for don't care about folks leaving without them. They're mainly to confirm ticket purchase and to confirm age for purchasing drinks. The bigger question is what to do if someone sees you mid-concert without a band, or (if you've got long sleeves) asks to see your band.