It's hard to avoid but the world doesn't stop when you're not there. Everyone can take his/her responsibility with you or without you. It's just that you're always available for everyone, maybe that creates burden. Learn to say No.