I'd explain that some people are less fortunate and there is a moral obligation to help them. Doesn't have to be by giving money, could be a job, or food, etc. I'd also explain that this moral obligation doesn't grant the dude a corresponding right to my money, and that believing otherwise is a slippery slope to communism.