well, at least for me, i get grossed out when bodily crud gets on fingers.

if somebody picks their nose it is gross. if you pick your teeth it is also considered gross. i think it has to do with likelihood of nastiness getting on fingers and therefore on other things as well.