It's rosin not chalk. It is derived from the sap of a fir tree. It's a powdery substance that get tacky when mixed with sweat so they can grip the ball better.

This is a cool story but they don't allow MLB pitchers to use any of this stuff anymore. Only rosin and sweat. They can lick their fingers if they are dry but not while they are on the mound.