This is a great point and I'm sure it happens.
The answer is likely some version of "We're still very early." There are more people who view bitcoin as a risky speculative asset and dump it when they flee to safety.