There are enough of us. We're just spread out globally.
I would bet that if just 10% of the global Bitcoin community moved to a chosen area, they would be enough to make an average sized U.S. city. And it would thrive and become and example to the world.