It’s a problem when these people congregate around the choke-points of a centralized, bureaucratic technocracy and impose their personal neuroses onto the rest of society. Not only as policy, but as official canon on what is truth itself.
The final straw is when dissent is criminalized and plunder legitimized. When all actions against those dissenters are fair game, while any civil (and constitutionally protected) resistance is by definition reprobate, then we have arrived in dystopia. At the very least: authoritarianism.