No, there is nothing wrong with amassing great wealth and influence when that influence is not coercive.
This is what happens under fiat when the government grows without bound, has a centralized monopoly on violence, and people utilize the government to exercise violence without skin in the game or fear that they might ever have to face