You are describing a federated oracle system, and federated is not the same thing as decentralized. Oracles provide their service because they make an income doing it, and this income aligns the incentives of oracles to report as unified a price as possible. That incentive naturally aggregates them into a cooperative that controls the pricing mechanism of any system that relies on them.