Would this not create a more robust system?

I have zero expertise, just interested to know the answer. I assumed taking an average from peers would make it more difficult to propagate faked / invalid timestamps.