This is why blocks also store a separate time stamp called "mediantime". The main "time" timestamp set by miners is allowed by consensus to drift within a certain window and still be valid. mempool.space displays the "time" of what miners set.