This is why blocks also store a separate time stamp called "mediantime". The main "time" timestamp set by miners is allowed by consensus to drift within a certain window and still be valid. mempool.space displays the "time" of what miners set.
Computers don’t keep consistent time with each other. It’s a well known problem - clock drift. But it’s also likely some miners are using poor software/configurations that doesn’t mind time very well.