Exactly. Its predicting based on how it was trained. Its not checking its work. It just not designed to do that. This is why Agentic is the buzz word. You can have one bot generating text and another checking it. But the one bot you interact with if that functionality is baked in isn't aware of anything. Its guessing.

The problem is not with AI. Its with the deception coming from people like Scam Altman.