Why do people find it so exciting when LLMs say outrageous things?

Scoresby

I was thinking about [this post](https://punkx.org/jackdoe/code-and-trust.html) about trust in LLMs when it comes to the code in pacemakers. The author ends with this post script:

> as I was writing it I discovered that I am truly horrified that my car's breaks will be programmed by a contractor using some local 7b model that specializes in writing MIRSA C:2023 ASIL-D compliant software. 

Outrage based on fuck ups that kill/harm people is already here -- but maybe we can expand that base to include less catastrophic outcomes: "No, I'm not using a model that gets basic details wrong."

