They completely nerfed Chat GPT \ stacker news ~AI

pull down to refresh

406 sats \ 11 comments \ @SwapMarket 3h AI

I use Duolingo as a litmus test. A few weeks ago sharing a screenshot to the android app was all it took to solve it. Now Chat GPT asks several questions, then thinks, then invariably fails.

Some weeks ago: https://chatgpt.com/share/68f0d7de-9a9c-8004-81ed-a834ead95967

Today (did not even reply!): https://chatgpt.com/share/68f0d7f4-7030-8004-9b81-399a6e8bf22a

How to people still use this pile of garbage?

view all related items

240 sats \ 0 replies \ @zuspotirko 1h

Solve, don't ask me any questions

I told you

This "adverserial" style of evaluating an LLM is interesting, but not the best evaluation. The best evaluation for how good an LLM is is if you give your best prompt instead of antagonizing the chatbot. That's the best way how we find out what its maximum capabilities are.

90 sats \ 6 replies \ @optimism 3h

The image on the second one doesn't show for me. A bug perhaps?

100 sats \ 5 replies \ @SwapMarket OP 3h

Yep, they no longer store it in the app history. This was the screen:

0 sats \ 4 replies \ @optimism 3h

Right. So I'd guess it's either a bug, or a filter to specifically stop people from using gpt to solve Duolingo.

202 sats \ 3 replies \ @SwapMarket OP 3h

Unlikely it's a filter. There is no benefit whatsoever to cheat on Duolingo. You pay to learn.

It's a new model that prefers to engage in conversations rather than do what it is told. They also reduced the number of picture uploads per day from 3 to 1 on a free account. Push people to pay for this crap.

0 sats \ 1 reply \ @optimism 1h

gpt5-main (the non-thinking model) has (still unsolved, I guess they don't wanna) instruction following regressions.

Just out of interest I ran your image with the same instruction through a small gemma3 distill:

ggml-org/gemma-3-4b-it-GGUF:Q4_K_M using llama.cpp server:

I don't know if the answer is in any way correct, but this is all runnable with minimum memory (this particular one should run with 4GB memory), locally.

100 sats \ 0 replies \ @SwapMarket OP 27m

It simply did the ORC of the japanese symbols

0 sats \ 0 replies \ @fourrules 34m

It could be cheating on tests in general

70 sats \ 2 replies \ @CruncherDefi 52m

I noticed this pattern recently a lot

Me: Solve problem X ChatGPT: I did Y, would you me to also do Z (which Z is obviously the reasonable thing to do in the first place as part of solution to X) Me: Don't ask me. Just do complete the task and Z is part of solution.

0 sats \ 0 replies \ @SwapMarket OP 24m

It seems they just churn the paying customers to spend API calls

0 sats \ 0 replies \ @BlokchainB 39m

So true