pull down to refresh
0 sats \ 1 reply \ @Catcher OP 27 Jan \ parent \ on: DeepSeek is super censored (My Experience) tech
Question is - what is the source / prove that DeepSeek in fact used only fraction of what OpenAI used?
From the avrix (sp?) paper that they released. I was skeptical of this, but evidently its completely open-sourced and thus verifiable.
People on twitter have said most of this "breakthru" was common sense tuning optimizations that resulted in less memory use, with a slight uptick in error rate, but the optimizations were scaled so that the increase in error rates didn't spike significantly.
Basically: Anyone with a constrained hardware budget would've eventually taken this approach.
reply