Yeah in the end we're still seeing incremental improvements. Their biggest issue will be grabbing users and mindshare from OpenAI and Google
Pretty amazing to achieve SOTA status after starting barely 2 years ago... Elon is a genius motivator (sounds exhausting really.. i would move to Meta and quiet quit).
Artificial Analysis Review comparing across foundation models:
view on x.comhttps://xcancel.com/ArtificialAnlys/status/1943166841150644622
still think it's a nothing burger, however their performance on ARC-AGI is impressive
Yeah in the end we're still seeing incremental improvements. Their biggest issue will be grabbing users and mindshare from OpenAI and Google
Pretty amazing to achieve SOTA status after starting barely 2 years ago... Elon is a genius motivator (sounds exhausting really.. i would move to Meta and quiet quit).
Rather sad that I would probably get a zero on Humanity's Last Exam unless it were multiple choice...
I'm assuming these results are more reliable than llama's benchmarks...