pull down to refresh
I avoided that market because it's not clear to me what constitutes an LLM beating a grandmaster. ChatGPT can already beat Magnus, all it takes is a very simple tool call to Stockfish.
ChatGPT can already beat Magnus, all it takes is a very simple tool call to Stockfish.
isn't that sort of what the point of such a challenge would be? Not just mimic Stockfish, but actually use the everyday retail usage models of Chat (or Fable or Opus, because they apparently grasp chess better) and see when they can beat a human
But every day retail usage can already to tool calls I think. So you'd have to get pretty specific about the terms of the challenge, which is why I'm avoiding that market
yea, true. Weird bet -- and it's too far into the future to tempt me, anyway.
I’m more concerned that they simply won’t hold a qualifying event. It seems pretty obvious that the capability will exist.
what, chess players? Predyx?
Kasparov was beating by IBM's computer almost thirty years ago; chess LLMs, the original neural nets, beat humans not long after that. Existing and popular general purpose LLMs like Gemini or Fable or Opus etc have gotten seriously good recently... but still just hallucinate insane (often illegal) moves on, like, move #25.
GothamChess's AI rundown battles were more fun a few years ago, when the machines could not grasp chess, but just argued back against the players: "No, of course I can put my queen there; No, you're wrong, I would like to just spawn a dead knight into the middle of the board"
that's way too far out to meaningfully do anything about. Are LLMs gonna get radically better? How fast? Will any chessplayer even bother beating them, will it be fun or exciting? Like, the IBM-Kasparov thing was cool but these days nobody cares.
Also, the specialized chess engined (Leela, Stockfish) are still gonna be vaaaastly better than the general-purpose LLMs, so what's the point?
The point is to settle this bet in my favor. That should be enough, shouldn’t it?
Speaking of Predyx markets, when are these guys gonna man up and get their asses kicked by an llm.