pull down to refresh

5 sats \ 3 replies \ @cy OP 3 Jul \ parent \ on: Transformer based AI will not lead us to AGI/ASI and is just a hype machine AI
Letting AI evolve its own code and giving enough time and compute may get us there sooner than we think. Human brain has 500 trillion synapses vs 1.8 trillion parameters in ChatGPT-4. We similarly can do math much worse than a classical computer and suck at generating random numbers. Thought process in our heads is verbal and very similar to an LLM. This internal dialogue gives us self awareness. AI has huge advantage of replication, immortality and the speed of communication. I would not be so cocky.
I would agree if human synapses and neurons were similar to parameters of an LLM and if humans learnt through back propagation (which they don't btw), I am not talking about the quality of the math but how they do it, we know the rules of additions and apply it, LLMs memorize 2+2=4 and fail to generalize at 427382098402973498279382 + 9847293847203874892374923, it completely makes shit up. There is no "thought process" in LLMs at all, CoT is a sham, technically it's a prompting technique, pls read the paper I've mentioned in the original post.
I am not denying their usefulness, but do not bet on LLMs to come up with anything useful.
write
preview
5 sats \ 2 replies \ @SwapMarket 3 Jul
427382098402973498279382 + 9847293847203874892374923
can you generalize this? the latest chatgpt I tried solved a-level math exam problems that I already could not. so it is smarter at math than I am. we don't know how humans learn exactly, but neural nets were modeled after our brains structure.
reply
0 sats \ 1 reply \ @cy OP 3 Jul
yes I can generalize it, I know how to add 2 integers and how carry over works, AI does not. neural networks were modeled after the impulse flow/data flow of human neurons and are not based off of neurobiology (this is a common misconception).
you said chatgpt solved a math problem which you solved, it did so because the data was present in its dataset and has seen multiple problems like it, this is, as I said before a weird case of generalisation.
reply
0 sats \ 0 replies \ @SwapMarket 3 Jul
Not really. Despite 250x more synapses, you would need a pen and paper to add these numbers. LLMs don't have to count, but use tools like calculators for that.
reply