50 sats \ 0 replies \ @quark 10 May \ on: Has generative AI already peaked? AI
No no. It is barely starting, not peaked. "We are so early". That phrase sounds familiar hmmmm heh
Look for example 1.58 bit weights quantisation which is a totally new way to train. We'll need new chips but it will be much more efficient.
There are people researching new AI methods that resemble more how the human brain works, which is excellent in efficiency.