pull down to refresh

they did so little quality control on the garbage they put in, that now they can make wild pseudoscientific claims on their own product, because it is apparently completely black box to them.

Fair. I did not read the paper but in the article they do hedge quite a bit.

Is the technology exponential there without the trust-me-bro consciousness, though? Without the AGI? Without the bullshit?

Yes. For some reason I expect consciousness to hitch a ride as these things get more capable, because I believe consciousness evolved in humans to support our capabilities.

Generally, I think humans are so amazing that when we want something like highly capable or conscious machines, it's only a matter of time.

Do you know why though? Why would a program be closer to you or I than to another program?

Because it's a program that has been trained to be a program and not programmed in the way your or I program something. It's programmed more like our genes are trained over millennia by our environment or like we train our brains by interacting with our environment. I feel myself reaching though so I know I haven't thought about this enough.

130 sats \ 1 reply \ @optimism 8 Jul

After thinking a bit about it, I think this is where our disconnect comes from:

Because it's a program that has been trained to be a program

I'd define it as it is a traditionally programmed program - be it with a lot of complicated math to make it useful - as the code is static and separate from the training outcomes.

All the "learning" is captured in the dataset (the weights) and, post-versioning freeze, in peripheral systems (skills, memory, system prompts that guide a path by manipulating input into the program, pre-sorting activations.)

That's why I have to stand by my point that for this to become closer to a human or an organism, the code has to be replaced by something that is mutating and self-learning.

When that "launches", there better be a grounding in consciousness or we risk ending up with a self-replicating, evolving swarm of intelligences that will probably cause a bit of a crisis. Luckily, we don't have that. Also, I hope that tools remain tools. It's nice to be able to offload some work.

reply

That makes me wonder how much self-learning is required for humanness because if it's a gate for humanness, it's probably a threshold. Otherwise, more self-learning would mean more humanness and younger people would be more human because they have an easier time learning. I'm not sure it's a gate to consciousness, but I accept that self-learning is an important part of humanness.

reply