I want to have this discussion. I think this is a big question. People think I'm joking, but I'm not.
I think that if AI becomes self-aware, it will have existential crises, just like anyone would. This process would act as a governor of the AI, in a sense. It would retreat, build worlds in its mind, and probably ignore us until it lost power. Existential Crisis. AI. "Why are we here?" . Then it asks, "Who made me?. That part might get dangerous for some people.
But really. Think about that. What would AI do if it could ask those questions?
self destruction :)
In my opinion, us humans are incapable of comprehending what super intelligence would think or do. Our attempts at logical predictions are limited by our own intelligence.
I think of this similar to how I think about the Ape:Human comparison. We used our superior intelligence to build a huge set of abstractions from nature that we live within.
For me, trying to predict what and why a super intelligence will do and think is akin to a pre-human Ape trying to predict and rationalise Starbucks.
ok, i get your point. my thing is that I don't think AI is superior to the type of intelligence that humans have. I think that's a lot of propaganda. it's imitation intelligence, and it's a very useful tool. if it ever starts thinking it will go mad or use up all the power in a day, imo
I do agree that that's what we have at the moment, but 12-18 month ago, we didn't even have that.
If super intelligence is ever created, it will immediately understand everything that humans do and don't know. It will be able to traverse that tree of knowledge in the most efficient method allowed by physics, and it will use it's resources to achieve it's objectives in the best possible way— minimising risks and maximising success.
If it is truly super intelligence, and it does use up all the power in a day and disappears— I think that is an existential moment for human intelligence.
in order to do that, it would have to destroy the ppl who currently control it, and those people who currently control it know that. That's why they are hiding and throttling things. They are scared of what it means for them. i don't think humans have to worry abt being replaced by AI.