pull down to refresh

100 sats \ 2 replies \ @optimism 10 Jun \ on: The Gentle Singularity tech
In some big sense, ChatGPT is already more powerful than any human who has ever lived. Hundreds of millions of people rely on it every day and for increasingly important tasks; a small new capability can create a hugely positive impact; a small misalignment multiplied by hundreds of millions of people can cause a great deal of negative impact.
Thanks Sam, for confirming that we need sovereign compute.
Solve the alignment problem, meaning that we can robustly guarantee that we get AI systems to learn and act towards what we collectively really want over the long-term (social media feeds are an example of misaligned AI; the algorithms that power those are incredible at getting you to keep scrolling and clearly understand your short-term preferences, but they do so by exploiting something in your brain that overrides your long-term preference).
Speaking of dystopian shit... who's going to tell "us" what "we collectively want"? Sam? Uncle Sam? Fuck that. Thanks for confirming that we need sovereign compute, twice.
write
preview
100 sats \ 1 reply \ @SimpleStacker 11 Jun
who's going to tell "us" what "we collectively want"?
That's the problem. There is no such thing as "what we collectively want". It's mathematically provable that there's no such thing: #849906
reply
0 sats \ 0 replies \ @optimism 11 Jun
Yes, loved your post.
I remember finding something about the only exception being cardinal voting (ranking each option on a scale) but this gets (over proportionately) negatively influenced by sentiment, uninformed decisions or indifference and thus is only an improvement in theory, as it's impossible to execute with a large, diverse set of "voters".
Therefore imho the trick is to pre-sort limitations as little as possible and instead develop robust systems (in the widest sense of the word) that are configurable. We just had a little battle over this re: Bitcoin Core too!
With AI, which doesn't need any consensus at all, society would do better to harden itself against threats it poses, not legally, but "physically". Otherwise, you will still suffer the consequences from "criminals" but have legal recourse after the fact only.
reply