Reading this article through to the end now I think it is good stuff and insightful. The thing that stands out is the inherent statist bent to the author's call to arms for setting up a quasi-Manhattan project team to tackle AGI and ensure national security, alignment and supervision as the inevitable super intelligence emerges.
In other words: make sure the Americans get AGI before the "Chinese" or whoever.
I question what makes him think the US Govt is a more ethical and moral player though? He unironically cites Gulf War 1 (Advanced US tech vs old soviet Iraqi tech) and the A-Bomb as situations where the US used superior technology to commit unilateral murder, going on to imply that whoever gets AGI first (and specifically the ability to train AI AI-Researchers as a feedback loop) will be the first ones to the "bomb", but then seems to insinuate that it can only be the Americans who are allowed to have this tech.
He also talks about Covid and what a difference a couple of months of head start can make, even if it turns out it was the USG-affiliated labs behind the leak the whole time.
I would be keen to read another take on this topic that does not lean on the state or government to save the day, because they won't.
there are actually quite a few...this is the best one in my opinion.
reply