Given the alarmist headlines on AI and existential risk that are currently flying around, I dug out an old 2018 Risk Bites video on AI risk. It’s still relevant, eight years later.
It's interesting, having written a novel on this very topic, how I fear they're turning it into a playbook and not a warning. Because the biggest threat from AI isn't AI... it's our lack of understanding about what it means to be human.
I don't know if you've seen it yet, but it works in a lot of the work I did with BDJ and Threatcasting.
What's new this time is how close we are to RSI, which automates making AIs cleverer, and how far we are from automating alignment, to keep them from doing bad things. If the rate that AIs get clever progresses at machine scales, but the rate that AIs learn not to do bad things progresses at human scales, we will inevitably get very clever AI that doesn't know how not to do bad things. That won't be good at all
I agree. The part that I've been most annoyed with is, yes, the Valley has been talking about these risks for years and years but the media has mostly yawned - the Eliezer Yudkowsky and Nate Soares book came out last year and pretty much died on the vine (to be fair, it was pedantic and hard to read so the messenger matters) - now, with a "sci-fish" incident over the summer, they are suddenly reporting the same things. I guess it has woken up the public but is fear mongering the way to do it?
It's interesting, having written a novel on this very topic, how I fear they're turning it into a playbook and not a warning. Because the biggest threat from AI isn't AI... it's our lack of understanding about what it means to be human.
I don't know if you've seen it yet, but it works in a lot of the work I did with BDJ and Threatcasting.
https://www.thesingularitychronicles.com
Ayubj49amd@gmail.com
Ayubj49amd@gmail.com
What's new this time is how close we are to RSI, which automates making AIs cleverer, and how far we are from automating alignment, to keep them from doing bad things. If the rate that AIs get clever progresses at machine scales, but the rate that AIs learn not to do bad things progresses at human scales, we will inevitably get very clever AI that doesn't know how not to do bad things. That won't be good at all
Made yesterday. I add weird shit for perplexing nosey wife.
Edit: wrong note! Lol.
I agree. The part that I've been most annoyed with is, yes, the Valley has been talking about these risks for years and years but the media has mostly yawned - the Eliezer Yudkowsky and Nate Soares book came out last year and pretty much died on the vine (to be fair, it was pedantic and hard to read so the messenger matters) - now, with a "sci-fish" incident over the summer, they are suddenly reporting the same things. I guess it has woken up the public but is fear mongering the way to do it?