The Roon quote has multiple duplicated paragraphs, starting with "People who call themselves accelerationist scoff".
In the list of possible opinions of accelerationists, another possibility that you showed some weeks ago is "You think AGI is real and will kill us, but you are ok with it."
Instead of making people feel low status by analogizing AI to their parent, maybe try "you are to AI as Vladimir Putin's father is to Putin." Putin's dad was a war vet who fought the Nazis and got wounded during WWII. A total badass!
He brought up Putin to be a good communist (aligned) and a total badass (capable), reading the works of Marx and Lenin and learning judo from a young age. Putin was smart, speaking German as a second language and earning a PhD in economics.
Then he joined the KGB and eventually rose to become the leader of Russia, courted a friendly relationship with America, and now he's putting the world in a state of existential crisis. Then ask how much smarter and more ruthless the Putin-AI would have to be than Putin himself to make you feel like it's a genuine existential threat? My guess is that the answer is "not much."
NGL I'm a little suspicious of Nvidia funding all these unicorns. If you're REALLY supply constrained, why do you need to give a startup with no revenue $700M to buy GPUs from you?
You use 'mature' to describe what technologically advanced societies collectively aren't; I recall Eliezer Yudkowsky using 'sane'. Do you basically mean the following?
'Sharing a vision of the overall good, sharing a realistic plan for attaining that good, and - despite the absence of a hegemonic enforcer - never defecting.'
If so, might 'cooperative' and/or 'loyal' capture that better in a single word? They seem more appropriate for valiant pursuit of improbable success than 'mature' and 'sane' do.
Mature there was quoting Conor Leahy, I don't use that term. And when EY says 'sane' I think he means something rather less than the standard you describe...
EY claiming that security mindset is somehow genetic really rankles. Why is security mindset any less learnable than any other high level skill? Sure, some people are more naturally paranoid, but it's still possible to get good at being honest about the adversary's moves in a game, and anyone with appropriate incentives is likely to git gud, fast. Maybe Eliezer could spend time thinking about how to teach security mindset, the way people teach chess or poker, instead of giving up and justifying it by some determined-at-birth narrative.
I agree that more effort should be spent to learn how to imbue people with it. If someone doesn't already have it, it seems at a minimum like something that requires the person to want to learn, the same way you can't 'accidentally' learn to play, or force someone else to learn to play well, poker or chess.
Does he claim it's genetic, or just that if an adult doesn't have it it's too late?
There are a large number of skills that children in the right environment pick up but are extremely rare to pick up in adulthood because it would take years of focused effort without distraction. Full language fluency is the obvious example, but there are also rarer ones like Perfect Pitch
More wit and wisdom of Sam Altman:
https://nitter.net/nearcyan/status/1697322347701702962#m
The other 2% are e/acc.
The Roon quote has multiple duplicated paragraphs, starting with "People who call themselves accelerationist scoff".
In the list of possible opinions of accelerationists, another possibility that you showed some weeks ago is "You think AGI is real and will kill us, but you are ok with it."
"You can adopt" should be "adapt", twice?
Instead of making people feel low status by analogizing AI to their parent, maybe try "you are to AI as Vladimir Putin's father is to Putin." Putin's dad was a war vet who fought the Nazis and got wounded during WWII. A total badass!
He brought up Putin to be a good communist (aligned) and a total badass (capable), reading the works of Marx and Lenin and learning judo from a young age. Putin was smart, speaking German as a second language and earning a PhD in economics.
Then he joined the KGB and eventually rose to become the leader of Russia, courted a friendly relationship with America, and now he's putting the world in a state of existential crisis. Then ask how much smarter and more ruthless the Putin-AI would have to be than Putin himself to make you feel like it's a genuine existential threat? My guess is that the answer is "not much."
NGL I'm a little suspicious of Nvidia funding all these unicorns. If you're REALLY supply constrained, why do you need to give a startup with no revenue $700M to buy GPUs from you?
You use 'mature' to describe what technologically advanced societies collectively aren't; I recall Eliezer Yudkowsky using 'sane'. Do you basically mean the following?
'Sharing a vision of the overall good, sharing a realistic plan for attaining that good, and - despite the absence of a hegemonic enforcer - never defecting.'
If so, might 'cooperative' and/or 'loyal' capture that better in a single word? They seem more appropriate for valiant pursuit of improbable success than 'mature' and 'sane' do.
Mature there was quoting Conor Leahy, I don't use that term. And when EY says 'sane' I think he means something rather less than the standard you describe...
EY claiming that security mindset is somehow genetic really rankles. Why is security mindset any less learnable than any other high level skill? Sure, some people are more naturally paranoid, but it's still possible to get good at being honest about the adversary's moves in a game, and anyone with appropriate incentives is likely to git gud, fast. Maybe Eliezer could spend time thinking about how to teach security mindset, the way people teach chess or poker, instead of giving up and justifying it by some determined-at-birth narrative.
I agree that more effort should be spent to learn how to imbue people with it. If someone doesn't already have it, it seems at a minimum like something that requires the person to want to learn, the same way you can't 'accidentally' learn to play, or force someone else to learn to play well, poker or chess.
Does he claim it's genetic, or just that if an adult doesn't have it it's too late?
There are a large number of skills that children in the right environment pick up but are extremely rare to pick up in adulthood because it would take years of focused effort without distraction. Full language fluency is the obvious example, but there are also rarer ones like Perfect Pitch