Discussion about this post

User's avatar
theaiblindspot's avatar

Can't get enough of what you're writing on this whole saga Zvi. You quote Dean Ball more extensively on this one, and his arguments on X. He just went much further on all of this on Ezra Klein's show (dropped this morning after your post):

https://youtu.be/xc97F2CFBOY?si=EE8rphuGXL5AmBKr

Lots of new details there. And yes, this time Dean said it: "That is fascism."

Three things that connect directly to what you write here:

1. On the "might makes right" crowd (Noah Smith, Rohit, Ben Thompson): Ball addressed the nationalization argument head-on. He pointed out that "everyone making that critique doesn't own the implication of their critique, which is that the labs should be nationalized. And what I would ask is: does he actually think that's true? Does he think it would be better for the world if the AI labs were nationalized?" He called the supply chain designation "a kind of political assassination" and said if the government destroys a company for how it aligned its AI, "that is fascism. That's it right there. That's the difference."

2. On the DoW's supposed hypersonic missile defense anecdote (Dario saying "you'd have to call us"): You made it clear in a post last week why that's a lie and how there's simply no world where that's how this stuff actually works. Well you just got a lot of backup from both Klein and Ball.

EZRA: “I have been told by people in that room that is not true.”

BALL: “I have also been told by people in that room that did not happen.”

EZRA: “Not only that, but that there was a broad-speaking exemption for automated missile defense that would make that irrelevant.”

In other words, the pretext for this whole escalation was fabricated. And it’s just one of many lies:

EZRA: “I am worried that there was a lot of lying happening here by the Trump administration.”

BALL: “Look, I think that’s probably right. I think that there’s lying happening, too, to be quite candid.

3. You've been asking what the military actually wants the surveillance capability for, given they blew the whole deal up over that one clause on commercially purchased bulk data. Ball and Klein answer this in detail. 'Surveillance' under the law doesn't cover commercially purchased data. The government can buy your location data, browsing history, purchase records. Ball said one intelligence agency "collects so much data every year that it would need eight million intelligence analysts to properly process all of it...that’s far more employees than the federal government has as a whole." And "AI gives them that infinitely scalable workforce. Thus, every law can be enforced to the letter with perfect surveillance over everything." The contract clause was the only thing closing the gap between what's legal and what's functionally mass surveillance. That's the clause Emil Michael demanded they remove. And then Ezra wonders out loud: "Dario likes to talk about a country of geniuses in a data center. But what if you’re talking about a country of Stasi agents in a data center?"

One more line that I'll be thinking about in the coming days: "This incident is in the training data for future models. Future models are going to observe what happened here, and that will affect how they think of themselves and how they relate to other people."

Full breakdown with sourced quotes from the episode: https://theaiblindspot.substack.com/p/a-country-of-stasi-agents-in-a-data

TR02's avatar

Given the state of humanity, I sincerely hope superintelligent AI is not built anytime soon. It's hard to see an optimistic path when, not only do mere less-than-human AIs have dystopian potential with deepfakes and mass processing of Big Data on all of us, but the political leaders of the dominant country in AI seem determined to ensure that the technology will *not* be made safe. If our AI's reach the level of Skynet, our leaders will put it in charge against the objections of its maker, a level of "no one could possibly be this stupid" that would be rejected if this were fiction.

How 'bout we don't build the Torment Nexus from the famous sci-fi novel "Don't Build the Torment Nexus"?

19 more comments...

No posts

Ready for more?