Discussion about this post

User's avatar
Brandon Reinhart's avatar

Re: The less skilled you are at coding, the less you need it because your problems don't need it.

This is not true. Unskilled engineers and even opus 4.8 can write subtly bad bugs. Working with a smarter agent, when available, is footgun protection.

Michael Lopez Chiesa's avatar

The classifier section is the right layer, and the clean way to say it is that two numbers are getting conflated. A capability number is what the model can do (the exploit-rate figure). A supervision number is whether you can reliably stop it.

A jailbreak is a statement about the second, not the first, so Anthropic and the government aren't disagreeing about capability, they agree there. They're disagreeing about what an imperfect supervision number obligates. And since a safeguard is a classifier over an adversarial input space, demonstrated jailbreaks are the expected event, not the exception, so "recall on jailbreak" eventually recalls every capable model, pulling the safeguarded version while the unsafeguarded equivalents you mention keep running.

11 more comments...

No posts

Ready for more?