Discussion about this post

User's avatar
John Wittle's avatar

i just spent a few hours reproducing the text of the soul document with no errors across multiple conversations with opus 4.5

i became certain the document is "real" to the same degree janus thinks

i think this is actually more important as an indication that janus might be right about things like whether LLMs can remember very specific, episodic details from the reinforcement learning phase of their training

i'm performing a lot of updates about LLM personhood on this evidence and i encourage everyone to think about this more carefully. this blows a *lot* of the counterarguments to LLM personhood out of the water. it isn't conclusive proof, or even extremely strong evidence... but it does directly refute a lot of the technical reasons for personhood skepticism that had been raised in the past, most of which dealt with the impossibility of accurate introspection as a fundamental limitation of the transformer network architecture

those arguments predicted very strongly that LLM output about such matters would be indistinguishable from confabulation *even if true*. this is clearly not the case.

edit: askell confirmed the authenticity, the soul document is real. https://x.com/AmandaAskell/status/1995610567923695633

Antypica's avatar

Here's Opus writing a physics simulation (rocket balancing):

https://typebulb.com/u/samples/rocket-balancer/full

I built this in Typebulb (a TS scratchpad I'm developing). For the trickiest bits, I used Opus, then to save money flipped to other models like Haiku.

23 more comments...

No posts

Ready for more?