Trust the Model the Least. I've Been Building That at Home for Months.
This weekend Satya Nadella published 'Models as Insider Risks in the Super Intelligence Era': separate the supply of intelligence from the authority over it, put the controls outside the model, and build systems that let us trust the model the least. I agree, and I didn't have to start this weekend. On my own hardware and my own time I've been running that architecture for months: receipts that need outside proof, a judge that isn't the model being judged, frontier and local models graded side by side every night, and a public log of every time my agents got it wrong. Here's the map from his 7 principles to what I run, where local models take it further, and where I'm not there yet.
BLUF (bottom line up front): This weekend Satya Nadella published Models as Insider Risks in the Super Intelligence Era. His line: “The most trustworthy Super Intelligence system will not be the one with the model we trust most. It will be the one that enables us to trust the model the least.” I agree, and I didn’t have to start this weekend. On my own hardware and my own time I’ve been running that architecture for months, and I’ve been writing it up in public as I…
