Rob Wiblin

And he replied, because that's where the money is.

Well, why would an AI attack an AI company?

That is where the compute is.

And on top of that, they're also highly intricate and sensitive machines that are basically very vulnerable to sabotage, both by AIs and foreign adversaries.

META's new methodology is set up to assess the safety of internal deployment in a credible way every six months, even if the models concerned are never published.

Companies could try to do this themselves, but there's several reasons META is in a better position to do it.

As an external party, they're less commercially conflicted.

As outsiders, they might have an easier time spotting mistakes a company has missed in their own setup.

And with the companies locked in a really fierce commercial race, they're probably glad that they can hand this task over to someone else and focus on making money and getting customers.

Anthropic co-founder and head of policy, Jack Clark, he recently wrote that he thinks there's a 60% chance that one AI company or other will hand over the task of developing AI to its own AI model by the end of 2028.

Let's imagine he's right for a moment.

I would bet that when that moment arrives, Claude Mythos 4 and Claude Mythos 5 that gets trained by Claude Mythos 4, those kinds of models won't be available to you and me, that their cyber capabilities will be too worrying, their ability to generate new pandemics will be way too alarming.

Everyone will be worried that Chinese AI companies are going to distill them, that that field will loom large.

And in any case, Anthropic will wander through as much of its compute as possible back into its own recursive self-improvement loop, not be offering it to customers.

As that scenario plays out, we're not going to be quibbling about what sort of user permissions Claude has.

It will have every permission under the sun.

It is the staff member.

And we won't be debating how good it is at coming up with escape plans.

A model good enough to fully replace Anthropic Staff won't be hiding its secrets in base 64.

It'll be able to come up with proper plans to keep things secret.