Daniel Kokotajlo

And now we have genetic evidence for the Yamnaya, which we believe is this group.

You have a blog where you do this.

This is your job, Scott.

So why shouldn't we hold the fact that language models can't do this more against them?

I mean, it seems like such an economically valuable... But how would you set up the training environment?

Well, maybe that's why you should have longer timelines.

It's a gnarly engineering problem.

And then let me just address that in a second, but just one final thought on this thread.

To the extent that there's like a modus ponens, modus tollens thing here, where one thing you could say is like, look, AIs, not just LLMs, but AIs will have this fundamental asymmetric advantage where they know all this shit.

And why aren't they able to use their general intelligence to use this asymmetric advantage to some enormous capability overhang?

Now, you could infer that same statement by saying, okay, well, once they do have that general intelligence, they will be able to use their asymmetric advantage to make all these enormous gains that humans are, in principle, less capable of, right?

So basically, if you do subscribe to this view that AIs could do all these things if only they had general intelligence, you're going to be like, well, once we actually do get the AGI, it's actually going to be totally transformative because they will have all of human knowledge memorized and they can use that to make all these connections.

You're so conservative, Daniel.

Look, your AI product works best when it has access to all of your client's information.

Your copilot needs your customer's entire code base, and your chatbot needs to access all of your client's documents.

But for your users, this presents a massive security risk.

Your client's IT people are going to need more assurance to even consider your product.

Enterprise customers need secure auth, granular access controls, robust logging, and a lot more just to start with.

Building all these features from scratch is expensive, tough, and time-consuming.

That's where my new sponsor, WorkOS, comes in.