Cal Newport

My grandma will just on the command line understand that like the cloud code agent can bring up a bash script that's just going to cat those files over to the regex grep, you know, it'll be fine.

No one knows how to do any of that type of stuff.

So it's sort of funny seeing the engineers building these incredibly intricate, nerdy, wonderful tools they've custom built for cloud code to help them in their life.

And they think the gap between that and everyone else having AI automate things in their life is like, oh, it's this real small thing.

I'm like, oh, man, I don't think you understand.

I mean, people are still not quite sure about the right click.

I think you still have a ways to go.

There's hundreds of those happening, right?

I heard, I don't know where this site is.

There's a site that tracks this.

lawyers getting busted for ChatGPT written briefs that just make things, because it will for sure make up things if you ask it.

Because again, what it tries to do is, you know, not to get, people know this, but right at the very bottom, what is a language model trying to do is trying to solve the word guessing game.

That's how it was trained.

It was given real text.

You knock out a word and say, replace that word.

Can you figure out what word was really there in the real text?

So the language models just think,

They're trying to expand a real text that really existed.

So they're trying to produce text that makes sense given the prompt.

There's not world models or structured reasoning in there of like, okay, this is a legal brief and we have a notion of a citation.