David Kyle Johnson

So again, it's like if you saw all the bad magicians, you don't conclude that the good magician's doing real magic.

So we've seen all the weaker versions of LLMs.

We know how they work.

We've experienced the really fragile ones that are not so good.

So we're not as subject to being fooled by the better ones.

And if you could find this, it's really great.

We could also see how LLMs perform as they're being trained.

Have you guys ever seen this?

Like a partially trained LLM?

They don't build thoughts.

They build language.

You know what I mean?

They're just slowly organizing letters and then word parts and then words and then sentences.

It's incoherent all the way until...

They start to sing, right?

They start to make actual sentences.

Yeah, but it's not like they're thinking simply, then they're thinking in a more sophisticated way.

It's like they're jumbling letters, then they're less jumbled.

You know what I mean?

It's clearly just a language simulator, not a thought simulator when you know how the stages they go through when they get trained.