Jimmy Wales

It's like it's an open system.

And so like whatever, a few weird things are going to happen.

And so there stopped being those kind of news stories because the media sort of started to understand of like, oh, OK, well, right.

So what?

Like, it's not a big deal.

Well, you know, I mean, I use large language models a lot.

I'm fascinated by it and I play with it, tinker with it, study it.

You know, the truth is large language models aren't nearly good enough yet to write encyclopedia articles.

If you've only played with it a little bit, you might think, oh my God, like this is amazing.

Of course it can write an encyclopedia article.

That's quite easy.

But

Once you realize how bad the hallucination problem is of just like making stuff up, then you realize like, oh, actually, no, I wouldn't think this is a good idea.

And, you know, one of the issues there is the way the technology works is by predicting the next token in a string of text.

And it predicts more or less like something plausible, the most plausible thing.

But the most plausible thing isn't always the true thing.

And so oftentimes it can sort of take itself down an alleyway.

And then pretty soon it's just making stuff up to support what it said in the past and so on.

And that doesn't really work at all.

And so the thing is, where will we be with this technology?