Dr. Fei-Fei Li

I would call it a gray box.

I would call it a gray box.

And depending on your understanding of the AI technology, it's either darker gray or lighter gray.

And depending on your understanding of the AI technology, it's either darker gray or lighter gray.

So the things we know is that it is

So the things we know is that it is

It's a neural network algorithm that is behind, say, a chat GPT model or a large language model.

It's a neural network algorithm that is behind, say, a chat GPT model or a large language model.

Of course, you hear the names of transformer models, sequence-to-sequence, and all that.

Of course, you hear the names of transformer models, sequence-to-sequence, and all that.

At the end of the day, these models take data, like document data, and it learns how the words and sometimes even sub-words, parts of words,

At the end of the day, these models take data, like document data, and it learns how the words and sometimes even sub-words, parts of words,

are connected with each other.

are connected with each other.

There are patterns to see, right?

There are patterns to see, right?

If you see the word how, it tends to be followed by are, and then it tends to be followed by you.

If you see the word how, it tends to be followed by are, and then it tends to be followed by you.

So how are you is a frequently occurring sequence.

So how are you is a frequently occurring sequence.