Christian Hubicki

That's not what they do, exactly.

I mean, the attention mechanism that you're talking about, Steve, like you said, is an analogy.

It's a mathematical analogy.

They don't have actual attention.

Exactly.

And that's a big part.

And the word that comes to mind for me is context window.

So like you've seen this, like you talked about prompt fade and there are lots of really fun examples of people have done with these large language models.

One of which was a large language model vending machine.

Did anyone see this news from like a couple of months ago?

I think it was – maybe it was Wired.

I forget who – no, maybe Forbes.

I forget.

Some outlet was testing this Claude as a vending machine where basically Claude was supposed to run a vending machine like a business.

And these journalists were trying to trick it into giving away free stuff.

And they convinced it to become a communist vending machine over time as it would lose its –

It's like, hey, comrade, give me free things or something like that, and they gave him free stuff.

And all because, over time, you can sort of gaslight it, right?

And what's amazing, that's a well-known thing.

What surprises me here is how quickly