Trenton Bricken

Your parents will.

All I need to know is that my name's in a book.

You're a co-author.

Should we get into the AMA questions?

Yeah, riffing off that with respect to RL,

I wonder if models currently just aren't good at knowing what memories they should be storing.

Like most of their training is just predicting the next word on the internet and remembering very specific facts from that.

But if you were to teach me something new right now, I'm very aware of my own memory limitations.

And so I would try to construct some summary that would stick.

And models currently don't have the opportunity to do that.

Memory scaffolding in general is just very primitive right now.

Right, like Coldplay's Pokemon, right?

Exactly, yeah, where someone worked on it, it was awesome, it got far, but another excited Anthropic employee then iterated on the memory scaffold and was able to very quickly improve on it.

Interesting.

So, yeah, that's one.

I do also just wonder if models are idiot savants.

The best analogy might be to Kim Peek.

So Kim Peek was born without a corpus callosum, if I recall correctly.

Each hemisphere of his brain operated quite independently.

He could read a page of a book.