Adam Brown

This is at a higher level of abstraction than that, but it wouldn't surprise me if it's able to debug what you say in that way.

Yeah, I...

I take an exam I gave years ago in my graduate general relativity class at Stanford and give it to these models.

And it's pretty extraordinary.

Three years ago, zero.

A year ago, they were doing pretty well.

Maybe...

A weak student, but in the distribution.

And now they essentially ace the test.

In fact, I'm retiring that.

That's just my own little private eval.

It's not published anywhere, but I just give them this thing just to follow along how they're doing.

And it's pretty strong.

It may be easy by the standards of graduate students.

courses but a graduate course in general relativity and they get pretty much everything right on the final exam.

That's just in the last couple of months that these have been doing that.

Physics problems compared to math problems tend to have two components.

One is to sort of take this word question and turn it, using your physics knowledge, into a math question.

Yeah.

And then...