Gus

And so not sort of handing off decisions fully to AI, but trying to use AI to empower ourselves.

How do you see that going forward?

Do you think that the approaches like these can scale as AI scales in the tempo that AI is progressing at?

There's a lot of talk about chatbots becoming AI agents instead.

How much do you think this is about the form factor or the interface, how you're interacting with the AI models?

Do you think that for us to stay informed when we make decisions and make better decisions, do we need something different than a chatbot?

And specifically, do we need to avoid agents or do we just need to use agents differently?

Do you think we are ready to work with the models as they are now?

So for example, we can do a lot of scaffolding, we can implement a lot of tools into a model, but if the model is not aligned with our interests, it might go badly anyway.

So you can imagine the model presenting information selectively to us and so pushing us to make a certain decision.

Is that something that's potentially solvable with

extras on top of the model, scaffolding tools, stuff like that?

Or is that a deeper issue that has to be solved before we can begin integrating these models?

I think that's a great question.

So how much do we need to improve on the human side of the full epistemic stack?

If we imagine that stack to be a collaboration between AI and humanity, how much of that is on us?

So for example, there's a massive difference between naively using an LM to try to produce some output and then sort of using best practices, doing everything you can to get the most out of the current models that you can.

Do we need some form of training?

Could this be integrated into the scaffolding in some way such that however simple and naive your prompt is, the system will sort of perhaps ask additional questions of you.

Some systems already do that.