Joshua Lambert

Yeah, exactly.

So, I mean, ideally, the way that this would work for them is we could actually just set this up on a website where they could go to at any point, ask their questions, get some feedback.

And, you know, maybe that's sufficient for them.

If not, we're always here to help them, obviously.

Not only happy, all of them said they preferred

the chatbot's answers over my own and my students' answers.

That must not have made you feel amazing about yourself, side note.

Well, the funny thing is that they never actually found out.

So they got the answers.

I had them fill out the response.

But we never actually revealed to them what the truth was.

So when they read this paper or watch our interview, they're going to find out for the first time that, oh, they guessed that the chat bot was the best answer.

And they also guessed that my answer was a chat bot's answer.

Yeah.

So there's this theory in psychology called expectation confirmation theory or ECT, which is basically says that all of us, no matter what we interface with, whether it's this podcast, going to the grocery store or sitting in a classroom, is that we have expectations.

Right.

We have expectations about what we're getting ready to go through.

And what ECT says is that we look for things in that experience that meet our expectations and confirm it.

So think of it almost as like a

confirmation bias um and we definitely found that in this data that students when blinded from the responses from the three sources consistently rated the chatbot the highest again they didn't know who it was right they were just rating it the highest but when we looked at the data further we found that the one that they rated the worst