Beth Lyons

You can make an API call.

I know you can do it, I think, with Gemini, but...

On the API, you can often set how deep the thinking mode will go when you're making the specific API call.

And 4.6 shipped with that.

And again, one of the things that every said was like 4.6 wins for them because it was able to do things like one shot bug fix that had been problematic for them for a little bit of time.

but it also does stupid things periodically.

Like sort of, holy crap moments, this was amazing.

Holy crap moments, why?

Right?

And they're expecting or surmising that that is part of this adaptive change where it's deciding how much it needs to think.

And when it doesn't get it right, it then leads to doing something stupid.

Mm-hmm.

And that is a real challenge for people who are vibe coding, right?

Because what you're doing is essentially giving up control and trust so that you're able to code above your knowledge, right?

And when something happens that is stupid but not detectable, that's something that I think we're going to see.

You, Andy, I believe, have found that when you give what's happened to another model, right?

So this is what's occurred.

This is what Claude did.

I give it to Gemini.

Gemini gives a response based on this.