John Siracusa
π€ SpeakerAppearances Over Time
Podcast Appearances
But if you want to try something, one of my suggestions would be point it at your code base.
You have to at least figure out how to give it stern instructions to not modify your code at all.
But it's mostly good about that, but it helps to just maybe...
put in a claude.md or whatever your equivalent is and say don't ever commit anything don't ever modify any files you have read-only whatever but uh just simply say this find any bugs in this program um and it will find a bunch of crap that are not bugs um but it will find some actual bugs too even if it's just a typo and a variable name it will find them
Not asking it to fix the bugs.
You're just saying find them.
And like I said, it's going to find stuff that's not bugs because it's not that smart, right?
But it will find legit bugs.
And the thing is, you can keep asking it.
Find any more bugs in this program.
Find any more bugs.
Find any performance issues.
Find any concurrency issues.
Find any memory safety issues.
You phrase it 75 different ways.
Just keep asking it questions and asking it to point you to things.
And all it's going to say is...
I think this thing over here is wrong.
And it's going to be wrong a lot of the time.
It's going to be pointing to things that are not bugs, which is annoying.