Noam Shazeer
👤 PersonAppearances Over Time
Podcast Appearances
If you could do that and have the system automatically sort of generate a bunch of experimental code and maybe you look at it and you're like, yeah, that looks good, run that.
That seems like a nice dream direction to go in and seems plausible in the next year or two years that you might make a lot of progress on that.
Sorry, I didn't mean to under-hype it.
I just don't like to hype things that aren't done yet.
Yeah.
I was pretty impressed.
I think it was on Reddit that I saw, like, we have a new experimental coding, like, model that's much better at coding and math and so on.
And someone external tried it, and they basically prompted it and said, I'd like you to implement a SQL processing database system with no external dependencies.
And please, please do that in C. Yeah.
And from what the person said, it actually did a quite good job.
It generated a SQL parser and a tokenizer and a query planning system and some storage format for the data on disk and actually was able to handle simple queries.
So from that prompt, which is like a paragraph of text or something, to get...
you know, even an initial cut at that seems like a big boost in productivity for software developers.
And I think you might end up with other kinds of systems that maybe don't try to do that in a single, you know, in semi-interactive respond in 40 second kind of thing, but might go off
for 10 minutes and might interrupt you after five minutes saying, oh, I've done a lot of this, but now I need to get some input.
Do you care about handling video or just images or something?
And that seems like you'll need ways of managing the workflow if you have a lot of these kind of background activities happening.
Probably more than that.
There were 15,000 at NeurIPS.
Yeah.