Alex Reisner

That data is extremely valuable to them.

It might seem like nothing to you, but you should be getting paid for that.

People thought that was crazy back then, and I think a lot of people still think that's crazy now.

But taking people's music to build models that generate songs that compete with them is just the next version of that, and it's just going to keep going.

If we don't acknowledge that this data is incredibly valuable and figure out a way –

to write laws around that or just have better business practices or something.

This is just it's just going to get worse.

This is going to be more exploitation and more more mining.

Absolutely not.

Really?

I don't think that there's any evidence that that actually works.

I think when AI companies talk about

training on synthetic data, they choose their words very carefully and they always exaggerate the extent to which it's happening.

There's a lot of research out there on the phenomenon called model collapse, which is what happens when you train a model on its own outputs.

It doesn't get better, it very quickly degrades.

And it's not hard to see why that could be the case.

Like AI is kind of an averaging machine.

It's finding statistical average between different types of content and putting that into some new kind of more average type of content.

And there's just not enough weirdness or interestingness or something like that.

There's some quality in the work that humans do that's not in the work that AI does.