Judd Rosenblatt
speaker
589 appearances
1 recordings
1 series
first heard Oct 2024
last heard Oct 2024
Judd Rosenblatt’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
We think that self modeling is a strong prior for cooperation, so it may also be an avenue to bias AI systems towards cooperation.
We found that self modelling induces a simplification of the network.
This has potentially profound implications for neuroscience, psychology, and machine learning.
For example, we've been l working with uh John Barge, who did some literature review and reached out to colleagues in his field and has the opinion that there has been no former connection between self-modeling and simplification in psychology literature.
We've stumbled upon uh something pretty major here.
From a pure machine learning point of view, our implementation
Is actually pretty simple and elegant.
And we can get into the details too.
But for now, basically, this means that it's trivial to add to pretty much any neural network, both from implementation and training costs perspective.
It's not that expensive.
Even though we still have a lot to understand about self-modeling, it may turn out to be a state-of-the-art training technique, which would have profound implications since we would be teaching the model to do self-reflection and provide.
a neuro plausible mechanism for consciousness in these artificial systems.
One thing that's pretty interesting here is that the self modeling task biases the internals of the network to become more predictable.
Our results show that these networks, while simpler and more parameter efficient, don't lose performance.
Keep that in mind as we talk about attention schema theory.
Attention schema theory for some reason is hard to get through your head.
Once you deeply get it through your head, sometimes your brain just sort of rejects it afterwards, and you're like, Oh, I totally get it now.
And you're like, This makes sense and completely explains consciousness.
Then the next day you're like, wait, no, that doesn't make sense.
It doesn't explain the quality of stuff.
Showing 421–440 of 589 · page 22 of 30
← Previous
Next →