Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Yannis Antonoglou

๐Ÿ‘ค Speaker
329 total appearances

Appearances Over Time

Podcast Appearances

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

is to try new algorithms.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

So you can try to take this model, do two different reinforcement learning algorithms, for example, and then just see which one behaves best, and then just do that with a model that's a frontier model.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

Yes.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

I mean, reinforcement learning is, we are like, you know, have true believers in reinforcement learning.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

Many of the team have like a strong reinforcement learning background, including myself.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

So for us, it's, you know, it's one of the big bets.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

Yeah, I mean, I guess like, you know, the fan architecture is something that like, you have to wait and see, like when the model lands.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

Fair enough.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

I cannot really, you know, kind of like share anything at this point.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

At the same time,

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

you know, like the what you're building is a frontier agenda model.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

So think of like a system that can do multi-step reasoning.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

So kind of like really interact with like tools and environments, just like complete the task end to end.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

So that means that it needs to understand long context.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

It needs to be able to self-correct.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

There are certain capabilities that are really important in order to have agentic intelligence.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

There are many things that go into training these models, from instruction following and pre-training and the data mixtures, but also a lot of reinforcement learning and what environments you use to really train this model.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

An environment can be anything.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

It can be something simple like a coding environment.

The Neuron: AI Explained
This DeepMind Vet Raised $2B to Open-Source Frontier AI

It can be an actual like a website or something that like you want to simulate.