Steve Gibson
speaker
17,616 appearances
14 recordings
1 series
first heard May 2026
last heard 2 Sep
Steve Gibson’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 14 in all, peaking in Jul 2026 with 5.
Appearances
We call it Gram, Gradient Routed Auxiliary Modules.
Note that there they wrote, note that the results of the experiments presented here are preliminary.
Gram has not been applied to any of the production models and anthropic.
And they said, and we're not sure it ever will be.
And I okay, so I I take that to reflect a very reasonable and very cautious approach because can you imagine the cost of a mistake?
If one of these companies gram trained model, whatever that is, and we'll we'll get to that in a second.
turned out to have unsuspected problems.
Uh there's no reason to believe that it would or that that would be the case, but again, their cost is understandable because they could be scrapping half a billion dollars these days.
So they write, Anthropic writes, how gram works
The idea behind Gram is to give a knowledge a model dedicated removable compartments.
For each category of dual-use knowledge, and to update only those compartments when learning from dual-use data.
Again, to update only those compartments, not all of the models' weights, only those in the compartments when learning from dual-use data.
They said concretely, Gram adds extra neurons to every layer of a standard transformer, you know, the neural network architecture on which large language models are based.
These neurons are divided into groups or modules, one module per dual use category.
During training, when the model encounters general purpose text, that is, you know, just standard text, we don't worry about it one or the other, it learns in the usual way.
But when it encounters text from a dual use category, virology for instance, they wrote, the rules change and
The model can use its general knowledge to make predictions, but only the virology model module is allowed to learn from that text.
The general purpose weights are temporarily frozen.
Right.
So in other words, the bulk of the model isn't changed by by learning about virology.
Showing 2241–2260 of 17,616 · page 113 of 881
← Previous
Next →