Andrej Karpathy

They will appear inert to us, as in...

They will behave in some very strange way to us because they're beyond... They're playing the metagame.

And the metagame is probably, say, arranging quantum mechanical systems in some very weird ways to extract infinite energy, solve the digital expansion of pi to whatever amount.

They will build their own little fusion reactors or something crazy.

They're doing something beyond comprehension and not understandable to us and actually brilliant under the hood.

We're just kind of like these particles in the wave that I feel like is mostly deterministic and takes a universe from some kind of a Big Bang to some kind of a super intelligent replicator

some kind of a stable point in the universe, given these laws of physics.

I think it's deterministic.

Oh, there's tons of... Well, I want to be careful with randomness.

Pseudo-random?

Yeah, I don't like random.

I think maybe the laws of physics are deterministic.

Yeah, I think they're deterministic.

Yeah, I think it's unsettling.

I think it's a deterministic system.

I think that things that look random, like say the collapse of the wave function, et cetera, I think they're actually deterministic, just entanglement and so on, and some kind of a multiverse theory, something, something.

It feels like it.

Yeah, you're interpreting the choice and you're creating a narrative for having made it.

Well, the one that I've been thinking about recently the most probably is the

transformer architecture um so basically uh neural networks have uh a lot of architectures that were trendy have come and gone for different uh sensory modalities like for vision audio text you would process them with different looking neural nets and recently we've seen these this convergence towards one architecture the transformer and uh you can feed it video or you can feed it you know images or speech or text and it just gobbles it up and it's kind of like a