More Compute Power Doesn’t Produce AGI

2m read

·Nov 3, 2024

The artificial general intelligence crew gets this completely wrong too. Just add more compute power and you'll get intelligence when we don't really know what it is underneath that makes us creative and allows us to come up with good explanations.

People talk a lot about GPT-3, the text matching engine that AI put out, which is a very impressive piece of software. But they say, "Hey, I can use GPT-3 to generate great tweets." Well, that's because, first, as a human, you're selecting which tweets out of all the garbage that it generates are good. Second, it's using some combination of plagiarism and synonym matching and so on to come up with plausible sounding stuff.

But the easiest way to see that what's generating doesn't actually make any sense is just asking it to follow a question. Take a GPT-3 generated output and ask it why—why is that the case? Or make a prediction based on that and watch it completely fall apart because there's no underlying explanation. It's parroting; it's a brilliant Bayesian reasoning. It's reading from what it already sees out there, generated by humans on the web.

But it doesn't have an underlying model of reality that can explain the scene in terms of the unseen. I think that's critical. That is what humans do uniquely— that no other creature, no other computer, no other intelligence, biological or artificial, that we have ever encountered does. And not only do we do it uniquely, but if we were to meet an alien species that also had the power to generate these good explanations, there is no explanation that they could generate that we could not understand.

We are maximally capable of understanding. There is no concept out there that is possible in this physical reality that a human being, given sufficient time, resources, and education, could not understand.

Building a Gym with Reusable Materials | Life Below Zero

WARNING: The Next Great Reset - UNEMPLOYMENT

View All

Representing endothermic and exothermic processes using energy diagrams | Khan Academy

Let’s say we run an experiment to determine if a reaction is endo or exothermic. For our hypothetical reaction, A reacts with B to form C, and let’s say this reaction takes place in aqueous solution in a beaker. We can define our system as the reactants a…

Allopatric and sympatric speciation | Biology | Khan Academy

[Voiceover] In any discussion of biology or discussion of evolution, the idea of a species will come up over and over again. And we have a whole separate video on species. But the general idea, or the mainstream definition of a species, is a group of orga…

Zero-order reactions | Kinetics | AP Chemistry | Khan Academy

Let’s say we have a hypothetical reaction where reactant A turns into products. Let’s say the reaction is zero order with respect to A. If it’s zero order with respect to A, we can write that the rate of the reaction is equal to the rate constant k times …

The ideal gas law (PV = nRT) | Intermolecular forces and properties | AP Chemistry | Khan Academy

In this video, we’re going to talk about ideal gases and how we can describe what’s going on with them. So the first question you might be wondering is, what is an ideal gas? It really is a bit of a theoretical construct that helps us describe a lot of wh…

How I Borrow FREE Money

What’s up you guys! It’s Graham here. So let’s cover something that continues to get brought up here on the channel, especially recently after some of my income breakdown videos. That is the fact that I actively try to borrow as much money as I possibly c…

Campaign finance | Political participation | US government and civics | Khan Academy

Let’s talk a little bit about money in elections in the United States and the various actors that might be involved. You, of course, at the center of the action, have the various campaigns for the candidates. Then you have the party committees that will t…

More Compute Power Doesn’t Produce AGI

More Articles