yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

More Compute Power Doesn’t Produce AGI


2m read
·Nov 3, 2024

The artificial general intelligence crew gets this completely wrong too. Just add more compute power and you'll get intelligence when we don't really know what it is underneath that makes us creative and allows us to come up with good explanations.

People talk a lot about GPT-3, the text matching engine that AI put out, which is a very impressive piece of software. But they say, "Hey, I can use GPT-3 to generate great tweets." Well, that's because, first, as a human, you're selecting which tweets out of all the garbage that it generates are good. Second, it's using some combination of plagiarism and synonym matching and so on to come up with plausible sounding stuff.

But the easiest way to see that what's generating doesn't actually make any sense is just asking it to follow a question. Take a GPT-3 generated output and ask it why—why is that the case? Or make a prediction based on that and watch it completely fall apart because there's no underlying explanation. It's parroting; it's a brilliant Bayesian reasoning. It's reading from what it already sees out there, generated by humans on the web.

But it doesn't have an underlying model of reality that can explain the scene in terms of the unseen. I think that's critical. That is what humans do uniquely— that no other creature, no other computer, no other intelligence, biological or artificial, that we have ever encountered does. And not only do we do it uniquely, but if we were to meet an alien species that also had the power to generate these good explanations, there is no explanation that they could generate that we could not understand.

We are maximally capable of understanding. There is no concept out there that is possible in this physical reality that a human being, given sufficient time, resources, and education, could not understand.

More Articles

View All
The Cartoon Laws of Physics | StarTalk
So we’re talking about animation here, and, uh, some of the earliest concepts of animation. There’s a drawing on a, is it an N in Iran, where it shows several images that, in sequence, is a moving animal. Yeah, it’s a leaping animal. It’s so we’ve been …
Linking verbs | The parts of speech | Grammar | Khan Academy
Hello grammarians! Today we’re talking about verbs and bears. So, we had previously established at least one thing about the verb, and that was that it can show actions. Um, but today I’d like to introduce the idea that the verb can link ideas to one anot…
Force, mass and acceleration | Movement and forces | Middle school physics | Khan Academy
So, I have three different asteroids over here, and they have different masses. We’ll talk a lot more about what mass means, but one way to think about it is how much stuff there is there. There are other ways to think about it. Let’s say that this first…
The Seven Years' War part 2
So we’ve been discussing the Seven Years’ War in North America, also commonly called the French and Indian War. But as I mentioned in the last video, I think “Seven Years’ War” is a better name for this conflict because it was the first global war that ha…
Space Elevator – Science Fiction or the Future of Mankind?
It’s hard to get to space. As much as we all wish there were an easy and affordable way to see our planet floating in the dark, right now, the only way is to become an astronaut or a billionaire. But there is a concept that might make it possible - while …
What type of aircraft does The Jet Business specialise in selling!
What kind of aircraft are we selling? First of all, there’s three groups of aviation. There are the commercial airlines, there’s the military, and then there’s general aviation. General aviation is broken down into a lot of different things: it’s agricult…