yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

More Compute Power Doesn’t Produce AGI


2m read
·Nov 3, 2024

The artificial general intelligence crew gets this completely wrong too. Just add more compute power and you'll get intelligence when we don't really know what it is underneath that makes us creative and allows us to come up with good explanations.

People talk a lot about GPT-3, the text matching engine that AI put out, which is a very impressive piece of software. But they say, "Hey, I can use GPT-3 to generate great tweets." Well, that's because, first, as a human, you're selecting which tweets out of all the garbage that it generates are good. Second, it's using some combination of plagiarism and synonym matching and so on to come up with plausible sounding stuff.

But the easiest way to see that what's generating doesn't actually make any sense is just asking it to follow a question. Take a GPT-3 generated output and ask it why—why is that the case? Or make a prediction based on that and watch it completely fall apart because there's no underlying explanation. It's parroting; it's a brilliant Bayesian reasoning. It's reading from what it already sees out there, generated by humans on the web.

But it doesn't have an underlying model of reality that can explain the scene in terms of the unseen. I think that's critical. That is what humans do uniquely— that no other creature, no other computer, no other intelligence, biological or artificial, that we have ever encountered does. And not only do we do it uniquely, but if we were to meet an alien species that also had the power to generate these good explanations, there is no explanation that they could generate that we could not understand.

We are maximally capable of understanding. There is no concept out there that is possible in this physical reality that a human being, given sufficient time, resources, and education, could not understand.

More Articles

View All
A Thermal Inversion Example in Donora | AP Environmental Science | Khan Academy
[Instructor] Hey there, friends. Today we’re gonna learn about air pollution, and to start off, we’re going back in time to the small town of Donora, Pennsylvania, in October of 1948. (Light music) Walking into this small industrial town, you can immediat…
Frogfish or Seaweed...Who's to Say! | National Geographic
As a passing fish, you’d be forgiven for confusing this frog fish with a mound of seaweed. But it would be the last mistake you probably ever make. As it turns out, the frog fish is a terrifying ambush predator. The spines on this fish act as a sort of ha…
Should you buy your private jet in cash?
Steve, I’m about to buy my first jet. Should I pay cash or should I finance it? I really think it depends. If you can make more money than they’re going to charge with the bank, obviously then borrow the money. But I’d say about 80% of the people finance…
Affirmative action | Civil liberties and civil rights | US government and civics | Khan Academy
What we’re going to do in this video is discuss affirmative action, and it can be a sensitive topic. So, I encourage folks to engage on the message boards, but to do so respectfully. So the first question is: what is affirmative action? Generally speakin…
Buoyancy Quiz
We are doing a buoyancy experiment today. If you drop a golf ball into some dishwashing liquid, it sinks very slowly. So why does it sink in the detergent? Because the golf ball is more heavy than the liquid that’s in the container— then the detergent. W…
The Crazy Engineering of Venice
The year is 452. The Roman Empire is on the brink of collapse, and the Huns have just launched their attack on Northern Italy. Several cities are completely destroyed, forcing the locals to go on the run. They head for a lagoon just off the coast and take…