yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

More Compute Power Doesn’t Produce AGI


2m read
·Nov 3, 2024

The artificial general intelligence crew gets this completely wrong too. Just add more compute power and you'll get intelligence when we don't really know what it is underneath that makes us creative and allows us to come up with good explanations.

People talk a lot about GPT-3, the text matching engine that AI put out, which is a very impressive piece of software. But they say, "Hey, I can use GPT-3 to generate great tweets." Well, that's because, first, as a human, you're selecting which tweets out of all the garbage that it generates are good. Second, it's using some combination of plagiarism and synonym matching and so on to come up with plausible sounding stuff.

But the easiest way to see that what's generating doesn't actually make any sense is just asking it to follow a question. Take a GPT-3 generated output and ask it why—why is that the case? Or make a prediction based on that and watch it completely fall apart because there's no underlying explanation. It's parroting; it's a brilliant Bayesian reasoning. It's reading from what it already sees out there, generated by humans on the web.

But it doesn't have an underlying model of reality that can explain the scene in terms of the unseen. I think that's critical. That is what humans do uniquely— that no other creature, no other computer, no other intelligence, biological or artificial, that we have ever encountered does. And not only do we do it uniquely, but if we were to meet an alien species that also had the power to generate these good explanations, there is no explanation that they could generate that we could not understand.

We are maximally capable of understanding. There is no concept out there that is possible in this physical reality that a human being, given sufficient time, resources, and education, could not understand.

More Articles

View All
Politics of Climate Change | Years of Living Dangerously
BRADLEY WHITFORD: I want to know why there aren’t more Republicans in Congress willing to come forward on climate. So I’m going to meet the GOP’s most outspoken critic, Democratic Senator Sheldon Whitehouse. SHELDON WHITEHOUSE: I am back to again urge my…
This Book Has No Words
Book From the Ground by Juing is a novel written entirely in pictogram symbols, icons, and logos. It tells the story of a day in the life of an office worker. You don’t need to know any particular language to read this book; you only need to be familiar w…
Analyzing structure with linear inequalities: fruits | High School Math | Khan Academy
Shantanu bought more apples than bananas, and he bought more bananas than cantaloupes. Let A represent the number of apples Shantanu bought, let B represent the number of bananas, and let C represent the number of cantaloupes. Let’s compare the expressio…
Andding decimals with hundredths
Let’s get some practice adding numbers that involve hundreds. So, pause this video and see if you can add these two numbers. See what you get. Alright, now let’s work through this together. Now, there’s many different ways to add decimals, and you’ll lea…
Properties of the equilibrium constant | Equilibrium | AP Chemistry | Khan Academy
An equilibrium constant has one value for a particular reaction at a certain temperature. For example, for this reaction, we have oxalic acid turning into two H plus ions and the oxalate anion. The equilibrium constant Kc for this reaction is equal to 3.8…
How did Russia begin? | 1450 - Present | AP US History | Khan Academy
What we’re going to talk about in this video are the origins of the Russian people, and in particular, we’re going to talk about the eastern Slavs, whom not just modern Russians, but also Ukrainians and Belarusians view as their ancestors. So, let’s thin…