yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

More Compute Power Doesn’t Produce AGI


2m read
·Nov 3, 2024

The artificial general intelligence crew gets this completely wrong too. Just add more compute power and you'll get intelligence when we don't really know what it is underneath that makes us creative and allows us to come up with good explanations.

People talk a lot about GPT-3, the text matching engine that AI put out, which is a very impressive piece of software. But they say, "Hey, I can use GPT-3 to generate great tweets." Well, that's because, first, as a human, you're selecting which tweets out of all the garbage that it generates are good. Second, it's using some combination of plagiarism and synonym matching and so on to come up with plausible sounding stuff.

But the easiest way to see that what's generating doesn't actually make any sense is just asking it to follow a question. Take a GPT-3 generated output and ask it why—why is that the case? Or make a prediction based on that and watch it completely fall apart because there's no underlying explanation. It's parroting; it's a brilliant Bayesian reasoning. It's reading from what it already sees out there, generated by humans on the web.

But it doesn't have an underlying model of reality that can explain the scene in terms of the unseen. I think that's critical. That is what humans do uniquely— that no other creature, no other computer, no other intelligence, biological or artificial, that we have ever encountered does. And not only do we do it uniquely, but if we were to meet an alien species that also had the power to generate these good explanations, there is no explanation that they could generate that we could not understand.

We are maximally capable of understanding. There is no concept out there that is possible in this physical reality that a human being, given sufficient time, resources, and education, could not understand.

More Articles

View All
Boost writing skills with Khan Academy's new essay feedback feature
Hey there! If you’ve heard of Kigo KH Academy’s AI-powered tutor and teaching assistant, you probably know about how it’s been developed to help students solve math problems without giving away the answer, strengthen arguments through debate, or break dow…
Episode 2 Recap | MARS [Spoilers]
Previously on Mars. I will miss my sister; she’s my heart and soul. For something like this to work, it has to be personal. We had traveled further than anyone ever had to get to Mars. But before we even entered Mars’ atmosphere, it was like she was tryin…
Solving quadratics using structure | Mathematics II | High School Math | Khan Academy
So let’s try to find the solutions to this equation right over here. We have the quantity (2x - 3) squared, and that is equal to (4x - 6). I encourage you to pause the video and give it a shot. I’ll give you a little bit of a hint: You could do this in th…
Quantitative information in texts | Reading | Khan Academy
Hello readers! Today we’re going to talk about quantitative information in texts. But I want to start with a question: What’s the best way to describe the way a horse looks as it runs? What’s the most efficient way? I guess I could just use words, right?…
Indefinite Pronouns | The parts of speech | Grammar | Khan Academy
Hey grammarians! Today, I want to talk about the idea of the indefinite pronoun, which looks kind of complicated, but really just does what it says on the tin. An indefinite pronoun is just that: it’s indefinite, undefined, uncertain. These are pronouns t…
Nuclear Energy Explained: How does it work? 1/3
Have you ever been in an argument about nuclear power? We have, and we found it frustrating and confusing, so let’s try and get to grips with this topic. It all started in the 1940s. After the shock and horror of the war and the use of the atomic bomb, n…