yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

More Compute Power Doesn’t Produce AGI


2m read
·Nov 3, 2024

The artificial general intelligence crew gets this completely wrong too. Just add more compute power and you'll get intelligence when we don't really know what it is underneath that makes us creative and allows us to come up with good explanations.

People talk a lot about GPT-3, the text matching engine that AI put out, which is a very impressive piece of software. But they say, "Hey, I can use GPT-3 to generate great tweets." Well, that's because, first, as a human, you're selecting which tweets out of all the garbage that it generates are good. Second, it's using some combination of plagiarism and synonym matching and so on to come up with plausible sounding stuff.

But the easiest way to see that what's generating doesn't actually make any sense is just asking it to follow a question. Take a GPT-3 generated output and ask it why—why is that the case? Or make a prediction based on that and watch it completely fall apart because there's no underlying explanation. It's parroting; it's a brilliant Bayesian reasoning. It's reading from what it already sees out there, generated by humans on the web.

But it doesn't have an underlying model of reality that can explain the scene in terms of the unseen. I think that's critical. That is what humans do uniquely— that no other creature, no other computer, no other intelligence, biological or artificial, that we have ever encountered does. And not only do we do it uniquely, but if we were to meet an alien species that also had the power to generate these good explanations, there is no explanation that they could generate that we could not understand.

We are maximally capable of understanding. There is no concept out there that is possible in this physical reality that a human being, given sufficient time, resources, and education, could not understand.

More Articles

View All
Predicting bond type (metals vs. nonmetals) | AP Chemistry | Khan Academy
In a previous video, we introduced ourselves to the idea of bonds between atoms, and we talked about the types of bonds: ionic, covalent, and metallic. In this video, we’re going to dig a little bit deeper and talk about the types of bonds that are likely…
YC Founders Made These Fundraising Mistakes
If you look at why the Google founders are the Google founders and still have all this control over their company, you can look all the way back in time to the moment of the earliest fundraisers. They were not desperate for cash and load leveraged. Hey, …
MARS | Exclusive Sneak Peek
And now an exclusive sneak peek at the first episode of [Music] [Music] Mars Retro Rockets about to fire in 1, 2, 3… bre… 1, 2… [Music] three. We dream it’s who we are, down to our bones, ourselves. That instinct to build, that drive to seek beyond what …
Coordinate plane relationships
We’re told Jazella plots the ordered pair (4, 3) on a coordinate grid by moving four units to the right and three units down from the origin. Which statement is true? So pause this video and have a go at this before we do this together. All right, now be…
Consumer credit unit overview | Teacher Resources | Financial Literacy | Khan Academy
Hi teachers, Welcome to the unit on consumer credit. So, just as a high level, this is going to cover everything from credit scores—what is it? How it’s able to give people who might give someone credit a sense of how likely you are to pay back that cred…
Marvels of an Arctic Winter | America's National Parks
As the months of winter pass, only the heartiest of creatures will be able to survive out in the open, seemingly resigned to their fate. But under the tundra, some creatures are pulling off a small biological miracle. The hibernating ground squirrel’s bod…