More Compute Power Doesn’t Produce AGI

2m read

·Nov 3, 2024

The artificial general intelligence crew gets this completely wrong too. Just add more compute power and you'll get intelligence when we don't really know what it is underneath that makes us creative and allows us to come up with good explanations.

People talk a lot about GPT-3, the text matching engine that AI put out, which is a very impressive piece of software. But they say, "Hey, I can use GPT-3 to generate great tweets." Well, that's because, first, as a human, you're selecting which tweets out of all the garbage that it generates are good. Second, it's using some combination of plagiarism and synonym matching and so on to come up with plausible sounding stuff.

But the easiest way to see that what's generating doesn't actually make any sense is just asking it to follow a question. Take a GPT-3 generated output and ask it why—why is that the case? Or make a prediction based on that and watch it completely fall apart because there's no underlying explanation. It's parroting; it's a brilliant Bayesian reasoning. It's reading from what it already sees out there, generated by humans on the web.

But it doesn't have an underlying model of reality that can explain the scene in terms of the unseen. I think that's critical. That is what humans do uniquely— that no other creature, no other computer, no other intelligence, biological or artificial, that we have ever encountered does. And not only do we do it uniquely, but if we were to meet an alien species that also had the power to generate these good explanations, there is no explanation that they could generate that we could not understand.

We are maximally capable of understanding. There is no concept out there that is possible in this physical reality that a human being, given sufficient time, resources, and education, could not understand.

Simple Products That Became Big Companies – Dalton Caldwell and Michael Seibel

15 Secrets Only Billionaires Know

View All

The Danger and Excitement of Underwater Cave Diving | Short Film Showcase

We come here every winter, bringing tons of dive stuff, going into the mountains. During this expedition, Darrell, we get to explore this cave system that we have found here. This is the longest underwater cave in Sweden, and we know there’s going to be s…

Factorization with substitution | Polynomial factorization | Algebra 2 | Khan Academy

We’re told that we want to factor the following expression that they have right here, and they say that we can factor the expression as ( u + v ) squared, where ( u ) and ( v ) are either constant integers or single variable expressions. What are ( u ) an…

Identifying centripetal force for cars and satellites | AP Physics 1 | Khan Academy

So here we have something that you probably have done in the last, maybe in the last day. If we’re in a car and we’re just making a turn, let’s say at a constant speed on a road that is flat, so it’s not a banked racetrack or anything like that, what is k…

What if You Lived on Trappist -1e?

[Music] Like most children, you go to bed early in the evening. No later, as your mother tucks you in, you see the warm glow of the sunset hitting your ceiling, the soft reds and the pinks of twilight playing on your bedroom walls. Then, as you’ve seen he…

Worked example: differentiating polar functions | AP Calculus BC | Khan Academy

Let r be the function given by r if theta is equal to three theta sine theta for theta is between zero and two pi, including zero and two pi. The graph of r in polar coordinates consists of two loops, as shown in the figure above. So let’s think about wh…

Warren Buffett: 5 Rules For Investing In Stock Market Crashes

Things can go on a long time that don’t make sense, but they do come to an end. I mean, the internet thing. I mean, you had these companies selling for many billions of dollars that had no, really frankly, no prospects of making any money. That’s a bubble…

More Compute Power Doesn’t Produce AGI

More Articles