yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

More Compute Power Doesn’t Produce AGI


2m read
·Nov 3, 2024

The artificial general intelligence crew gets this completely wrong too. Just add more compute power and you'll get intelligence when we don't really know what it is underneath that makes us creative and allows us to come up with good explanations.

People talk a lot about GPT-3, the text matching engine that AI put out, which is a very impressive piece of software. But they say, "Hey, I can use GPT-3 to generate great tweets." Well, that's because, first, as a human, you're selecting which tweets out of all the garbage that it generates are good. Second, it's using some combination of plagiarism and synonym matching and so on to come up with plausible sounding stuff.

But the easiest way to see that what's generating doesn't actually make any sense is just asking it to follow a question. Take a GPT-3 generated output and ask it why—why is that the case? Or make a prediction based on that and watch it completely fall apart because there's no underlying explanation. It's parroting; it's a brilliant Bayesian reasoning. It's reading from what it already sees out there, generated by humans on the web.

But it doesn't have an underlying model of reality that can explain the scene in terms of the unseen. I think that's critical. That is what humans do uniquely— that no other creature, no other computer, no other intelligence, biological or artificial, that we have ever encountered does. And not only do we do it uniquely, but if we were to meet an alien species that also had the power to generate these good explanations, there is no explanation that they could generate that we could not understand.

We are maximally capable of understanding. There is no concept out there that is possible in this physical reality that a human being, given sufficient time, resources, and education, could not understand.

More Articles

View All
The Spectacular Failure of Rivian Stock.
I don’t know if you’ve been paying attention to the EV space recently, but things are getting tough out there. Tesla went gangbusters until 2022 and has since struggled. BYD gangbusters until 2022 and has now struggled. VW went well in 2021 and has now st…
Dianna Health Update from SmarterEveryDay
I’ve got some good news and, um, it’s a little complicated, but I would love to explain it to you. My name is Dustin, by the way. Uh, I have a YouTube channel called Smarter Every Day, and this is Physics Girl; this is Diana’s channel. Uh, recently, I we…
Startup Experts Reveal Their Top Productivity Advice
A lot of people think that they’re great at multitasking, and they are not. I think the best Founders, you’ll see them be very picky with their time, and sometimes it’s the non-obvious things that end up being the things that really unlock your business. …
It Started: The Worst Market Collapse In 50 Years | Michael Burry
What’s up, Graham? It’s guys here, and it’s official: the stock market makes absolutely no sense. Despite weak earnings, a recession that’s all but confirmed, and JP Morgan’s recent warning that the market could fall another 20%, prices have begun to do t…
Isotopes | Atoms, isotopes, and ions | High school chemistry | Khan Academy
Every element is defined by the number of protons in its atoms, which is called its atomic number. So, for example, every atom of potassium has 19 protons, and every atom of cobalt has 27 protons. But what about neutrons? Well, an element doesn’t always …
Selling corporate jets isn't easy!
How long can that process take? Days, weeks; sometimes you’re working on a transaction for a year or two. Sometimes it’s a month, still right up to the line. I’ve had a transaction where we’ve signed the contract, they put up a deposit, and we’re going t…