yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

How AI, Like ChatGPT, *Really* Learns


2m read
·Nov 7, 2024

The main video is talking about a genetic breeding model of how to make machines learn. This method is simpler to explain or just show. Here is a machine learning to walk, or play Mario, or jump really high. A genetic code is an older code, but it still checks out, and I personally suspect in the future genetic models will have a resurgence as compute power approaches crazy pants.

However, the current hotness is deep learning and recursive neural networks, and that is where the linear algebra really increases and explainability in a brief video really decreases. But if I had to kind of explain how they work in a footnote, just for the record, it's like this: No infinite warehouse. Just one student. Teacher Bot has the same test, but this time Builder Bot is 'Dial Adjustment Bot,' where each dial is how sensitive one connection in the student bot's head is.

There's a lot of connections in its head, so a lot of dials. A LOT, a lot. Teacher Bot shows Student Bot a photo, and Dial Adjustment Bot adjusts that dial stronger or weaker to get Student Bot closer to the answer. It's a bit like adjusting the dial on a radio. Is that still a thing? Do cars have radios still? I don't know, anyway.

You might not know the exact frequency of the station, but you can tell if you're getting closer or further away. It's like that but with a hundred thousand dials and a lot of math, and that's just for one test question. When Teacher Bot introduces the next photo, Dial Adjustment Bot needs to adjust all the dials so that Student Bot can answer both questions. As the test gets longer, this becomes an insane amount of math and fine-tuning for Dial Adjustment Bot.

But when it's done, there's a student bot who can do a pretty good job at recognizing new photos, though still suffers from some of the problems mentioned in the main video. Anyway, that's the most babies' first introduction to neural networks you will ever hear. If it sounds interesting to you and you like math and code, go dig into the details; machines that learn are the future of everything.

Maybe, quite literally, the future of everything, and given what we've put them through, may the bots have mercy on us all.

More Articles

View All
The Stanford Prison Experiment
One of the most infamous psychological studies ever conducted was the Stanford Prison Experiment. It’s mentioned in almost every intro to psychology textbook. They tend to focus on how unethical it was and are less critical of its supposed conclusion. Aug…
BIGGEST Game Collection Ever... and More! -- Mind Blow 5
Yeah, let me get a beer. And how are you feeling that from the bottom? Are you some kind of evil wizard? I’m not drinking your evil wizard. But I forget it, just give me two. Speaking of wizards, let’s see what a little hydrogen peroxide and dry yeast ca…
Dating apps are more dangerous than you think
A couple of weeks ago, I was having dinner with a friend and overheard what had to be a first date at the table right next to us. The conversation was awkward at first, as they both seemed to struggle to get a good flow going. I looked over a bit later to…
How I built a $500,000 Net Worth at 24 Years Old
So I recently learned a very valuable lesson: don’t make a claim here on YouTube unless you’re willing to back it up. I recently talked about how lessons I have learned from billionaire investor Charlie Munger helped me build a $500,000 net worth at 24 ye…
Orphaned Baby Elephants “You Can’t Help But Fall In Love With” | National Geographic
I wanted to go to Kenya to relax a bit with elephants, to see the Sheldrick Wildlife Trust orphaned elephants. Now that’s bittersweet in itself. These are baby elephants, which you can’t help but fall in love with. [Music] Look at these guys! How could y…
China Doesnt Play By The Rules
I mean look, you’ve called for 400% tariffs on China. Won’t Trump’s plan make things more expensive? Actually, we have tariffs in place now. Biden Harris Administration did not remove any of them that were in place when they took over the administration. …