yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

How AI, Like ChatGPT, *Really* Learns


2m read
·Nov 7, 2024

The main video is talking about a genetic breeding model of how to make machines learn. This method is simpler to explain or just show. Here is a machine learning to walk, or play Mario, or jump really high. A genetic code is an older code, but it still checks out, and I personally suspect in the future genetic models will have a resurgence as compute power approaches crazy pants.

However, the current hotness is deep learning and recursive neural networks, and that is where the linear algebra really increases and explainability in a brief video really decreases. But if I had to kind of explain how they work in a footnote, just for the record, it's like this: No infinite warehouse. Just one student. Teacher Bot has the same test, but this time Builder Bot is 'Dial Adjustment Bot,' where each dial is how sensitive one connection in the student bot's head is.

There's a lot of connections in its head, so a lot of dials. A LOT, a lot. Teacher Bot shows Student Bot a photo, and Dial Adjustment Bot adjusts that dial stronger or weaker to get Student Bot closer to the answer. It's a bit like adjusting the dial on a radio. Is that still a thing? Do cars have radios still? I don't know, anyway.

You might not know the exact frequency of the station, but you can tell if you're getting closer or further away. It's like that but with a hundred thousand dials and a lot of math, and that's just for one test question. When Teacher Bot introduces the next photo, Dial Adjustment Bot needs to adjust all the dials so that Student Bot can answer both questions. As the test gets longer, this becomes an insane amount of math and fine-tuning for Dial Adjustment Bot.

But when it's done, there's a student bot who can do a pretty good job at recognizing new photos, though still suffers from some of the problems mentioned in the main video. Anyway, that's the most babies' first introduction to neural networks you will ever hear. If it sounds interesting to you and you like math and code, go dig into the details; machines that learn are the future of everything.

Maybe, quite literally, the future of everything, and given what we've put them through, may the bots have mercy on us all.

More Articles

View All
What's it like to become a father? - Smarter Every Day 132
Hey, it’s me Destin, welcome back to Smarter Every Day. We just had a baby, which is awesome. I mean, every single child we’ve brought into our house has taught us a tremendous amount. And you would think that you kind of learned the ropes and you’re just…
The Mystery of Synchronous Fireflies - Smarter Every Day 274
Hey, it’s me, Destin. Welcome back to Smarter Every Day. I grew up here in Alabama, like most kids in the area, learning how to catch lightning bugs and putting them in a jar. It’s a magical memory that most of a share. But today, on Smarter Every Day, we…
Rainforests 101 | National Geographic
(Birds chirping) - [Narrator] Shrouded in a blanket of clouds, they awaken. Their canopies of green glitter in the sun. Their wildlife start to slither. (Snake hissing) - Chirp. (Birds chirping) - And growl. (Growling) - And one of the planet’s richest ec…
North Dakota Is Not Just “Oil & Gas” l Winner State Tour
[Music] And we’re coming off of an exciting announcement to you with that investment in the IV in gr fors. Can you tell me a little bit broadly speaking with the Wonder fund? What’s the long-term goal for that within our state? Is it getting outside capit…
Food and energy in organisms | Middle school biology | Khan Academy
Hey, quick question for you. You ever look at a person’s baby pictures and wonder how people go from being small to, well, big? I mean, yes, I get it; people grow up, but here I’m thinking more on the level of the atoms and molecules that make up the body…
Managing the New York City Power Grid | Breakthrough
I never thought that something as simple as like an LED light bulb could make such a big impact. There was one project that I worked on where the team that I was working with thought, “Well, what about if we just screwed a bunch of LED light bulbs all thr…