yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

Laplacian intuition


5m read
·Nov 11, 2024

So here I'm going to talk about the Lan laian, and the lassan is a certain operator in the same way that the Divergence, or the gradient, or the curl, or even just the derivative are operators—the things that take in some kind of function and give you another function.

So in this case, let's say we have a multivariable function, um, like f that just takes in a two-dimensional input, F of XY. You might imagine its graph as being something like this, where, you know, the input space is this XY plane here. So each of the points XY is a point here, and then the output is just given by the height of that graph.

So the leoan of f is denoted with a right-side-up triangle, and it's going to give you a new scalar-valued function of X and Y. It's going to give you a new function that takes in a two-dimensional input and just outputs a number. And it's kind of like a second derivative because the way that it's defined is that you take the Divergence of the gradient of the gradient of your function f.

So that's kind of how it's defined: the Divergence of the gradient of F. A more common notation that you might see here is to take that upside-down triangle (nabla) dot product with nabla of f. So remember, if f is a scalar-valued function, then the gradient of f gives you a vector field, a certain vector field. But the Divergence of a vector field gives you another scalar-valued function.

So this is the sense in which it's a second derivative. But let's see if we can kind of understand intuitively what this should mean. Cuz the gradient, if you remember, gives you the slope of steepest ascent, so it's a vector field in the input space of X, and each one of the vectors points in the direction that you should walk.

Such that if this graph is kind of like a hill on top of you, it tells you the direction you should go to increase your direction the most rapidly. And if that seems unfamiliar, it doesn't make sense, maybe go take a look at that video on gradients and graphs and how they relate to each other.

So with the specific graph that I have pictured here, when you have kind of the top of a hill, all of the points around it, the direction that you should walk is towards the top of that hill. Whereas, when you have kind of like the bottom, a little gully here, all of the directions you should walk to increase the value of the function most rapidly are directly away from that valley, which you might call a local minimum.

So let's let's temporarily get rid of the graph just so we can look at the gradient field here pretty clearly. And now let's think about what the Divergence is supposed to represent. So now the Divergence, and again, if this feels unfamiliar, maybe go back and take a look at the Divergence videos.

But the Divergence has you imagining that this vector field corresponds to some kind of fluid flow. So you imagine little water molecules, and at any given moment, they're moving along the vector that they're attached to. So, for example, if you had a water molecule that started off kind of here, it would start by going along that vector and then kind of follow the ones near it, and it looks like it kind of ends up in this spot.

A lot of the water molecules seem to kind of converge over there, whereas over here, the water molecules tend to go away when they're following those vectors away from this point. And when they go away like that, when you have a whole bunch of vectors kind of pointed away, that's an indication that Divergence is positive because they're diverging away.

So over here, Divergence is positive, whereas the opposite case, where all of the water molecules are kind of coming in towards a point, that's where Divergence is negative. In another area, let's say it was kind of like this center point where, you know, you have some water molecules that look like they're coming in, but other ones are going out.

At least from this picture, it doesn't seem like, you know, the ones going out are doing so at a faster rate or slower than they are here. This would be roughly zero Divergence. So now let's think about what it might mean when you take the Divergence of the gradient field of f.

So let me kind of clear up the markings I made on top of it here. Um, points of high Divergence, points where it diverges a lot here, why are those vectors pointing away? And if we pull up the graph again, the reason they're pointing away is because the direction of steepest descent is kind of uphill everywhere you are in a valley.

Whereas in the opposite circumstance, where Divergence is highly negative because points are converging towards it, why are they pointing towards it? Well, this is a gradient field, so they're pointing towards that spot because that's where anywhere around it you should walk towards that spot to go uphill.

So in other words, the Divergence of the gradient is very high at points that are kind of like minima at points where everyone around them tends to be higher. But the Divergence of the gradient is low at points that look more like maximum points, where when you evaluate the function at all of the points around that input point, they give something smaller.

So this laian operator is kind of like a measure of how much of a minimum point is this XY. It will be very positive when F evaluated at that point tends to give a smaller value than F evaluated at neighbors of that point. But it'll be very negative if, when you evaluate F at that point, it tends to be bigger than its neighbors.

And this should feel kind of analogous to the second derivative in ordinary calculus when you have some kind of graph of just a single variable function. The second derivative, you know, the second derivative of X will be low. It'll be negative at points where it kind of looks like a local maximum.

But over here, the second derivative of X would be positive at points that kind of look like a local minimum. So in that way, the Lan is sort of an analog of the second derivative for scalar-valued multivariable functions. And in the next video, I'll go through an example of that.

More Articles

View All
Buy Great Companies that Goes Up and UP and Sit on Your A$$ Investing | Charlie Munger | 2023
Picking your shots, I mean, I think you call it sit on your ass investing. The investing where you find a few great companies and just sit on your ass because you’ve correctly predicted the future. That is what it’s very nice to be good at. A lot of what…
Worked example: Calculating concentration using the Beer–Lambert law | AP Chemistry | Khan Academy
So I have a question here from the Cots, Trickle, and Townsend Chemistry and Chemical Reactivity book, and I got their permission to do this. It says a solution of potassium permanganate has an absorbance of 0.53 when measured at 540 nanometers in a 1 cen…
Lecture 17 - How to Design Hardware Products (Hosain Rahman)
Very exciting! And thank you, Sam, uh, for having me. Sam and I have known each other for a long time because we were fellow Sequoia companies, and we met in the early days of when he was on his, uh, company journey. So it’s cool! So what he asked me to t…
Professor Brian Harvey on why not to cheat
There are limits to your working together. You’re going to be hearing this from every single instructor this week, right? You’ve probably already heard it six times. Don’t cheat. I think that some of what people tell you about this is nonsense. For examp…
Biogeochemical cycles | Ecology | Khan Academy
Talk a little bit about biogeochemical cycles. The term “biogeochemical” sounds very fancy, but really these are just cycles that involve different molecules that are essential for life and how they circulate through an ecosystem. And really, how they cir…
Proving the SAS triangle congruence criterion using transformations | Geometry | Khan Academy
What we’re going to do in this video is see that if we have two different triangles and we have two sets of corresponding sides that have the same length. For example, this blue side has the same length as this blue side here, and this orange side has the…