yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

Laplacian intuition


5m read
·Nov 11, 2024

So here I'm going to talk about the Lan laian, and the lassan is a certain operator in the same way that the Divergence, or the gradient, or the curl, or even just the derivative are operators—the things that take in some kind of function and give you another function.

So in this case, let's say we have a multivariable function, um, like f that just takes in a two-dimensional input, F of XY. You might imagine its graph as being something like this, where, you know, the input space is this XY plane here. So each of the points XY is a point here, and then the output is just given by the height of that graph.

So the leoan of f is denoted with a right-side-up triangle, and it's going to give you a new scalar-valued function of X and Y. It's going to give you a new function that takes in a two-dimensional input and just outputs a number. And it's kind of like a second derivative because the way that it's defined is that you take the Divergence of the gradient of the gradient of your function f.

So that's kind of how it's defined: the Divergence of the gradient of F. A more common notation that you might see here is to take that upside-down triangle (nabla) dot product with nabla of f. So remember, if f is a scalar-valued function, then the gradient of f gives you a vector field, a certain vector field. But the Divergence of a vector field gives you another scalar-valued function.

So this is the sense in which it's a second derivative. But let's see if we can kind of understand intuitively what this should mean. Cuz the gradient, if you remember, gives you the slope of steepest ascent, so it's a vector field in the input space of X, and each one of the vectors points in the direction that you should walk.

Such that if this graph is kind of like a hill on top of you, it tells you the direction you should go to increase your direction the most rapidly. And if that seems unfamiliar, it doesn't make sense, maybe go take a look at that video on gradients and graphs and how they relate to each other.

So with the specific graph that I have pictured here, when you have kind of the top of a hill, all of the points around it, the direction that you should walk is towards the top of that hill. Whereas, when you have kind of like the bottom, a little gully here, all of the directions you should walk to increase the value of the function most rapidly are directly away from that valley, which you might call a local minimum.

So let's let's temporarily get rid of the graph just so we can look at the gradient field here pretty clearly. And now let's think about what the Divergence is supposed to represent. So now the Divergence, and again, if this feels unfamiliar, maybe go back and take a look at the Divergence videos.

But the Divergence has you imagining that this vector field corresponds to some kind of fluid flow. So you imagine little water molecules, and at any given moment, they're moving along the vector that they're attached to. So, for example, if you had a water molecule that started off kind of here, it would start by going along that vector and then kind of follow the ones near it, and it looks like it kind of ends up in this spot.

A lot of the water molecules seem to kind of converge over there, whereas over here, the water molecules tend to go away when they're following those vectors away from this point. And when they go away like that, when you have a whole bunch of vectors kind of pointed away, that's an indication that Divergence is positive because they're diverging away.

So over here, Divergence is positive, whereas the opposite case, where all of the water molecules are kind of coming in towards a point, that's where Divergence is negative. In another area, let's say it was kind of like this center point where, you know, you have some water molecules that look like they're coming in, but other ones are going out.

At least from this picture, it doesn't seem like, you know, the ones going out are doing so at a faster rate or slower than they are here. This would be roughly zero Divergence. So now let's think about what it might mean when you take the Divergence of the gradient field of f.

So let me kind of clear up the markings I made on top of it here. Um, points of high Divergence, points where it diverges a lot here, why are those vectors pointing away? And if we pull up the graph again, the reason they're pointing away is because the direction of steepest descent is kind of uphill everywhere you are in a valley.

Whereas in the opposite circumstance, where Divergence is highly negative because points are converging towards it, why are they pointing towards it? Well, this is a gradient field, so they're pointing towards that spot because that's where anywhere around it you should walk towards that spot to go uphill.

So in other words, the Divergence of the gradient is very high at points that are kind of like minima at points where everyone around them tends to be higher. But the Divergence of the gradient is low at points that look more like maximum points, where when you evaluate the function at all of the points around that input point, they give something smaller.

So this laian operator is kind of like a measure of how much of a minimum point is this XY. It will be very positive when F evaluated at that point tends to give a smaller value than F evaluated at neighbors of that point. But it'll be very negative if, when you evaluate F at that point, it tends to be bigger than its neighbors.

And this should feel kind of analogous to the second derivative in ordinary calculus when you have some kind of graph of just a single variable function. The second derivative, you know, the second derivative of X will be low. It'll be negative at points where it kind of looks like a local maximum.

But over here, the second derivative of X would be positive at points that kind of look like a local minimum. So in that way, the Lan is sort of an analog of the second derivative for scalar-valued multivariable functions. And in the next video, I'll go through an example of that.

More Articles

View All
15 Things Everyone Wants But Money Can’t Buy
You know, there are things money can’t buy. You know it, but you forget it. You forget that fundamentally, you’re on the same level as the richest people in the world. You have to appreciate these things now, so that when your wealth grows, your motivatio…
Jeff Bezos In 1999 On Amazon's Plans Before The Dotcom Crash
It doesn’t matter to me whether we’re a pure internet play. What matters to me is do we provide the best customer service. Internet Shminternet. Given the decades of wisdom that has built up in the business world investors, it sounds like you’re saying yo…
One Order of Operations for Starting a Startup by Michael Seibel
One order of operations for starting a startup. More often than not, when I talk to a talented technical person who’s thinking about becoming a Founder, their number one blockers is that they don’t have an idea. At some point during their formative years,…
Bill Belichick & Ray Dalio on Having Great Relationships: Part 2
But the generosity part of it was really, I thought that was so on point. Well, it’s, we’re just talking about the different versions of that, right? And, and, and you know that you have succeeded not only in those two dimensions. You know, that day on th…
Ratios with tape diagrams
We’re told Kenzie makes quilts with some blue squares and some green squares. The ratio of blue squares to green squares is shown in the diagram. The table shows the number of blue squares and the number of green squares that Kenzie will make on two of he…
The SECRET Behind The World's Best Lobster Roll | Chef Wonderful
Where can you get the best slops on earth? Right here in Nantucket, and there’s one place you come. How long have you been open here? 45 years. 45 years! This is my new gig from now on. You’re gonna find me here. Hey, chef, wonderful here! Where am I? Yo…