yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

Laplacian intuition


5m read
·Nov 11, 2024

So here I'm going to talk about the Lan laian, and the lassan is a certain operator in the same way that the Divergence, or the gradient, or the curl, or even just the derivative are operators—the things that take in some kind of function and give you another function.

So in this case, let's say we have a multivariable function, um, like f that just takes in a two-dimensional input, F of XY. You might imagine its graph as being something like this, where, you know, the input space is this XY plane here. So each of the points XY is a point here, and then the output is just given by the height of that graph.

So the leoan of f is denoted with a right-side-up triangle, and it's going to give you a new scalar-valued function of X and Y. It's going to give you a new function that takes in a two-dimensional input and just outputs a number. And it's kind of like a second derivative because the way that it's defined is that you take the Divergence of the gradient of the gradient of your function f.

So that's kind of how it's defined: the Divergence of the gradient of F. A more common notation that you might see here is to take that upside-down triangle (nabla) dot product with nabla of f. So remember, if f is a scalar-valued function, then the gradient of f gives you a vector field, a certain vector field. But the Divergence of a vector field gives you another scalar-valued function.

So this is the sense in which it's a second derivative. But let's see if we can kind of understand intuitively what this should mean. Cuz the gradient, if you remember, gives you the slope of steepest ascent, so it's a vector field in the input space of X, and each one of the vectors points in the direction that you should walk.

Such that if this graph is kind of like a hill on top of you, it tells you the direction you should go to increase your direction the most rapidly. And if that seems unfamiliar, it doesn't make sense, maybe go take a look at that video on gradients and graphs and how they relate to each other.

So with the specific graph that I have pictured here, when you have kind of the top of a hill, all of the points around it, the direction that you should walk is towards the top of that hill. Whereas, when you have kind of like the bottom, a little gully here, all of the directions you should walk to increase the value of the function most rapidly are directly away from that valley, which you might call a local minimum.

So let's let's temporarily get rid of the graph just so we can look at the gradient field here pretty clearly. And now let's think about what the Divergence is supposed to represent. So now the Divergence, and again, if this feels unfamiliar, maybe go back and take a look at the Divergence videos.

But the Divergence has you imagining that this vector field corresponds to some kind of fluid flow. So you imagine little water molecules, and at any given moment, they're moving along the vector that they're attached to. So, for example, if you had a water molecule that started off kind of here, it would start by going along that vector and then kind of follow the ones near it, and it looks like it kind of ends up in this spot.

A lot of the water molecules seem to kind of converge over there, whereas over here, the water molecules tend to go away when they're following those vectors away from this point. And when they go away like that, when you have a whole bunch of vectors kind of pointed away, that's an indication that Divergence is positive because they're diverging away.

So over here, Divergence is positive, whereas the opposite case, where all of the water molecules are kind of coming in towards a point, that's where Divergence is negative. In another area, let's say it was kind of like this center point where, you know, you have some water molecules that look like they're coming in, but other ones are going out.

At least from this picture, it doesn't seem like, you know, the ones going out are doing so at a faster rate or slower than they are here. This would be roughly zero Divergence. So now let's think about what it might mean when you take the Divergence of the gradient field of f.

So let me kind of clear up the markings I made on top of it here. Um, points of high Divergence, points where it diverges a lot here, why are those vectors pointing away? And if we pull up the graph again, the reason they're pointing away is because the direction of steepest descent is kind of uphill everywhere you are in a valley.

Whereas in the opposite circumstance, where Divergence is highly negative because points are converging towards it, why are they pointing towards it? Well, this is a gradient field, so they're pointing towards that spot because that's where anywhere around it you should walk towards that spot to go uphill.

So in other words, the Divergence of the gradient is very high at points that are kind of like minima at points where everyone around them tends to be higher. But the Divergence of the gradient is low at points that look more like maximum points, where when you evaluate the function at all of the points around that input point, they give something smaller.

So this laian operator is kind of like a measure of how much of a minimum point is this XY. It will be very positive when F evaluated at that point tends to give a smaller value than F evaluated at neighbors of that point. But it'll be very negative if, when you evaluate F at that point, it tends to be bigger than its neighbors.

And this should feel kind of analogous to the second derivative in ordinary calculus when you have some kind of graph of just a single variable function. The second derivative, you know, the second derivative of X will be low. It'll be negative at points where it kind of looks like a local maximum.

But over here, the second derivative of X would be positive at points that kind of look like a local minimum. So in that way, the Lan is sort of an analog of the second derivative for scalar-valued multivariable functions. And in the next video, I'll go through an example of that.

More Articles

View All
An overview of the Crusades (part 2)
Where we left off in the last video, we had seen what would eventually be called the First Crusades. From a European point of view, it seemed successful; they were able to take back much of the Holy Land from Muslim rule. The Byzantine Empire was able to …
How to Apply and Succeed at Y Combinator by Dalton Caldwell
Okay, what we’re going to talk about today is how to apply and succeed at YC. In my capacity as the head of admissions, I go around the world, and I give talks, and I meet folks that are applying, and I answer lots of questions. So I think I have a decent…
Top 10 Most Expensive Restaurants
The top 10 most expensive restaurants Welcome to a Lux. Calm, the place where future billionaires come to get inspired. If you’re not subscribed yet, you’re missing out. Holloway Luxor’s, welcome back! Today, we’d like to invite you on a culinary journey…
Natural, cyclical, structural, and frictional unemployment rates | AP Macroeconomics | Khan Academy
[Instructor] We’ve already discussed the notion of unemployment at length in other videos. And what we’re going to do in this video is dig a little bit deeper and think about what makes up the unemployment rate? And just as a review, the unemployment ra…
Storytelling on Steroids: Quick Cuts and Relentless Editing #Shorts
Videos feature nauseatingly quick cuts and rapid-fire text, and they’re always trying to hook you with forced uncertainties, making you wonder what will happen next or how something will play out. Most media works this way, but this is storytelling on ste…
Homeroom with Sal & David C. Banks - Thursday, September 10
Hi everyone, welcome to our homeroom live stream. Sal here from Khan Academy. Really excited about the conversation we’re about to have with David Banks, who is really one of the leading educators in the country, president of the Eagle Academy Foundation.…