yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

Transforming nonlinear data | More on regression | AP Statistics | Khan Academy


2m read
·Nov 11, 2024

So we have some data here that we can plot on a scatter plot that looks something like that.

And so the next question, given that we've been talking a lot about lines of regression or regression lines, is can we fit a regression line to this?

Well, if we try to, we might get something that looks like this or maybe something that looks like this.

I'm just eyeballing it, obviously. We could input it into a computer to try to develop a linear regression model to try to minimize the sum of the squared distances from the points to the line, but you can see it's pretty difficult.

And some of you might be saying, well, this looks more like some type of an exponential, so maybe we could fit an exponential to it.

So it could look something like that, and you wouldn't be wrong.

But there is a way that we can apply our tools of linear regression to this data set.

And the way we can is instead of plotting x versus y, we can think about x versus the logarithm of y.

So this is the exact same data set. You see the x values are the same, but for the y values, I just took the log base 10 of all of these.

10 to the what power is equal to 2307.23?

10 to the 3.36 power is equal to 2307.23, and I did that for all of these data points.

I did it on a spreadsheet, and if you were to plot all of these, something neat happens.

All of a sudden, when we're plotting x versus the log of y or the log of y versus x, all of a sudden it looks linear.

Now be clear, the true relationship between x and y is not linear; it looks like some type of an exponential relationship.

But the value of transforming the data—and there are different ways you can do it—in this case, the value of taking the log of y and thinking about it that way is now we can use our tools of linear regression.

Because this data set, you could actually fit a linear regression line to this quite well.

You could imagine a line that looks something like this; it would fit the data quite well.

And the reason why you might want to do this versus trying to fit an exponential is because we've already developed so many tools around linear regression and hypothesis testing around the slope and confidence intervals, and so this might be the direction you want to go at.

And what's neat is once you fit a linear regression, it's not difficult to mathematically unwind from your linear model back to an exponential one.

So the big takeaway here is that the tools of linear regression can be useful even when the underlying relationship between x and y are non-linear.

And the way that we do that is by transforming the data; here we took a logarithm of the y's, and that helped us see a more linear relationship of log y versus x.

More Articles

View All
These are the questions you should be asking at a late-stage startup.
When a company goes public or when a company is acquired for a lot of money, the market is looking at how much revenue that company is making and is that revenue growing. I would say that, you know, for example, if I’m at a company right now that’s making…
Finding inverse functions: rational | Mathematics III | High School Math | Khan Academy
[Voiceover] So we’re told that g of x is equal to two x minus one over x plus three. Based on this, pause the video and see if you can figure out what the inverse of g is. g inverse of x. What is that going to be equal to? Alright, I’m assuming you’ve had…
Introducing a New Cheetah! – Day 81 | Safari Live
Interim! Let’s send you all the way on down-south, 1,600 miles to Scott. Hello everyone! You may have just seen a bird fly through the thick undergrowth there. We were hoping it would stick around. So, it’s calling it “say orange-breasted bush shrike,” a…
Peru Orphanage Update 2017 - Smarter Every Day 183
I can’t tell if it’s focused. Stay right there. Hey! It’s me, Destin. Welcome back to Smarter Every Day. This is my wife, Tara. My better half. [laughs] Every year in December, I make a video about an orphanage in Peru called Not Forgotten. Tara went down…
Apple please watch this. - Frore AirJet MacBook Air
Okay, Apple, I know this is gonna sound a little crazy, but what if the MacBook Air actually moved some air around so it didn’t thermal throttle after two minutes of any kind of work? Well, believe it or not, it can and without even adding any fans. All w…
This Virus Shouldn't Exist (But it Does)
Hidden in the microverse all around you, there’s a merciless war being fought by the true rulers of this planet: microorganisms. Amoeba, protists, bacteria, archaea, and fungi compete for resources and space. And then there are the strange horrors that ar…