yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

Examples thinking about power in significance tests | AP Statistics | Khan Academy


3m read
·Nov 11, 2024

A significance test is going to be performed using a significance level of five hundredths. Suppose that the null hypothesis is actually false. If the significance level was lowered to 100, which of the following would be true?

So pause this video and see if you can answer it on your own.

Okay, now let's do this together and let's see. They're talking about how the probability of a type 2 error or the power would change. So before I even look at the choices, let's think about this.

We've talked about in previous videos that if we increase our level of significance, that will increase our power and power is the probability of not making a type 2 error. So that would decrease the probability of making a type 2 error. But in this question, we're going the other way. We're decreasing the level of significance, which would lower the probability of making a type 1 error but this would decrease the power. It actually would increase the probability of making a type 2 error.

And so which of these choices are consistent with that? Well, choice A says that both the type two error and the power would decrease. Well, those don't… these two things don't move together. If one increases, the other decreases, so we rule that one out. Choice B also has these two things moving together, which can't be true. If one increases, the other decreases.

Choice C: the probability of a type II error would increase. That's consistent with what we have here and the power of the test would decrease. Yep, that's consistent with what we have here, so that looks good.

And choice D is the opposite of that; the probability of a type 2 error would decrease. So this is— they're talking about this scenario over here and that would have happened if they increased our significance level, not decreased it. So we could rule that one out as well.

Let's do another example. Asha owns a car wash and is trying to decide whether or not to purchase a vending machine so that customers can buy coffee while they wait. She'll get the machine if she's convinced that more than 30 percent of her customers would buy coffee.

She plans on taking a random sample of n customers and asking them whether or not they would buy coffee from the machine and she'll then do a significance test using alpha equals 0.05 to see if the sample proportion who say yes is significantly greater than 30 percent.

Which situation below would result in the highest power for her test? So again pause this video and try to answer it.

Well, before I even look at the choices, we can think about what her hypotheses would be. Her null hypothesis is—you could kind of view it as a status quo, no news here—and that would be that the true population proportion of people who want to buy coffee is 30 percent.

And that her alternative hypothesis is that no, the true population proportion, the true population parameter there is greater than 30 percent.

And so if we're talking about what would result in the highest power for her test—so a high power means the lowest probability of making a type 2 error. In other videos we've talked about, it looks like she's dealing with the sample size and what is the true proportion of customers that would buy coffee.

And the sample size is under her control; the true proportion isn't. Don't want to make it seem like somehow you can change the true proportion in order to get a higher power. You can change the sample size but the general principle is: the higher the sample size, the higher the power.

So you want the highest possible sample size and you're going to have a higher power if the true proportion is further from your hypothesis—your null hypothesis proportion. And so we want the highest possible n and that looks like an n of 200, which is there and there.

And we want a true proportion of customers that would actually buy coffee as far away as possible from our null hypothesis which once again would not be under Asha's control. But you can clearly see that 50 is further from 30 than 32 is. So this one, choice D, is the one that looks good.

More Articles

View All
Why Do We Get Bored?
Hey, Vsauce. Michael here. Action and danger is exciting, but this is a fake gun, and the process of enlarging a hole, like the barrel of a gun, is called boring. Boring. Boring a hole is a slow process requiring repetitive movements from a tool that goe…
Little Farms, Big Movement | Branching Out | Part 2
Today my family and I are hitting the road in search of a farm. A vertical farm is a farm, just like it sounds, that is stacked. But since I’m leading this family adventure, it’s not just gonna be your average farm. We are on the hunt to find the next gen…
Recognizing number pattern examples
We are asked which expression can we use to find the missing number in the pattern. So pause this video and see if you can try this before we do this together. All right, now let’s try this together, and the way I would tackle it is I’ll try to see, “Hey,…
Kevin O'Leary shares his thoughts on the market
You’re listening to the real estate talk show with Simon Janini and Erin McCoy on Talk Radio AM 640. Welcome back to the real estate talk show, your source for all things real estate. Now Simon, we know that for some, real estate is single-handedly the m…
A Scare in the Night | The Great Human Race
What do you think? You feel safe in here? I wouldn’t go through that nasty. My hands are full of these things. Not only was fire used for warmth and protection, but it was also a gathering place for humans and the beginning of a sense of community. You kn…
My Advice for Each Stage of Life
There’s a life cycle: right, your teens, your 20s, your 30s, and so on. Every phase is a little bit different, or quite a bit different. People have asked me, uh, in their 20s, what is good advice for their 20s? You are about to go independent; you were d…