yego.me
💡 Stop wasting time. Read Youtube instead of watch. Download Chrome Extension

Invalid conclusions from studies example | Study design | AP Statistics | Khan Academy


3m read
·Nov 11, 2024

Jerry was reading about a study that looked at the connection between smartphone usage and happiness. Based on data from approximately 5,000 randomly selected teenagers, the study found that, on average, the teens who spent more time on smartphones were significantly less happy than those who spent less time on smartphones. Jerry concluded that spending more time on smartphones makes teens less happy.

Alright, this is interesting! So what I want you to do is think about whether Jerry is making a valid conclusion or not, and why or why not. Do you think he's making a valid conclusion?

Alright, now let's work on this together. This is really important to understand because you will see things like this in the popular media all the time. They try to establish a causality when there might not be causality, or at least where the study might not be able to show causality.

So right now, Jerry is saying he's concluding that smartphone usage makes teens less happy. He's assuming there's a causal connection: smartphone usage causes teens to be less happy. Can he actually make that conclusion from this study, based on how it was designed?

Well, the first thing to ask ourselves is, is this an experimental study that is designed to establish causality, or is it an observational study where we really can just say there's an association? But we really can't make a statement about causality.

In an experimental study, he would have had to have a control group and then a treatment group, sometimes called an experimental group. So I'll say that's the control group, and that's the treatment or the experimental group. Then, you randomly assign folks to one of those two groups. You would make that treatment group use the cell phone more and see if they are less happy.

That's not what happened here. What happened here was an observational study. In this study, we are looking at two variables: smartphone usage and then teen happiness. They took these 5,000 randomly selected teenagers and they figured out their smartphone usage and their happiness, maybe with a survey of some kind.

Then you could plot those data points. You would have 5,000 data points. This data point right over here would be a very happy teenager that doesn't use a smartphone much. This would be a not-so-happy teenager that uses a smartphone a lot. You would plot those data points, and there might be a teenager who's unhappy and doesn't use a smartphone, or one that is happy and that uses a smartphone a lot.

But you could see there's a trend, there's an association that, in general, the teenagers who use their smartphones more seem to be less happy, and the teenagers who use their smartphones less seem to be more happy.

But it's important to realize that the causality could go the other way around. Maybe less happy teenagers use their smartphones more, and maybe more happy teenagers don't find a need to use a smartphone. Or there could be some variable that's not even being observed in the study that has a causal relationship with both of these.

So there could be some other variable that might cause someone to be less happy and use their smartphone more. In an observational study, you can really just say there's an association; you wouldn't be able to say that there is causality.

So, Jerry is not making a valid conclusion. It's an observational study. We've only established an association, not causality.

More Articles

View All
Why Astronauts left a reflector on the Moon! (ft. MinutePhysics) - Smarter Every Day 73
Hey, it’s me, Destin. Welcome back to Smarter Every Day! So, did you know that in the 60s and 70s, when the astronauts went to the moon in the Saturn V rocket, they actually left experiments on the surface of the moon? In fact, there’s one that’s still th…
It's Time To Fight Back Against China!
Kevin, are you a tariff man? I am actually in the case of China. I don’t like tariffs generally, but China, we’re in an economic war with. There’s 100% that that’s the case. They don’t play by a level playing field. I do business there, so this is not an …
Walking away from marriage, children, and other stuff we're supposed to have
You want someone to grow old with? You want someone to be a mother for your children, assuming you want children? And if you don’t want children, well, you probably will, and if you don’t, you’re either deluded or immature. And you might say, “Well no, th…
The Ancient Orchestra | Podcast | Overheard at National Geographic
So the first thing I want to do here, Amy, is just play you something. Okay? Out of the blue. [Music] Okay, so that is not Chewbacca, right? No? Just okay, let’s clear that up right now. You like the oldies, right? Yeah, but not that old. All these people…
Jeff Dean’s Lecture for YC AI
So I’m going to tell you a very not super deep into any one topic but very broad brush sense of the kinds of things we’ve been using deep learning for the kinds of systems we’ve built around making deep learning faster. This is joint work with many, many,…
Canceling zeros when dividing | Math | 4th grade | Khan Academy
Let’s solve 350 divided by 50. So one way to think about this is if we had 350 of something, let’s say something delicious like brownies. If we had 350 brownies and we were dividing them into groups of 50, how many groups of 50 could we get? Well, one ide…