Statistics Terminology & Study Designs
Learning Objectives
- Understand the definitions of population, sampling, statistic, parameter, and data
- Determine whether a study is observational or an experiment and identify appropriate use cases
Why This Matters
Every drug in your medicine cabinet exists because a clinical trial -- an experiment -- produced a sample statistic that estimated an unknown population parameter well enough to convince the FDA the drug actually works. Every election forecast you've ever checked was built by surveying a sample, computing a statistic, and using it to estimate a parameter that nobody knows until votes are counted. The five terms in this simulation -- population, sample, parameter, statistic, and the observational-vs-experimental distinction -- aren't textbook formality; they're the vocabulary behind every data-driven decision that affects your health, your vote, and your paycheck.
How to Use This Simulation
- Start with the Vocabulary in Context tab -- read each real-world scenario and classify its components by clicking the correct category for each item.
- Switch to the Study Designs tab and classify each study as observational or experimental. Pay special attention to the final scenario.
- Check the Explanation Panel below -- it updates as you interact and connects each classification to the bigger picture.
- Test yourself with the Quick Check and Try This challenges at the bottom.
For each scenario, classify the highlighted components. Click the correct category button for each item -- feedback is immediate.
For each study, decide: did the researcher intervene by assigning treatments (experiment), or observe what was already happening (observational study)?
What's Happening
Quick Check
A fitness app collects heart rate data from 10,000 of its users during workouts and reports that the average maximum heart rate is 162 bpm. An exercise scientist reads the report and says, "That's a statistic, not a parameter." Why is the scientist correct?
Try This
A polling firm surveys 800 likely voters before a mayoral election and finds that 54% plan to vote for Candidate B. Using what you practiced in the Vocabulary tab, identify: (1) the population, (2) the sample, (3) the parameter being estimated, (4) the statistic, and (5) whether this study is observational or experimental. Check your answers against the scenario cards above.
Two studies examine whether listening to music improves exam performance:
Study A: A researcher surveys 500 college students about whether they listen to music while studying and collects their most recent exam scores. Students who listen to music average 81; those who don't average 76.
Study B: A researcher randomly assigns 200 students to study with instrumental music or in silence for one week, then gives both groups the same exam. The music group averages 79; the silence group averages 77.
Identify the design of each study. Explain in one sentence what kind of conclusion each design supports. Then explain why Study A and Study B, despite addressing the same question, produce different strengths of evidence.
A news article reports: "People who eat breakfast daily earn 20% more than those who skip it, according to a 10-year study tracking 15,000 working adults."
(1) Classify the study design. (2) Identify the population, sample, parameter, and statistic from the article's framing. (3) The headline implies that eating breakfast causes higher earnings. Does the study design support that conclusion? Explain in two sentences what the study can and cannot tell us. (4) Propose what an experimental version of this study might look like and what additional conclusions it could support.
Instructor Notes
Teaching Notes
This simulation works best when you let students attempt the vocabulary classifications before defining the terms. Most students will guess that "52% support" is the parameter (because it sounds definitive), and the feedback corrects this by distinguishing "computed from a sample" (statistic) from "true value for the population" (parameter). That correction is the entry point for the parameter-statistic distinction that runs through the entire inferential arc -- confidence intervals, hypothesis tests, and the Central Limit Theorem all rest on this foundation.
The Study Designs tab's final card (coffee and productivity, both designs) is the highest-value teaching moment. After students classify both designs, ask: "Which study would you trust more if you were deciding whether to buy coffee for your entire office?" The answer isn't straightforward -- the experiment has higher internal validity but the observational study may have higher external validity. This nuance previews the tradeoffs students will encounter in later simulations on hypothesis testing research.
Common Student Errors
- Calling any computed number a "parameter" because it sounds more official than "statistic." Reinforce: parameters describe populations, statistics describe samples.
- Classifying surveys as experiments because "the researcher did something" (designed and distributed a survey). Clarify: intervention means assigning treatments, not collecting data.
- Confusing "data" with "statistic" -- data are the raw observations, a statistic is a number computed from the data.
- Assuming observational studies are inferior to experiments. Both have roles; they answer different questions with different levels of certainty.
Discussion Questions
- If you could survey every single student at this university about their study habits, would the average you compute be a parameter or a statistic? Why does the answer change if you only survey your statistics class?
- A news article says "chocolate reduces the risk of heart disease." What's the first question you should ask about the study behind this claim?
- Why do pharmaceutical companies spend billions on randomized clinical trials instead of just surveying patients who already take a medication?
Exam Connection
Typical exam questions present a study description and ask students to identify the population, sample, parameter, and statistic, and to classify the study design. The vocabulary cards in Tab 1 directly practice the first task. The study design cards in Tab 2 directly practice the second. The Stretch tier challenge practices both simultaneously with the added demand of comparing designs.