Notes
Populations and sampling
- The population is the whole group of interest and a sample is the part we study. A parameter describes a population and a statistic describes a sample.
- Random methods: simple random sample, stratified (SRS within groups), cluster (randomly chosen groups, survey all), systematic (every $k$th after a random start).
- Convenience and voluntary response samples are not random and tend to be biased.
Bias
- Undercoverage, voluntary response, nonresponse and response bias (such as leading questions) each push results in a direction. A bigger sample does not fix bias.
Studies and experiments
- Observational studies observe; experiments impose treatments. Only experiments with random assignment can show cause and effect.
- Good experiments use control, random assignment, replication and often blinding. Blocks and matched pairs control known sources of variation.
- Random sampling lets us generalize; random assignment lets us conclude cause and effect.
Topics in this unit
Each topic has its own short notes and practice.
Practice
It is a number describing a sample.
A random start followed by every 10th individual is a systematic sample.
The sample leaves out part of the population, so the result is likely biased.
The researchers imposed treatments using random assignment.
Chance balances other variables across groups, so differences can be credited to the treatments.
Random sampling lets us generalize to the population from which the sample was drawn.
Free response
Write your answer first, then open the scoring guide.
Free-response question
A school wants to find out whether a new study app improves quiz scores. Sixty students volunteer to take part.
(a) Is this an observational study or an experiment? Identify the explanatory and response variables.
Show the answer and scoring guide
It is an experiment if the school assigns the students to use the app or not. The explanatory variable is whether the student uses the app, and the response variable is the quiz score.
Check off the points you earned:
(b) Describe how to use random assignment to form two groups of 30 students.
Show the answer and scoring guide
Number the students 1 to 60. Use a random number generator to choose 30 different numbers. Those students use the app and the other 30 form the control group.
Check off the points you earned:
(c) If the app group scores significantly higher, what can the school conclude? What limits the conclusion?
Show the answer and scoring guide
Because of random assignment, the app caused the higher scores. Because the students were volunteers and not a random sample, the result may not apply to all students.
Check off the points you earned: