Comparing Two Groups: Means and Proportions
Two-Sample Inference
Comparing groups
Many practical questions ask whether two populations differ in mean outcome or proportion of success. The inferential strategy depends on whether the response is numerical or categorical.
Two-group methods
| Question | Typical parameter | Typical method |
|---|---|---|
| Difference in average test scores | Two-sample procedures | |
| Difference in success rates | Two-proportion z procedures | |
| Before/after change in same units | Mean of paired differences | Paired procedures |
Paired data
Use a paired method when measurements come from matched units or the same subject measured twice, because observations are not independent across groups.
Independent vs paired designs
Independent samples
- Different units in each group
- Compare two separate populations
- Use two-sample methods
Paired samples
- Same units measured twice or matched pairs
- Analyze differences within pairs
- Usually more powerful when pairing is meaningful
Choosing the right two-group test
-
1
Step 1: Identify whether the response is quantitative or categorical.
-
2
Step 2: Decide whether the data are independent or paired.
-
3
Step 3: Form the parameter of interest, such as or .
-
4
Step 4: Use the appropriate confidence interval or hypothesis test.
Which situation calls for a paired test?
Before-and-after measurements on the same people are paired.
Correct answer: Comparing the same patients before and after treatment
What is the main advantage of pairing when it is appropriate?
Pairing can remove between-subject differences and improve sensitivity.
Correct answer: It reduces variability by comparing matched observations or repeated measurements within the same units.