Statistical Analysis in Psychological Research
12. Advanced Statistical Inference in Psychology
Inferential Statistics
Inferential statistics allow researchers to draw conclusions from sample data to a broader population. The independent samples t-test compares the means of two distinct groups. The formula calculates the ratio of the difference between group means to the variability of groups: where is the pooled standard deviation.
Statistical vs. Clinical Significance
A statistically significant result (e.g., ) simply means the effect is unlikely due to chance. It does not necessarily mean the effect is large or practically meaningful (clinical significance).
Analysis of Variance (ANOVA) Variants
In Null Hypothesis Significance Testing (NHST), what constitutes a Type I error?
A Type I error (false positive) occurs when a researcher incorrectly rejects a true null hypothesis, claiming an effect exists when it does not. The probability of this is denoted by alpha ().
Correct answer: Rejecting a true null hypothesis
Effect Size
Because p-values are heavily influenced by sample size, modern psychology emphasizes reporting effect sizes. Cohen's quantifies the standardized difference between two means: A of 0.2 is considered small, 0.5 medium, and 0.8 large.
Null Hypothesis Significance Testing (NHST)
-
1
State the Null Hypothesis () and Alternative Hypothesis ().
-
2
Set the alpha level (typically ).
-
3
Calculate the test statistic (e.g., t, F, ).
-
4
Determine the p-value associated with the test statistic.
-
5
Compare the p-value to alpha to make a decision regarding .
What is the term for the probability of finding the observed, or more extreme, results when the null hypothesis is true?
The p-value is the probability of obtaining test results at least as extreme as the results actually observed, under the assumption that the null hypothesis is correct.
Correct answer: p-value