Learning and Behaviorism
3. Formal Models of Learning
Classical Conditioning
Classical conditioning can be mathematically quantified using the Rescorla-Wagner model, which calculates trial-by-trial changes in associative strength between a conditioned stimulus (CS) and an unconditioned stimulus (US): Here, is the change in associative strength, and represent the salience of the CS and US, is the maximum conditioning possible, and is the total associative strength of all stimuli present.
Schedules of Reinforcement
Operant Conditioning: Shaping
-
1
Identify the target behavior.
-
2
Identify the starting behavior (what the subject currently does).
-
3
Determine the successive approximations required to reach the target.
-
4
Differentially reinforce each successive approximation while extinguishing the previous one.
In the Rescorla-Wagner model, what does the term conceptually represent?
The term represents the prediction error—the difference between the maximum possible associative strength (what actually happens) and the current expected associative strength.
Correct answer: The prediction error or degree of surprise
Operant Conditioning
Pioneered by B.F. Skinner, operant conditioning focuses on how consequences shape voluntary behavior. The Law of Effect, originally proposed by Thorndike, dictates that responses followed by a satisfying state of affairs are more likely to occur again.
Consequences in Operant Conditioning
Reinforcement
- Increases the likelihood of a behavior.
- Positive: Adding a desirable stimulus.
- Negative: Removing an aversive stimulus.
Punishment
- Decreases the likelihood of a behavior.
- Positive: Adding an aversive stimulus.
- Negative: Removing a desirable stimulus.
What term describes the gradual weakening and disappearance of a conditioned response when the conditioned stimulus is repeatedly presented without the unconditioned stimulus?
Extinction occurs when the association between the CS and US is broken, leading to a decline in the conditioned response.
Correct answer: Extinction