Mechanisms of Adaptation to Unsignaled Changes in Reinforcement Contingencies: A Bayesian Model Comparison
Adaptive behavior requires organisms to adjust their choices when environmental constraints change. The matching law is a widely established model of choice behavior, describing how organisms allocate their responses across different alternatives as a function of the relative rewards obtained from them. However, while matching describes behavior at equilibrium, there are still open questions regarding how animals reach such equilibrium and how they adjust and redistribute their choices when the relative payoff from each alternative suddenly changes. In this study, we examine the behavior of six pigeons responding to dynamic concurrent VI-VI schedules, in which the scheduled relative rates of reinforcement abruptly change within sessions. After such a change occurred, the birds started adjusting to the new equilibrium relatively quickly, but fully reaching the new matching prediction took them considerably longer. To account for these results, we compare different models of choice that consider different mechanisms, including the influence of previous reinforcers, the passage of time, and the tendency to repeat previous choices. We use a Bayesian approach to compare these models, with particular attention to whether the observed adjustments reflect gradual changes in learned preferences, persistence in responding, or some combination of both. We explore whether these mechanisms produce different predictions regarding the nature of the post-change adjustment and how well they account for the initial rapid adjustment and the slower convergence toward the new matching equilibrium. Our goal is to understand the processes underlying adaptation to changing environments and exploit the usefulness of the Bayesian framework in separating latent learning dynamics from observed choice behavior.
Keywords
There is nothing here yet. Be the first to create a thread.
Cite this as: