The dynamics of explore-exploit decisions suggest a threshold mechanism for reduced random exploration in older adults.

Abstract

When faced with a choice between exploring an unknown option vs exploiting an option they know well, older adults explore less and exploit more than younger adults. Recent work has suggested that one cause of this age difference in exploration is a reduction in the extent to which older adults use "random exploration" - exploration driven by behavioral variability. Here we investigate potential mechanisms for this age-related difference in random exploration through the lens of a drift diffusion model (DDM) of the explore-exploit choice. In this model, random exploration can be modulated by two mechanisms - the fidelity with which information about the choice is represented in the brain, the "signal-to-noise ratio" (SNR), and the amount of information required to make a decision, the "decision threshold." Reduced random exploration in aging could be caused either by an increase in signal-to-noise ratio or an increase in decision threshold in older adults. By fitting the DDM to choices and response times in a sample of healthy younger and older adults, we found that older adults had a lower SNR and a higher threshold than younger adults. This suggests that reduced random exploration in aging is driven by higher response thresholds in older adults, which may compensate for the reduced signal-to-noise ratio with which decision information is represented in the brain.