Wu, CM; Schulz, E; Speekenbrink, M; Nelson, JD; Meder, B; (2017) Mapping the unknown: The spatially correlated multi-armed bandit. In: Proceedings of the 39th annual meeting of the Cognitive Science Society 2017. (pp. pp. 1357-1362). Cognitive Science Society: London,UK.

Preview

Text wu2017mapping.pdf - Published Version Download (7MB) | Preview

Abstract

We introduce the spatially correlated multi-armed bandit as a task coupling function learning with the explorationexploitation trade-off. Participants interacted with bi-variate reward functions on a two-dimensional grid, with the goal of either gaining the largest average score or finding the largest payoff. By providing an opportunity to learn the underlying reward function through spatial correlations, we model to what extent people form beliefs about unexplored payoffs and how that guides search behavior. Participants adapted to assigned payoff conditions, performed better in smooth than in rough environments, and—surprisingly—sometimes performed equally well in short as in long search horizons. Our modeling results indicate a preference for local search options, which when accounted for, still suggests participants were best-described as forming local inferences about unexplored regions, combined with a search strategy that directly traded off between exploiting high expected rewards and exploring to reduce uncertainty about the spatial structure of rewards.

Download activity - last month

Export as XMLCSVJSON

Download activity - last 12 months

Export as CSVXMLJSON

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item