Action similarity warps visual feature space in working memory.

Abstract

Visual working memory (VWM) retains representations of past visual information for future action. Yet to date, most studies have approached VWM as just serving perception beyond the immediate. Whether and how prospective actions shape information in VWM remains largely unknown, in part because typical experimental setups limit behavior to simple button presses. In two experiments (one preregistered), using a novel interactive VWM task, we show that the similarity of the actions that we intend to perform on memory items adaptively distorts their representation. Participants memorized the orientation of two bars, after which they were informed as to which manual actions they should reproduce these orientations with in a memory recall test. We observed that perceptually similar items were remembered as more distinct when paired with different action plans versus the same action plan. A control experiment showed that this action-induced effect reflects a true change in the visual representation rather than a motor bias. These findings demonstrate that VWM representations are flexibly adapted to guide specific overt actions and provide evidence that action plans can retrospectively warp sensory feature space in VWM.