Training strategies for competing multiagent dynamical systems.

Abstract

We explore competitive dynamics in multiagent active matter systems using reinforcement learning. In our study, two active Brownian particles (referred to as predators) were trained using either simultaneous or sequential protocols to capture ten passive Brownian particles (preys). The training results depend on the agent, and generally one agent tends to overperform the other. To assess the effectiveness of the two protocols, we examined two policies: (i) a natural policy, where updates to the reinforcement learning parameters of both predators were stopped at a fixed time, even if one agent performed suboptimally; and (ii) a hybrid policy, where we combined the reinforcement learning parameters recorded when each agent achieved its optimal performance. If limited to natural training, simultaneous training appears to be the better option. However, when hybrid training is also allowed, sequential training becomes the preferred choice.