Maintaining trust when agents can engage in self-deception.

Abstract

The coexistence of cooperation and selfish instincts is a remarkable characteristic of humans. Psychological research has unveiled the cognitive mechanisms behind self-deception. Two important findings are that a higher ambiguity about others' social preferences leads to a higher likelihood of acting selfishly and that agents acting selfishly will increase their belief that others are also selfish. In this work, we posit a mathematical model of these mechanisms and explain their impact on the undermining of a global cooperative society. We simulate the behavior of agents playing a prisoner's dilemma game in a random network of contacts. We endow each agent with these two self-deception mechanisms which bias her toward thinking that the other agent will defect. We study behavior when a fraction of agents with the "always defect" strategy is introduced in the network. Depending on the magnitude of the biases the players could start a cascade of defection or isolate the defectors. We find that there are thresholds above which the system approaches a state of complete distrust.