Mitigating Privacy Conflicts with Computational Theory of Mind

Publication date

2025-06-05

Authors

Erdogan, EmreISNI 0000000512526998
Aydin, Hüseyin
Dignum, F.P.M.ISNI 0000000121013677
Verbrugge, Rineke
Yolum, PinarORCID 0000-0001-7848-1834ISNI 0000000492960622

Editors

Vorobeychik, Yevgeniy
Das, Sanmay
Nowe, Ann

Advisors

Supervisors

Document Type

Part of book
Open Access logo

License

cc_by

Abstract

Multiagent systems bring together agents that represent different users with possibly different concerns. When interacting to make decisions, conflicts occur. A well-known case is with privacy. Agents often need to manage the privacy of content that belong to multiple users, such as sharing group pictures on social media. When agents have different expectations on how the content should be shared, multi-party privacy conflicts can arise. How should we design agents to deal with such conflicts? We have studied an empirical user study to understand the effect of group dynamics in various multi-party privacy settings. Our findings show that as users' beliefs and knowledge about others evolve, privacy expectations shift as well. Inspired by this, we propose computational agents that mimic a human-inspired Theory of Mind (ToM) model to help their users preserve their privacy in multi-party privacy conflicts. The agents can express empathy when others are in need but can also fight for their own privacy. We evaluate our approach in multiagent simulations with varying decision-making strategies. Our results demonstrate that ToM-enabled agents improve privacy preservation for all parties, and even more when their understanding of others is dynamically updated through learning.

Keywords

Human-Centered AI, Multi-Party Privacy, Theory of Mind, Artificial Intelligence, Software, Control and Systems Engineering

Citation

Erdogan, E, Aydın, H, Dignum, F, Verbrugge, R & Yolum, P 2025, Mitigating Privacy Conflicts with Computational Theory of Mind. in Y Vorobeychik, S Das & A Nowe (eds), Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2025. Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS, International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), pp. 695-703, 24th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2025, Detroit, United States, 19/05/25. https://doi.org/10.5555/3709347.3743586, conference