Does ChatGPT have Theory of Mind?

Publication date

2023-05-23

Authors

Holterman, BartISNI 0000000493298925
van Deemter, KeesISNI 0000000115590531

Editors

Advisors

Supervisors

Document Type

/dk/atira/pure/researchoutput/researchoutputtypes/workingpaper/preprint
Open Access logo

License

Abstract

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent recent Large Language Models in the ChatGPT tradition possess ToM. We posed six well-known problems that address biases in human reasoning and decision making to two versions of ChatGPT and we compared the results under a range of prompting strategies. While the results concerning ChatGPT-3 were somewhat inconclusive, ChatGPT-4 was shown to arrive at the correct answers more often than would be expected based on chance, although correct answers were often arrived at on the basis of false assumptions or invalid reasoning.

Keywords

Citation

Holterman, B & van Deemter, K 2023 'Does ChatGPT have Theory of Mind?' arXiv, pp. 1-13. https://doi.org/10.48550/arXiv.2305.14020