Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions
Publication date
2016
Authors
Miri, Hossein
Kolkmeier, Jan
Taylor, Paul J.
Poppe, R.W.
Heylen, Dirk K J
Editors
Advisors
Supervisors
Document Type
Part of book
Metadata
Show full item recordCollections
License
taverne
Abstract
This paper presents a multimodal simulation system, project-SENSE, that combines virtual reality and full-body motion capture technologies with real-time verbal and nonverbal communication. We introduce the technical setup and employed hardware and software of a first prototype. We discuss the capabilities of the system for the investigation of cooperation paradoxes and the effects of direct nonverbal mimicry. We argue that this prototype lays the technological basis for further research in interpersonal and social skills, as well as the social and emotional consequences of nonverbal mimicry in sustained interactions.
Keywords
Virtual reality, Motion capture, Interactive conversational agents, Mimicry, Social skills, Interpersonal sensemaking, Taverne
Citation
Miri, H, Kolkmeier, J, Taylor, P J, Poppe, R W & Heylen, D K J 2016, Project SENSE – Multimodal Simulation with Full-Body Real-Time Verbal and Nonverbal Interactions. in Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN). Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 178, Springer, pp. 279-284. https://doi.org/10.1007/978-3-319-49616-0_28