Comparing Humans and Large Language Models in Filling Clinical Questionnaires

Publication date

2025-09-22

Authors

Nardoni, Valeria
Hyeraci, Giulia
Maccari, Martina
Arana, Alejandro
Lucenteforte, Ersilia
Limoncella, Giorgio
Mohammadi, Sima
Roberto, Giuseppe
Tarazjani, Amirreza Dehghan
Virgili, Gianni

Editors

Pedreschi, Dino
Milano, Michela
Tiddi, Ilaria
Russell, Stuart
Boldrini, Chiara
Pappalardo, Luca
Passerini, Andrea
Wang, Shenghui

Advisors

Supervisors

Document Type

Part of book
Open Access logo

License

No license information available

Abstract

Filling clinical questionnaires to perform retrospective studies is a time-consuming task that requires strong expertise in specific domains. We exploit prompt engineering techniques to optimize the completion of clinical questionnaires through Large Language Models (LLMs), aiming to compare their performance with respect to human experts. Despite challenges related to limited access to input data, our preliminary experimental results demonstrate the potential of LLMs to streamline clinical data collection, greatly reducing the manual workload for healthcare professionals. However, human validation remains essential to ensure accuracy and reliability in real-world applications.

Keywords

Clinical Records, Large Language Models, Questionnaire Filling, Artificial Intelligence

Citation

Nardoni, V, Hyeraci, G, Maccari, M, Arana, A, Lucenteforte, E, Limoncella, G, Mohammadi, S, Roberto, G, Tarazjani, A D, Virgili, G, Weibel, D, Gini, R, Lippi, M & Marinai, S 2025, Comparing Humans and Large Language Models in Filling Clinical Questionnaires. in D Pedreschi, M Milano, I Tiddi, S Russell, C Boldrini, L Pappalardo, A Passerini & S Wang (eds), HHAI 2025 - Proceedings of the 4th International Conference on Hybrid Human-Artificial Intelligence. Frontiers in Artificial Intelligence and Applications, vol. 408, IOS Press, pp. 525-527, 4th International Conference on Hybrid Human-Artificial Intelligence, HHAI 2025, Pisa, Italy, 9/06/25. https://doi.org/10.3233/FAIA250682, conference