Comparing Humans and Large Language Models in Filling Clinical Questionnaires
Publication date
2025-09-22
Authors
Nardoni, Valeria
Hyeraci, Giulia
Maccari, Martina
Arana, Alejandro
Lucenteforte, Ersilia
Limoncella, Giorgio
Mohammadi, Sima
Roberto, Giuseppe
Tarazjani, Amirreza Dehghan
Virgili, Gianni
Editors
Pedreschi, Dino
Milano, Michela
Tiddi, Ilaria
Russell, Stuart
Boldrini, Chiara
Pappalardo, Luca
Passerini, Andrea
Wang, Shenghui
Advisors
Supervisors
Document Type
Part of book
Metadata
Show full item recordCollections
License
No license information available
Abstract
Filling clinical questionnaires to perform retrospective studies is a time-consuming task that requires strong expertise in specific domains. We exploit prompt engineering techniques to optimize the completion of clinical questionnaires through Large Language Models (LLMs), aiming to compare their performance with respect to human experts. Despite challenges related to limited access to input data, our preliminary experimental results demonstrate the potential of LLMs to streamline clinical data collection, greatly reducing the manual workload for healthcare professionals. However, human validation remains essential to ensure accuracy and reliability in real-world applications.
Keywords
Clinical Records, Large Language Models, Questionnaire Filling, Artificial Intelligence
Citation
Nardoni, V, Hyeraci, G, Maccari, M, Arana, A, Lucenteforte, E, Limoncella, G, Mohammadi, S, Roberto, G, Tarazjani, A D, Virgili, G, Weibel, D, Gini, R, Lippi, M & Marinai, S 2025, Comparing Humans and Large Language Models in Filling Clinical Questionnaires. in D Pedreschi, M Milano, I Tiddi, S Russell, C Boldrini, L Pappalardo, A Passerini & S Wang (eds), HHAI 2025 - Proceedings of the 4th International Conference on Hybrid Human-Artificial Intelligence. Frontiers in Artificial Intelligence and Applications, vol. 408, IOS Press, pp. 525-527, 4th International Conference on Hybrid Human-Artificial Intelligence, HHAI 2025, Pisa, Italy, 9/06/25. https://doi.org/10.3233/FAIA250682, conference