Quantifying learning-style adaptation in effectiveness of LLM teaching
Publication date
2024
Authors
Weijers, Ruben
De Castilho, Gabrielle Fidelis
Godbout, Jean François
Rabbany, Reihaneh
Pelrine, Kellin
Editors
Deshpande, Ameet
Hwang, EunJeong
Murahari, Vishvak
Park, Joon Sung
Yang, Diyi
Sabharwal, Ashish
Narasimhan, Karthik
Kalyan, Ashwin
Advisors
Supervisors
DOI
Document Type
Part of book
Metadata
Show full item recordCollections
License
cc_by
Abstract
This preliminary study aims to investigate whether AI, when prompted based on individual learning styles, can effectively improve comprehension and learning experiences in educational settings. It involves tailoring LLMs baseline prompts and comparing the results of a control group receiving standard content and an experimental group receiving learning styletailored content. Preliminary results suggest that GPT-4 can generate responses aligned with various learning styles, indicating the potential for enhanced engagement and comprehension. However, these results also reveal challenges, including the model's tendency for sycophantic behavior and variability in responses. Our findings suggest that a more sophisticated approach is required for integrating AI into education (AIEd) to improve educational outcomes.
Keywords
Computational Theory and Mathematics, Software, Linguistics and Language
Citation
Weijers, R, De Castilho, G F, Godbout, J F, Rabbany, R & Pelrine, K 2024, Quantifying learning-style adaptation in effectiveness of LLM teaching. in A Deshpande, E Hwang, V Murahari, J S Park, D Yang, A Sabharwal, K Narasimhan & A Kalyan (eds), Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024). Association for Computational Linguistics, pp. 112-118, 1st Workshop on Personalization of Generative AI Systems, PERSONALIZE 2024, St. Julian's, Malta, 22/03/24. < https://aclanthology.org/2024.personalize-1.10/ >, conference