Quantifying learning-style adaptation in effectiveness of LLM teaching

Publication date

2024

Authors

Weijers, Ruben
De Castilho, Gabrielle Fidelis
Godbout, Jean François
Rabbany, Reihaneh
Pelrine, Kellin

Editors

Deshpande, Ameet
Hwang, EunJeong
Murahari, Vishvak
Park, Joon Sung
Yang, Diyi
Sabharwal, Ashish
Narasimhan, Karthik
Kalyan, Ashwin

Advisors

Supervisors

DOI

Document Type

Part of book
Open Access logo

License

cc_by

Abstract

This preliminary study aims to investigate whether AI, when prompted based on individual learning styles, can effectively improve comprehension and learning experiences in educational settings. It involves tailoring LLMs baseline prompts and comparing the results of a control group receiving standard content and an experimental group receiving learning styletailored content. Preliminary results suggest that GPT-4 can generate responses aligned with various learning styles, indicating the potential for enhanced engagement and comprehension. However, these results also reveal challenges, including the model's tendency for sycophantic behavior and variability in responses. Our findings suggest that a more sophisticated approach is required for integrating AI into education (AIEd) to improve educational outcomes.

Keywords

Computational Theory and Mathematics, Software, Linguistics and Language

Citation

Weijers, R, De Castilho, G F, Godbout, J F, Rabbany, R & Pelrine, K 2024, Quantifying learning-style adaptation in effectiveness of LLM teaching. in A Deshpande, E Hwang, V Murahari, J S Park, D Yang, A Sabharwal, K Narasimhan & A Kalyan (eds), Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024). Association for Computational Linguistics, pp. 112-118, 1st Workshop on Personalization of Generative AI Systems, PERSONALIZE 2024, St. Julian's, Malta, 22/03/24. < https://aclanthology.org/2024.personalize-1.10/ >, conference