Re-viewing performance: Showing eye-tracking data as feedback to improve performance monitoring in a complex visual task

Publication date

2022-08

Authors

Kok, Ellen
Hormann, Olle
Rou, Jeroen
van Saase, Evi
van der Schaaf, Marieke
Kester, Liesbeth
van Gog, Tamara

Editors

Advisors

Supervisors

Document Type

Article

Collections

Open Access logo

License

cc_by_nc

Abstract

Background: Performance monitoring plays a key role in self-regulated learning, but is difficult, especially for complex visual tasks such as navigational map reading. Gaze displays (i.e. visualizations of participants' eye movements during a task) might serve as feedback to improve students' performance monitoring. Objectives: We hypothesized that participants who review their performance based on screen recordings that also display their gaze would have a higher monitoring accuracy and increase in post-test performance and would remember more executed actions than participants who review based on a screen recording only (i.e. control condition). Methods: Sixty-four higher education students were randomly assigned to a gaze-display or control condition. After watching an instruction video, they practiced five navigational map-reading tasks and then reviewed their performance while thinking aloud, either prompted by a screen recording with gaze display or a screen recording only. Before and after reviewing, participants estimated the number of correctly solved tasks and finally made a five-item post-test. Results and conclusions: Analyses with frequentist and Bayesian statistics showed that gaze displays did not improve monitoring accuracy (i.e. estimated minus actual performance), post-test performance, or the number of reported actions. It is concluded that scanpath gaze displays do not provide useful cues to improve monitoring accuracy in this task. Takeaways: Gaze displays are a promising tool for education, but scanpath gaze displays did not help to enhance monitoring accuracy in a navigational map-reading task.

Keywords

eye tracking, gaze display, metacognition, monitoring, navigational map reading, Education, Computer Science Applications

Citation

Kok, E, Hormann, O, Rou, J, van Saase, E, van der Schaaf, M, Kester, L & van Gog, T 2022, 'Re-viewing performance : Showing eye-tracking data as feedback to improve performance monitoring in a complex visual task', Journal of Computer Assisted Learning, vol. 38, no. 4, pp. 1087-1101. https://doi.org/10.1111/jcal.12666