ASSESSRA—A Case-Based Approach for the Assessment of Students’ Scientific Reasoning and Argumentation Skills

Publication date

2026-02

Authors

Horrer, Anna
Brandl, Laura
Reichow, Insa
Sailer, Michael
Sailer, Maximilian
Stadler, Matthias
Heene, Moritz
van Gog, TamaraISNI 0000000387224834
Fischer, Frank
Fischer, Martin R.

Editors

Advisors

Supervisors

Document Type

Article
Open Access logo

License

cc_by_nc

Abstract

Scientific reasoning and argumentation (SRA) skills are crucial in higher education, yet comparing studies on these skills remains challenging due to the scarcity of well-developed SRA-tests with robust psychometric properties. In this paper, the case-based ASSESSRA approach is proposed to evaluate university students’ SRA-skills, focusing specifically on the skills evidence evaluation and drawing conclusions. A prototype constructed using this approach in an educational context demonstrated reliability within an expert panel (n = 9; ICC = .81). In a subsequent study, the validity of the ASSESSRA approach was examined with 207 students, a partial-credit-model exhibited an acceptable fit, demonstrating no significant outfit and excellent distribution of ability parameters and Thurstonian thresholds. The ASSESSRA-prototype, coupled with provided guidelines, offers a versatile framework for developing comparable SRA-tests across diverse domains. This approach not only addresses the current gap in SRA assessment instruments but also holds promise for enhancing the understanding and promotion of SRA-skills in higher education.

Keywords

assessment, case-based reasoning, evidence-based decision-making, higher education, scientific reasoning and argumentation, Education, Clinical Psychology, General Psychology

Citation

Horrer, A, Brandl, L, Reichow, I, Sailer, M, Sailer, M, Stadler, M, Heene, M, van Gog, T, Fischer, F, Fischer, M R & Zottmann, J M 2026, 'ASSESSRA—A Case-Based Approach for the Assessment of Students’ Scientific Reasoning and Argumentation Skills', Journal of Psychoeducational Assessment, vol. 44, no. 1, pp. 3-19. https://doi.org/10.1177/07342829251364579