Use of Computational Thinking Skills when solving Bebras Tasks: a Think-aloud Study

Abstract

In this study we examine the use of CT skills when solving Bebras tasks. Bebras tasks are logical puzzles created to introduce, practice and sometimes assess Computational Thinking (CT) skills. We use the think-aloud method to investigate the problem-solving process of participants with advanced CT skills. The contribution of this study is three-fold. First, the study examines how the use of CT skills manifests itself in the problem-solving process. By examining the thought process of participants, our study provides a detailed operationalization of CT skill definitions that could be used in subsequent studies to investigate the use of the skills. Secondly, the study provides a validation of the classification of a selection of Bebras tasks. Our results show that the skills assigned to these Bebras are indeed the skills most often used by the problem solvers while solving the tasks. Finally, even though the skills are used, the results also show that this does not always translate into answering these puzzles correctly. Based on the results we therefore conclude that, without looking at the problem-solving process, the tasks may not be suitable for the assessment of CT skills.