Gyöngyvér Molnár: The Effectiveness and Change of Exploration Strategies in an Interactive Problem-Solving Environment: Logfile Analyses

Improvements in educational assessment technology have now made it possible to record and analyse not only students’ answers, but also the actions they take during testing. Through the contextual data in logfiles, we can reconstruct everything the students were thinking in completing each item on the test. Based on contextual data collected during the research on both the developmental level and development of the interactive problem-solving strategies used by students in Grades 6–8 in the study (n=2226), we analysed the effective and less effective mapping and problem-solving strategies they employed in solving interactive problems. In phase one, we constructed a mathematical model based on theoretically good strategies that led to the solving of minimally complex problems. This model provided an overview that made it possible to analyse the combination of steps and strategies used. With this coding procedure and model, we were able to obtain a precise picture of students’ successful and less successful problem-solving strategies. We have thus succeeded in expanding the range of problem-solving strategies identified thus far in the literature, where the vary-one-thing-at-a-time (VOTAT) strategy has been viewed as the only correct strategy in minimally complex problem solving. The reliability indices of the test increase significantly if we base our determinations not only on students’ specific answers (α=0.72), but also on an analysis of the characteristic contextual data that enable us to reconstruct the problem-solving process more accurately (α=0.91). Despite the fact that an understanding and mapping of minimally complex systems may be achieved with a number of problem-solving strategies, the use of the strategy of isolated variables, which is grouped among the VOTAT strategies – strategies that are discussed with near exclusivity in the literature – has proved the most effective. The more complex the system that underlies the problem, the greater the gap in performance between the more and less conscious VOTAT strategy users. The analyses elucidate the students’ relative achievements, which were close overall, though they had taken different paths with problem-solving strategies of varying effectiveness. The results have contributed to a more thorough understanding of strategies that are and can be used in an interactive problem-solving environment, and they have shed light once again on the increasingly urgent task of shifting from instruction grounded almost completely in the transmission of knowledge to an expansion of problem-based teaching that also brings thinking skills into focus.

MAGYAR PEDAGÓGIA 116. Number 4. 427-453. (2016)

Levelezési cím / Address for correspondence: : Molnár Gyöngyvér, Szegedi Tudományegyetem Oktatáselmélet Tanszék. H–6722 Szeged, Petőfi Sándor sgt. 30–34.

 
PDF