Log File Times as Indicators of Structured Figural Matrix Processing

Abstract

Previous research has shown individual differences in (a) time on task (ToT) and (b) the degree of structuredness in processing figural matrices. The goal of this article was to integrate these two lines of research by analyzing log files from a computer-based assessment (N = 198) to examine the role of three ToT sub-components: onset times (before engaging with the first matrix rule), interrule times (between the rules), and intrarule times (within a single rule). We tested three clues that support the assumptions that the interrule times reflect the cognitive construction of a rule-specific solution plan, while the onset times represent a global orientation reaction, and the intrarule times capture the behavioral execution of the plan: (1) based on the interrule times, we identified two clusters of participants, of which one processed the matrices in a more structured fashion; (2) only the accelerating effect of the interrule times across the test was associated with test performance, indicating higher reasoning saturation; (3) a mediated path analysis revealed that faster interrule times propagate in faster intrarule times and more structured processing of matrix rules, resulting in better performance. Confirming internal validity, the three log file times accounted for an incremental 24.30% of test performance variance beyond the traditional ToT. Confirming external validity, two clusters were also identified based on the interrule times from the first test and performance scores from a second matrix test.