A multitrait-multimethod study of assessment instruments for complex problem solving

• Verfasst von: Greiff, Samuel [VerfasserIn]
• Verfasst von: Fischer, Andreas [VerfasserIn]
• Verfasst von: Wüstenberg, Sascha [VerfasserIn]
• Verfasst von: Sonnleitner, Philipp [VerfasserIn]
• Verfasst von: Brunner, Martin [VerfasserIn]
• Verfasst von: Martin, Romain [VerfasserIn]
• Titel: A multitrait-multimethod study of assessment instruments for complex problem solving
• Verf.angabe: Samuel Greiff, Andreas Fischer, Sascha Wüstenberg, Philipp Sonnleitner, Martin Brunner, Romain Martin
• E-Jahr: 2013
• Jahr: 23 August 2013
• Umfang: 18 S.
• Teil: volume:41
• Teil: year:2013
• Teil: number:5
• Teil: pages:579-596
• Teil: extent:18
• Fussnoten: Gesehen am 11.03.2021
• Titel Quelle: Enthalten in: Intelligence
• Ort Quelle: Greenwich, Conn. : Ablex, 1977
• Jahr Quelle: 2013
• Band/Heft Quelle: 41(2013), 5, Seite 579-596
• ISSN Quelle: 1873-7935
• DOI: doi:10.1016/j.intell.2013.07.012
• Datenträger: Online-Ressource
• Sprache: eng
• Bibliogr. Hinweis: Erscheint auch als : Druck-Ausgabe: Greiff, Samuel, 1979 - : A multitrait-multimethod study of assessment instruments for complex problem solving. - 2013
• Sach-SW: Complex Problem Solving
• Sach-SW: Genetics Lab
• Sach-SW: MicroDYN
• Sach-SW: MicroFIN
• Sach-SW: Reasoning
• K10plus-PPN: 175113279X

Abstract

Recently published studies on Complex Problem Solving (CPS) suggest that assessments of CPS using multiple complex systems are only moderately related to tests of classical cognitive abilities. Further, CPS assessments show incremental validity beyond tests of other cognitive abilities when predicting relevant outcomes. However, these empirical accounts have relied on single CPS assessment instruments. We do not know whether these findings will generalize to the construct level across different CPS assessment instruments. To answer this question, we tested a sample of N=339 German university students who completed three CPS assessment instruments based on multiple complex systems (MicroDYN, the Genetics Lab, and MicroFIN) and the matrices subtest of the Intelligence Structure Test as measure of reasoning. Students further reported their school grades. Analyses including latent multitrait-multimethod models provided support for the conceptualization of CPS as a complex cognitive ability. Results indicated that different CPS assessment instruments showed sufficient convergent validity (with a consistency mostly between .50 and .60). In addition, we found evidence for the divergent validity of CPS from reasoning (reasoning predicted two CPS facets, knowledge and control, βKNOW=.49 and βCON=.53, respectively). In the prediction of academic achievement, CPS explained variance in natural science grades after we controlled for reasoning (βCPS=.22), whereas social science grades were not predicted. Our findings suggest that the validity of CPS generalizes across different measurement instruments.