Filtering essays by means of a software tool

• Verfasst von: Seifried, Eva [VerfasserIn]
• Verfasst von: Lenhard, Wolfgang [VerfasserIn]
• Verfasst von: Spinath, Birgit [VerfasserIn]
• Titel: Filtering essays by means of a software tool
• Titelzusatz: identifying poor essays
• Verf.angabe: Eva Seifried, Wolfgang Lenhard, and Birgit Spinath
• Jahr: 2017
• Jahr des Originals: 2016
• Umfang: 10 S.
• Fussnoten: Published online: June 6, 2016 ; Gesehen am 19.04.2017
• Titel Quelle: Enthalten in: Journal of educational computing research
• Ort Quelle: London : Sage Publishing, 1985
• Jahr Quelle: 2017
• Band/Heft Quelle: 55(2017), 1, Seite 26-45
• ISSN Quelle: 1541-4140
• DOI: doi:10.1177/0735633116652407
• Datenträger: Online-Ressource
• Sprache: eng
• K10plus-PPN: 1556684878

Abstract

Writing essays and receiving feedback can be useful for fostering students’ learning and motivation. When faced with large class sizes, it is desirable to identify students who might particularly benefit from feedback. In this article, we tested the potential of Latent Semantic Analysis (LSA) for identifying poor essays. A total of 14 teaching assistants evaluated a sample of N = 60 German essays. Using the human graders’ evaluations as the standard of comparison, more of the poor essays were correctly identified by LSA than by random sampling (i.e., selecting essays by chance). By contrast, selection by text length did not perform better than random sampling. When three different teaching assistants evaluated another sample of N = 94 essays, the results largely replicated those found in the first sample. We conclude that LSA can help university teachers to identify poorly performing students. Additional analyses were computed to investigate the potential of combining the methods in different ways.