Advanced

Assessing the black box of feedback neglect in a digital educational game for elementary school

Tärning, Betty LU ; Lee, Yeon Joo ; Andersson, Richard LU ; Månsson, Kristian LU ; Gulz, Agneta LU and Haake, Magnus LU (2020) In Journal of the Learning Sciences
Abstract

Background: Previous research shows that critical constructive feedback, that scaffolds students to improve on tasks, often remains untapped. The paper’s aim is to illuminate at what stages students provided with such feedback drop out of feedback processing. Methods: In our model, students can drop out at any of five stages of feedback processing: (1) noticing, (2) decoding, (3) making sense, (4) acting upon, and (5) using feedback to make progress. Eye-tracking was used to measure noticing and decoding of feedback. Behavioral data-logging tracked students’ use of feedback and potential progress. Three feedback signaling conditions were experimentally compared: a pedagogical agent, an animated arrow, and no signaling (control... (More)

Background: Previous research shows that critical constructive feedback, that scaffolds students to improve on tasks, often remains untapped. The paper’s aim is to illuminate at what stages students provided with such feedback drop out of feedback processing. Methods: In our model, students can drop out at any of five stages of feedback processing: (1) noticing, (2) decoding, (3) making sense, (4) acting upon, and (5) using feedback to make progress. Eye-tracking was used to measure noticing and decoding of feedback. Behavioral data-logging tracked students’ use of feedback and potential progress. Three feedback signaling conditions were experimentally compared: a pedagogical agent, an animated arrow, and no signaling (control condition). Findings: Students dropped out at each stage and few made it past the final stage. The agent condition led to significantly less feedback neglect at the two first stages, suggesting that students who are not initially inclined to notice and read feedback text can be influenced into doing so. Contribution: The study provides a model and method to build more fine-grained knowledge of students’ (non)processing of feedback. More knowledge on at what stages students drop out and why can inform methods to counteract drop out and scaffold more productive and fruitful responses.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; ; and
organization
publishing date
type
Contribution to journal
publication status
epub
subject
in
Journal of the Learning Sciences
pages
39 pages
publisher
Routledge
external identifiers
  • scopus:85087607496
ISSN
1050-8406
DOI
10.1080/10508406.2020.1770092
language
English
LU publication?
yes
id
ad5b2473-ad62-4a89-b244-54a249587fd3
date added to LUP
2020-07-23 11:26:54
date last changed
2020-10-07 07:02:06
@article{ad5b2473-ad62-4a89-b244-54a249587fd3,
  abstract     = {<p>Background: Previous research shows that critical constructive feedback, that scaffolds students to improve on tasks, often remains untapped. The paper’s aim is to illuminate at what stages students provided with such feedback drop out of feedback processing. Methods: In our model, students can drop out at any of five stages of feedback processing: (1) noticing, (2) decoding, (3) making sense, (4) acting upon, and (5) using feedback to make progress. Eye-tracking was used to measure noticing and decoding of feedback. Behavioral data-logging tracked students’ use of feedback and potential progress. Three feedback signaling conditions were experimentally compared: a pedagogical agent, an animated arrow, and no signaling (control condition). Findings: Students dropped out at each stage and few made it past the final stage. The agent condition led to significantly less feedback neglect at the two first stages, suggesting that students who are not initially inclined to notice and read feedback text can be influenced into doing so. Contribution: The study provides a model and method to build more fine-grained knowledge of students’ (non)processing of feedback. More knowledge on at what stages students drop out and why can inform methods to counteract drop out and scaffold more productive and fruitful responses.</p>},
  author       = {Tärning, Betty and Lee, Yeon Joo and Andersson, Richard and Månsson, Kristian and Gulz, Agneta and Haake, Magnus},
  issn         = {1050-8406},
  language     = {eng},
  month        = {07},
  publisher    = {Routledge},
  series       = {Journal of the Learning Sciences},
  title        = {Assessing the black box of feedback neglect in a digital educational game for elementary school},
  url          = {http://dx.doi.org/10.1080/10508406.2020.1770092},
  doi          = {10.1080/10508406.2020.1770092},
  year         = {2020},
}