Assessing the Effectiveness of Personalized Computer-Administered Feedback in an Introductory Biology Course
Date
2019-08-14
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
ORCID
0000-0003-1547-9838
Type
Thesis
Degree Level
Masters
Abstract
Though often held in high regard as a pedagogical tool, the role of feedback within the learning process remains poorly understood. The prevailing feedback literature reveals a history of inconsistent if not contradictory findings. This already complicated state is made worse by the recent introduction of learning analytic tools capable of providing students with ongoing personalized computer-generated feedback; the effectiveness of which remains unknown. The present study contributed to this new domain of knowledge by evaluating one such circumstance where a learning analytic feedback intervention was implemented in an introductory biology course at the University of Saskatchewan. The system provided personalized feedback to half of the enrolled students differentiated according their individual characteristics. The remaining students received generic feedback that was common to all students within the condition. The effectiveness of personalized feedback was evaluated with respect to academic achievement (i.e., final grade) and feedback satisfaction. Results of the treatment effect analyses showed no significant differences in student academic achievement but a small significant difference in feedback satisfaction. Follow-up analyses revealed that these significant differences in feedback satisfaction were not consistent from one iteration of the course to the next and that mean feedback satisfaction was in steady decline since the system’s implementation. It is suspected that the lack of improvement in academic achievement pertained to poor adherence of the system with the theoretical underpinnings of good feedback practice. Limitations of the study and future directions are discussed.
Description
Keywords
Learning analytics, personalized feedback
Citation
Degree
Master of Education (M.Ed.)
Department
Educational Psychology and Special Education
Program
Applied Measurement and Evaluation