TY - GEN
T1 - A meta-learning augmented bidirectional transformer model for automatic short answer grading
AU - Wang, Zichao
AU - Lan, Andrew S.
AU - Waters, Andrew E.
AU - Grimaldi, Phillip
AU - Baraniuk, Richard G.
PY - 2019
Y1 - 2019
N2 - We introduce ml-BERT, an effective machine learning method for automatic short answer grading when training data, i.e., graded answers, is limited. Our method combines BERT (Bidirectional Representation of the Transformer), the state-of-the-art model for learning textual data representations, with meta-learning, a training framework that leverages additional data and learning tasks to improve model performance when labeled data is limited. Our intuition is to use meta-learning to help us learn an initialization of the BERT parameters in a specific target subject domain using un-labeled data, thus fully leveraging the limited labeled training data for the grading task. Experiments on a real-world student answer dataset demonstrate the promise of ml-BERT method for automatic short answer grading.
AB - We introduce ml-BERT, an effective machine learning method for automatic short answer grading when training data, i.e., graded answers, is limited. Our method combines BERT (Bidirectional Representation of the Transformer), the state-of-the-art model for learning textual data representations, with meta-learning, a training framework that leverages additional data and learning tasks to improve model performance when labeled data is limited. Our intuition is to use meta-learning to help us learn an initialization of the BERT parameters in a specific target subject domain using un-labeled data, thus fully leveraging the limited labeled training data for the grading task. Experiments on a real-world student answer dataset demonstrate the promise of ml-BERT method for automatic short answer grading.
UR - https://www.scopus.com/pages/publications/85085965692
UR - https://www.scopus.com/inward/citedby.url?scp=85085965692&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85085965692
T3 - EDM 2019 - Proceedings of the 12th International Conference on Educational Data Mining
SP - 667
EP - 670
BT - EDM 2019 - Proceedings of the 12th International Conference on Educational Data Mining
A2 - Lynch, Collin F.
A2 - Merceron, Agathe
A2 - Desmarais, Michel
A2 - Nkambou, Roger
PB - International Educational Data Mining Society
T2 - 12th International Conference on Educational Data Mining, EDM 2019
Y2 - 2 July 2019 through 5 July 2019
ER -