Validity and Reliability of Student Models for Problem-Solving Activities

Varování

Publikace nespadá pod Ekonomicko-správní fakultu, ale pod Fakultu informatiky. Oficiální stránka publikace je na webu muni.cz.
Autoři

EFFENBERGER Tomáš PELÁNEK Radek

Rok publikování 2021
Druh Článek ve sborníku
Konference Proceedings of the 11th International Conference on Learning Analytics and Knowledge
Fakulta / Pracoviště MU

Fakulta informatiky

Citace
www https://dl.acm.org/doi/10.1145/3448139.3448140
Doi http://dx.doi.org/10.1145/3448139.3448140
Klíčová slova student modeling; skills; difficulties; validity; reliability; performance measures; problem solving; introductory programming
Popis Student models are typically evaluated through predicting the correctness of the next answer. This approach is insufficient in the problem-solving context, especially for student models that use performance data beyond binary correctness. We propose more comprehensive methods for validating student models and illustrate them in the context of introductory programming. We demonstrate the insufficiency of the next answer correctness prediction task, as it is neither able to reveal low validity of student models that use just binary correctness, nor does it show increased validity of models that use other performance data. The key message is that the prevalent usage of the next answer correctness for validating student models and binary correctness as the only input to the models is not always warranted and limits the progress in learning analytics.
Související projekty:

Používáte starou verzi internetového prohlížeče. Doporučujeme aktualizovat Váš prohlížeč na nejnovější verzi.