- To reproduce data preprocessing steps, refer content directory
- To evaluate KT methods in diverse setting, use kt_benchmark submodule
- To run AFM in the dataset, user pyAFM submodule
Our data inherits the terms of use of CMU datashop (https://pslcdatashop.web.cmu.edu/Terms).
We conducted this experiment on an M3 MacBook Pro with 36GB of shared memory. The experiments were conducted only once with the seed fixed on the code, and the seeds were not optimized for better results.
If you need any help with the code or the data, feel free to contact me at donim [at] andrew.cmu.edu
@inproceedings{2025.EDM.long-papers.170,
abstract = {Knowledge tracing models have enabled a range of intelligent tutoring systems to provide feedback to students.
However, existing methods for knowledge tracing in learning sciences are predominantly reliant on statistical data and instructor-defined knowledge components, making it challenging to integrate AI-generated educational content with traditional established methods. We propose a method for automatically extracting knowledge components from educational content using instruction-tuned large multimodal models. We validate this approach by comprehensively evaluating it against knowledge tracing benchmarks in five domains. Our results indicate that the automatically extracted knowledge components can effectively replace human-tagged labels, offering a promising direction for enhancing intelligent tutoring systems in limited-data scenarios, achieving more explainable assessments in educational settings, and laying the groundwork for automated assessment.},
address = {Palermo, Italy},
author = {Hyeongdon Moon and Richard Lee Davis and Seyed Parsa Neshaei and Pierre Dillenbourg},
booktitle = {Proceedings of the 18th International Conference on Educational Data Mining},
doi = {10.5281/zenodo.15870171},
editor = {Caitlin Mills and Giora Alexandron and Davide Taibi and Giosuè Lo Bosco and Luc Paquette},
isbn = {978-1-7336736-6-2},
month = {July},
pages = {342--353},
publisher = {International Educational Data Mining Society},
title = {Using Large Multimodal Models to Extract Knowledge Components for Knowledge Tracing from Multimedia Question Information},
year = {2025}
}