DROPS

Document

DOI: 10.4230/OASIcs.ICPEC.2025.5

Integrating Questions About Learners’ Code in an Automated Assessment System

Authors: Afonso B. Caniço and André L. Santos

Published in: OASIcs, Volume 133, 6th International Computer Programming Education Conference (ICPEC 2025)

Abstract

Questions about Learners' Code (QLCs) assess programming students' program comprehension skills by providing personalised questions targeting the students' own program code. We conducted a preliminary, experimental implementation of integrating QLCs in the Automated Assessment System (AAS) used in an introductory programming course using Java. QLCs targeted some of the code assignments which students had to complete during the course. We collected 889 answers to QLCs, answered by 13 students over five course modules. We found that as the complexity of exercises increases, the success rate of the same type of QLC may not improve, and even exhibit a decline over time. We further analysed incorrect answers individually to relate them to possible misconceptions.

Cite as

Afonso B. Caniço and André L. Santos. Integrating Questions About Learners’ Code in an Automated Assessment System. In 6th International Computer Programming Education Conference (ICPEC 2025). Open Access Series in Informatics (OASIcs), Volume 133, pp. 5:1-5:14, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2025)

Copy BibTex To Clipboard

@InProceedings{canico_et_al:OASIcs.ICPEC.2025.5,
  author =	{Cani\c{c}o, Afonso B. and Santos, Andr\'{e} L.},
  title =	{{Integrating Questions About Learners’ Code in an Automated Assessment System}},
  booktitle =	{6th International Computer Programming Education Conference (ICPEC 2025)},
  pages =	{5:1--5:14},
  series =	{Open Access Series in Informatics (OASIcs)},
  ISBN =	{978-3-95977-393-5},
  ISSN =	{2190-6807},
  year =	{2025},
  volume =	{133},
  editor =	{Queir\'{o}s, Ricardo and Pinto, M\'{a}rio and Portela, Filipe and Sim\~{o}es, Alberto},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/OASIcs.ICPEC.2025.5},
  URN =		{urn:nbn:de:0030-drops-240353},
  doi =		{10.4230/OASIcs.ICPEC.2025.5},
  annote =	{Keywords: programming education, student assessment, program comprehension, questions about learners’ code}
}

Search Results

Documents authored by Caniço, Afonso B.

Integrating Questions About Learners’ Code in an Automated Assessment System

Abstract

Cite as

Thanks for your feedback!

Could not send message