Generation of Document Type Exercises for Automated Assessment

Authors José Paulo Leal , Ricardo Queirós , Marco Primo

Thumbnail PDF


  • Filesize: 467 kB
  • 6 pages

Document Identifiers

Author Details

José Paulo Leal
  • CRACS - INESC-TEC, Porto, Portugal
  • Department of Computer Science, Faculty of Science, University of Porto, Portugal
Ricardo Queirós
  • CRACS - INESC-TEC, Porto, Portugal
  • uniMAD, ESMAD/P.PORTO, Portugal
Marco Primo
  • Faculty of Sciences, University of Porto, Portugal

Cite AsGet BibTex

José Paulo Leal, Ricardo Queirós, and Marco Primo. Generation of Document Type Exercises for Automated Assessment. In 11th Symposium on Languages, Applications and Technologies (SLATE 2022). Open Access Series in Informatics (OASIcs), Volume 104, pp. 4:1-4:6, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2022)


This paper describes ongoing research to develop a system to automatically generate exercises on document type validation. It aims to support multiple text-based document formalisms, currently including JSON and XML. Validation of JSON documents uses JSON Schema and validation of XML uses both XML Schema and DTD. The exercise generator receives as input a document type and produces two sets of documents: valid and invalid instances. Document types written by students must validate the former and invalidate the latter. Exercises produced by this generator can be automatically accessed in a state-of-the-art assessment system. This paper details the proposed approach and describes the design of the system currently being implemented.

Subject Classification

ACM Subject Classification
  • Applied computing → Computer-assisted instruction
  • Information systems → Information storage systems
  • Information systems → Web data description languages
  • Information systems → Extensible Markup Language (XML)
  • exercise generation
  • automated assessment
  • document type assessment


  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    PDF Downloads


  1. Cesare Bartolini, Antonia Bertolino, Eda Marchetti, and Andrea Polini. Ws-taxi: A wsdl-based testing tool for web services. In 2009 International Conference on Software Testing Verification and Validation, pages 326-335. IEEE, 2009. Google Scholar
  2. Clara Benac Earle, Lars-Åke Fredlund, and John Hughes. Automatic grading of programming exercises using property-based testing. In Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education, pages 47-52, 2016. Google Scholar
  3. Katerina Georgouli and Pedro Guerreiro. Incorporating an automatic judge into blended learning programming activities. In International Conference on Web-Based Learning, pages 81-90. Springer, 2010. Google Scholar
  4. José Carlos Paiva, José Paulo Leal, and Álvaro Figueira. Automated assessment in computer science education: A state-of-the-art review. ACM Transactions on Computing Education (TOCE), 2022. Google Scholar
  5. José Carlos Paiva, Ricardo Queirós, José Paulo Leal, and Jakub Swacha. Yet another programming exercises interoperability language (short paper). In 9th Symposium on Languages, Applications and Technologies (SLATE 2020). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 2020. Google Scholar
  6. Dessislava Petrova-Antonova, Kunka Kuncheva, and Sylvia Ilieva. Automatic generation of test data for xml schema-based testing of web services. In 2015 10th International Joint Conference on Software Technologies (ICSOFT), volume 1, pages 1-8. IEEE, 2015. Google Scholar
  7. Harry M Sneed and Shihong Huang. The design and use of wsdl-test: a tool for testing web services. Journal of Software Maintenance and Evolution: Research and Practice, 19(5):297-314, 2007. Google Scholar
  8. Austin Wright, Henry Andrews, and G Dennis. Json schema: A media type for describing json documents. In IETF, Internet-Draft draft. IETF - Internet Engineering Task Force, 2020. Google Scholar
Questions / Remarks / Feedback

Feedback for Dagstuhl Publishing

Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail