Adoption of Computer Programming Exercises for Automatic Assessment — Issues and Caution

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)

1 Scopus Citations
View graph of relations

Author(s)

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationWorkshop Proceedings of the 25th International Conference on Computers in Education
EditorsY. Hayashi
PublisherAsia-Pacific Society for Computers in Education
Pages555-564
ISBN (Print)9789869401227
Publication statusPublished - Dec 2017

Conference

Title25th International Conference on Computers in Education (ICCE 2017)
LocationRydges Latimer hotel
PlaceNew Zealand
CityChristchurch
Period4 - 8 December 2017

Abstract

Computational thinking is an interdisciplinary core skill to be acquired in STEM education, while computer program coding is a concrete manifestation of such a skill. In response to the increasing size of computer programming classes and rapidly growing number of learners, particularly in massive open online courses (MOOCs), many instructors nowadays heavily rely on the use of automated systems to assess the programming work of students. However, these automated assessment systems typically perform black box testing to determine the correctness of student programs, which limits the type of programming exercises that can be automatically assessed. This paper reports a case study on the adoption of programming exercises from textbook and online resources, and categorises some difficulties and issues of caution due to the technical limitation of typical automated assessment systems. The identified issues are mainly related to the input/output and non-deterministic nature of the programs or the intended learning outcomes of some of the exercises. The paper concludes with a brief outline of recent research directions to alleviate these problems for improvement of learning.

Research Area(s)

  • Assessment of learning, automated assessment, black box testing, computational thinking, computer programming exercises, technology-enhanced learning and assessment

Citation Format(s)

Adoption of Computer Programming Exercises for Automatic Assessment — Issues and Caution. / YU, Yuen Tak; TANG, Chung Man; POON, Chung Keung; KEUNG, Jacky Wai.

Workshop Proceedings of the 25th International Conference on Computers in Education. ed. / Y. Hayashi. Asia-Pacific Society for Computers in Education, 2017. p. 555-564.

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with ISBN/ISSN)