Toward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with host publication)peer-review

View graph of relations

Related Research Unit(s)

Detail(s)

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE 35th International Conference on Software Engineering Education and Training, CSEE&T 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages132-136
ISBN (Electronic)9798350322026
ISBN (Print)9798350322033
Publication statusPublished - 2023

Publication series

NameSoftware Engineering Education Conference, Proceedings
Volume2023-August
ISSN (Print)1093-0175
ISSN (Electronic)2377-570X

Conference

Title35th IEEE International Conference on Software Engineering Education and Training (CSEE&T 2023)
PlaceJapan
CityTokyo
Period7 - 9 August 2023

Abstract

We propose a new methodology, the Exercise Creation Methodology (ECM), that leverages recent AI technology advancements to create ChatGPT-assisted programming exercises for beginners. ECM takes an existing exercise as input and mutates it by removing some contents into semantically equivalent but syntactically different versions. The pair of versions are labeled as answered correctly and misleadingly by ChatGPT. The removed contents are re-inserted incrementally with further mutation, ensuring the labels remain unchanged. Using the version with the misleading answer and the ChatGPT elaboration on the other version, we construct a ChatGPT-assisted exercise. The latter version may also serve as a solution. We illustrate ECM using a case study. © 2023 IEEE.

Research Area(s)

  • adversarial example, ChatGPT, exercise, mutation

Citation Format(s)

Toward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models. / Chan, W. K.; Yu, Y. T.; Keung, Jacky W. et al.
Proceedings - 2023 IEEE 35th International Conference on Software Engineering Education and Training, CSEE&T 2023. Institute of Electrical and Electronics Engineers Inc., 2023. p. 132-136 (Software Engineering Education Conference, Proceedings; Vol. 2023-August).

Research output: Chapters, Conference Papers, Creative and Literary Works (RGC: 12, 32, 41, 45)32_Refereed conference paper (with host publication)peer-review