Toward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Title of host publication | Proceedings - 2023 IEEE 35th International Conference on Software Engineering Education and Training, CSEE&T 2023 |
Publisher | Institute of Electrical and Electronics Engineers, Inc. |
Pages | 132-136 |
ISBN (electronic) | 9798350322026 |
ISBN (print) | 9798350322033 |
Publication status | Published - 2023 |
Publication series
Name | Software Engineering Education Conference, Proceedings |
---|---|
Volume | 2023-August |
ISSN (Print) | 1093-0175 |
ISSN (electronic) | 2377-570X |
Conference
Title | 35th IEEE International Conference on Software Engineering Education and Training (CSEE&T 2023) |
---|---|
Place | Japan |
City | Tokyo |
Period | 7 - 9 August 2023 |
Link(s)
Abstract
We propose a new methodology, the Exercise Creation Methodology (ECM), that leverages recent AI technology advancements to create ChatGPT-assisted programming exercises for beginners. ECM takes an existing exercise as input and mutates it by removing some contents into semantically equivalent but syntactically different versions. The pair of versions are labeled as answered correctly and misleadingly by ChatGPT. The removed contents are re-inserted incrementally with further mutation, ensuring the labels remain unchanged. Using the version with the misleading answer and the ChatGPT elaboration on the other version, we construct a ChatGPT-assisted exercise. The latter version may also serve as a solution. We illustrate ECM using a case study. © 2023 IEEE.
Research Area(s)
- adversarial example, ChatGPT, exercise, mutation
Citation Format(s)
Toward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models. / Chan, W. K.; Yu, Y. T.; Keung, Jacky W. et al.
Proceedings - 2023 IEEE 35th International Conference on Software Engineering Education and Training, CSEE&T 2023. Institute of Electrical and Electronics Engineers, Inc., 2023. p. 132-136 (Software Engineering Education Conference, Proceedings; Vol. 2023-August).
Proceedings - 2023 IEEE 35th International Conference on Software Engineering Education and Training, CSEE&T 2023. Institute of Electrical and Electronics Engineers, Inc., 2023. p. 132-136 (Software Engineering Education Conference, Proceedings; Vol. 2023-August).
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review