Abstract
This thesis outlines the application and exploration of 3D technology, specifically represented by augmented reality (AR), in visual experience and interaction design, traditional culture, and narrative research. This research is a practical study of how AR Book and the classical Chinese novel A Dream of Red Mansions are integrated to create a design artifact. It explores the interactive experiment of desktop-level handheld AR creative work to better understand the essential cognition of AR applications. AR Books based on Chinese classical novels are developed through this project, which also demonstrates a design process for implementing into AR applications, in addition to providing new design knowledge for AR research. There are three main stages in this study, each with a research question attached to it:RQ1: What are AR Books as materials for presenting Chinese culture?
RQ1 focuses mainly on the background of AR and AR Books, interactive technology, and creative work cases. Because there are few AR and AR Book literature and case studies related to Chinese culture, the research scope will be expanded to Asian cultures influenced by Chinese culture (mainly from Japan and South Korea).
RQ2: What kinds of possibilities are there for handheld mobile devices (mobile phones and tablets) as application displays for AR Books?
RQ2 is designed to explore how users can collaborate with AR Books based on handheld mobile devices. Through three experiments, I will answer the technical potential and operational limitations of mobile phones and tablets as device platforms. The insights and preliminary design knowledge gained from these experiments will provide technical support and data. These experiments will be used as materials to develop 3D scenes and interactive experiences for the final AR Book.
RQ3: How might Chinese traditional culture and AR technology be integrated into an interdisciplinary artifact like an AR Book?
RQ3 will demonstrate collaboration across disciplines related to narrative design, interaction mechanisms, Chinese culture, and art expression through design documentation and interactive prototypes. Based on the design experiment, the formal project opens a specific research space to create Chapter 5 of the Chinese classic A Dream of Red Mansions into an AR Book artifact. My research is based on practice, combining the documentation and reflection of theoretical and empirical work.
The design project is a new AR app to experience the magical book described in A Dream of Red Mansions — an AR Scroll ‘Jinling, Twelve Beauties of Main Register’ based on handheld devices. The paintings and poems of ‘Jinling, Twelve Beauties of Main Register’ depict the fate of the twelve girls in the Grand View Garden. However, the main character Jia Baoyu saw this book, but he was confused and unable to realize the family’s decline. If he uses modern technology, such as the AR app on a smartphone or tablet, he will comprehend the tragic fate hidden underneath the predictions. Can he save his family and twelve beauties from tragedy? Can we expect to see him be able to turn things around? In general, I combine classical Chinese literature and traditional art with AR’s “time machine” and dream-making tech to create imaginative scenes such as “Land of Illusion” and “Grand View Garden”. This fusion of ancient elements and modern technology is ultimately meant to inspire users to reflect on the fate of human beings, life and death, and the nature of the world in the context of Buddhist and Taoist philosophy. My research presents a creative paradigm for cultural AR design, combining modern technology with traditional Chinese aesthetics.
| Date of Award | 14 Jan 2026 |
|---|---|
| Original language | English |
| Awarding Institution |
|
| Supervisor | Jussi Pekka HOLOPAINEN (Supervisor), Christian SANDOR (Supervisor), MoBen BENAYOUN (Supervisor) & Alvaro CASSINELLI (Co-supervisor) |
Cite this
- Standard