Different Layers of Reality. A Retrospective Evaluation on diverse possibilities for digitally preserving memories of the Yunnan Garden as an Immersive Experience

This paper offers an in-depth evaluation and future outlook of the representation of Singapore’s Yunnan Garden, with a central focus on various methods to create an immersive experience. The methods explored include 360-degree video, photogrammetric capture, and detailed photorealistic VR reconstruction. We critically assess their effectiveness and potential in the preservation of cultural and natural heritage in the digital world. The incorporation of interactive elements and the inclusion of motion capture of performers are also thoroughly examined. Challenges faced during implementation are discussed and solutions proposed for future attempts. The paper concludes with an exploration of the current approach to working with Gaussian Splatting as a future outlook. The research goes beyond the objective of preservation by reconstructing the former garden into a virtual cultural heritage application. It delves into diverse narrative and aesthetic experiments, aiming to create artistic interpretations that engage the audience. This endeavour challenged the project team to explore novel visual and aural forms of representation.