Flexible Spatial Augmented Reality

Project: Research

View graph of relations


Spatial Augmented Reality (SAR) is the use of projected light to alter the appearance of physical objects. In the last twenty years, SAR has been explored in multiple form factors, and uses. (Bimber and Raskar, 1998) Lately, its simplified commercial form, known as Projection Mapping, has become very popular. (Benko et al., 2014)Interactive SAR has also been explored, and different techniques offering single and multiuser interaction have been proposed. (Benko et al., 2014) However, these projects usually attempt to re-create existing forms of human-computer interaction in a SAR environment, not being able of taking advantage of the complexity and expressiveness of the new medium (Steimle et al., 2013). Existing proposals usually assume that the augmented objects are static, while being able to physically alter the projected surfaces can drastically expand the design possibilities.Arts-inflected research has proved being very successful in creating design alternatives, with artists contributing at keeping things culturally relevant while offering original cognitive approaches. (Brand, 1993) The project proposes using art-infused research to explore new SAR systems that incorporate mutable and unfixed geometry. These systems will be based on flexible and on unfixed screens (starting with elastic screens and screens mounted on drones), and will explore alternative data visualization and interaction designs.Spatial Augmented Reality systems are capable of radically affecting its users’ environment. What are the design strategies that permit a better understanding of the possibilities of augmented environments? What are their aesthetic possibilities and constrains?Adopting a user-centred design (UCD) approach we will examine existing SAR designs identifying their strengths. Selected strategies will be expanded by incorporating mutable geometry, and the results will be tested with small groups of representative users. UCD will allow us to involve users in the design and research processes and to iterate on the proposed interaction designs, ensuring the reliability and reproducibility of the project’s findings. The results will help significantly in the creation of new systems that fully integrate augmented space as a fundamental component. We expect the project to contribute to the current debate about interaction, augmented reality, and new media art, as well as to impact on the industry, specifically on the design of immersive spaces and novel human-computer interaction techniques.The published results, artworks, and videos will be published in the leading international conferences (such as SIGGRAPH, TEI, ISEA), and journals (such as Leonardo, TOCHI,IJMMS).


Project number9042456
Grant typeGRF
Effective start/end date1/01/1726/06/20

    Research areas

  • Spatial Augmented Reality , Interactive Art , Human Computer Interaction , New media art , Data Visualization