Overview Outcomes and Publications Prototypes Team Media

PAINTER

Procedurally Assisted INTErchangeable Reality

POCI-01-0145-FEDER-030740 – PTDC/CCI-COM/30740/2017

With the democratization of the use of virtual and augmented reality devices a totally new way of creating and visualizing 3D environments has emerged. This presents a challenge for media content providers, to game developers, to technology mediated industry and multimedia consumers in general.

This project will design and implement a framework for the assisted creation and edition of virtual environments to be used collaboratively in Virtual Reality (VR) and Augmented Reality (AR). The objective is to explore new interaction paradigms for editing content inside VR with the assistance of AR markers and procedural content generated algorithms.

The main solution will be based in a central virtual simulation system capable of accepting connections with several AR-VR headsets, smartphones and interaction devices. This framework will be divided in three modules:

  1. Content edition in VR: allow to invert the 3D creation process by bringing the user to the virtual world and allowing him to retouch in-loco the virtual objects.
  2. Interaction between VR and AR: allow additional users to collaborate in the creation process and to map real world objects to virtual world actions.
  3. Procedural generation: automatic content from external free sources will speed up the creation process of 3D scenes in VR.

The development of this framework will be important for the creation process of virtual environments and for the interaction in AR between real and virtual scenarios. To evaluate the framework a demonstrator will be created in the laboratory. Additionally, two use cases, one in an industrial environment, and other in a tourism location will showcase its features.

Acknowledgements

This work is financed by the ERDF – European Regional Development Fund through the Operational Programme for Competitiveness and Internationalisation – COMPETE 2020 Programme and by National Funds through the Portuguese funding agency, FCT – Fundação para a Ciência e a Tecnologia within project POCI-01-0145-FEDER-030740 – PTDC/CCI-COM/30740/2017