Virtual co-presence for real-time communication

Mr. Zaher Joukhadar1

1The University Of Melbourne, Melbourne, Australia

In this project we explore the emerging opportunities offered by rapidly evolving virtual, augmented, and mixed reality technologies (AR/VR) to create the next era in remote telepresence communications.

Recent advances in depth sensing technology and 3D capturing devices mean we are now able to design and create ways to ‘teleport’ collaborators into each other’s environments to enable an immersive sense of being in each other’s presence. We call this ‘virtual co-presence’.

Our project aims to create a digital platform that captures volumetric videos of people and environments and then renders the data in real-time as a volumetric hologram. Using a motion capture device, the hologram is then projected into another location enabling users to “see” each other in their own environment with the use of an AR headset (such as Magic Leap or Hololens).

The depth sensing and motion capture devices now available commercially can rapidly produce large volumes of data. The project uses an array of Azure Kinects cameras which results in large amount of data generated and rendered approximately 280 MB per second). In order to deal with this huge volume of raw data, we need to develop new computational methods to process, store, and replay the data.


Biography:

Zaher Joukhadar is research data specialist and lead software engineer. He has joint position at the School of Computing and Information Systems (CIS) and Melbourne Data Analytics Platform (MDAP). At MDAP he focuses on supporting research in video and image analysis. At CIS, Zaher lead software development and manage the HCI Lab within the Interaction Design Lab (IDL) group.

ABOUT AeRO

AeRO is the industry association focused on eResearch in Australasia. We play a critical coordination role for our members, who are actively transforming research via Information Technology. Organisations join AeRO to advance their own capabilities and services, to collaborate and to network with peers. AeRO believes researchers and the sector significantly benefit from greater communication, coordination and sharing among the increasingly different and evolving service providers.