Microsoft demonstrated the platformMesh, which allows a group of people to see holographic projections of each other and remotely interact with virtual objects through various mixed reality devices.
An Azure cloud-based project createsthe feeling of the presence of all conference participants in one room. This is achieved through the technology of halographic teleportation of user avatars and tools for group interaction with projected three-dimensional objects, as in the physical world. In the future, avatars will be replaced with realistic holo-projections of people.
Microsoft Mesh system tracks eye movementsand hands for the correct display of information and manipulation of virtual objects. It is also equipped with several AI models to enhance image quality.
In the near future the company will offerdevelopers a set of tools for creating original avatars, spatial rendering, session management and synchronization of actions of multiple users. A demo of the Mesh app is already available for use on HoloLens and the social platform AltspaceVR.
We also encourage you to learn about other innovative user interfaces that will change the future of work.
text: Ilya Bauer, photo and video: Microsoft