Full Body Video-Based Self-Avatars for Mixed Reality: from E2E System to User Study. (arXiv:2208.12639v1 [cs.CV])

In this work we explore the creation of self-avatars through video
pass-through in Mixed Reality (MR) applications. We present our end-to-end
system, including: custom MR video pass-through implementation on a commercial
head mounted display (HMD), our deep learning-based real-time egocentric body
segmentation algorithm, and our optimized offloading architecture, to
communicate the segmentation server with the HMD. To validate this technology,
we designed an immersive VR experience where the user has to walk through a
narrow tiles path over an active …

arxiv avatars cv mixed reality study video