Egocentric Activity Recognition and Localization on a 3D Map. (arXiv:2105.09544v3 [cs.CV] UPDATED)

Given a video captured from a first person perspective and the environment
context of where the video is recorded, can we recognize what the person is
doing and identify where the action occurs in the 3D space? We address this
challenging problem of jointly recognizing and localizing actions of a mobile
user on a known 3D map from egocentric videos. To this end, we propose a novel
deep probabilistic model. Our model takes the inputs of a Hierarchical
Volumetric Representation …

3d 3d map arxiv cv localization map