Multimodal Sense-Informed Prediction of 3D Human Motions

arXiv:2405.02911v1 Announce Type: new
Abstract: Predicting future human pose is a fundamental application for machine intelligence, which drives robots to plan their behavior and paths ahead of time to seamlessly accomplish human-robot collaboration in real-world 3D scenarios. Despite encouraging results, existing approaches rarely consider the effects of the external scene on the motion sequence, leading to pronounced artifacts and physical implausibilities in the predictions. To address this limitation, this work introduces a novel multi-modal sense-informed motion prediction approach, which conditions …

abstract application arxiv behavior collaboration cs.cv effects fundamental future future human human intelligence machine machine intelligence multimodal prediction results robot robots sense type world