D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Grounding. (arXiv:2112.01551v2 [cs.CV] UPDATED)

Recent studies on dense captioning and visual grounding in 3D have achieved
impressive results. Despite developments in both areas, the limited amount of
available 3D vision-language data causes overfitting issues for 3D visual
grounding and 3D dense captioning methods. Also, how to discriminatively
describe objects in complex 3D environments is not fully studied yet. To
address these challenges, we present D3Net, an end-to-end neural
speaker-listener architecture that can detect, describe and discriminate. Our
D3Net unifies dense captioning and visual grounding …

3d architecture arxiv captioning cv