Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motion

arXiv:2403.13327v1 Announce Type: new
Abstract: High-quality scene reconstruction and novel view synthesis based on Gaussian Splatting (3DGS) typically require steady, high-quality photographs, often impractical to capture with handheld cameras. We present a method that adapts to camera motion and allows high-quality scene reconstruction with handheld video data suffering from motion blur and rolling shutter distortion. Our approach is based on detailed modelling of the physical image formation process and utilizes velocities estimated using visual-inertial odometry (VIO). Camera poses are considered …

abstract arxiv cameras compensation cs.cv natural novel photographs quality synthesis type video view