Efficient Data-driven Scene Simulation using Robotic Surgery Videos via Physics-embedded 3D Gaussians

arXiv:2405.00956v1 Announce Type: cross
Abstract: Surgical scene simulation plays a crucial role in surgical education and simulator-based robot learning. Traditional approaches for creating these environments with surgical scene involve a labor-intensive process where designers hand-craft tissues models with textures and geometries for soft body simulations. This manual approach is not only time-consuming but also limited in the scalability and realism. In contrast, data-driven simulation offers a compelling alternative. It has the potential to automatically reconstruct 3D surgical scenes from real-world …

abstract arxiv craft cs.cv cs.gr cs.ro data data-driven designers education embedded environments labor physics process robot robotic robotic surgery role simulation simulations simulator surgery type via videos