In this study, we introduce 𝗦𝘂𝗿𝗴𝗧𝗣𝗚𝗦, a novel framework that enables real-time, text-promptable 3D semantic querying in surgical environments. By integrating 𝘃𝗶𝘀𝗶𝗼𝗻-𝗹𝗮𝗻𝗴𝘂𝗮𝗴𝗲 𝗺𝗼𝗱𝗲𝗹𝘀 with 𝗚𝗮𝘂𝘀𝘀𝗶𝗮𝗻 𝗦𝗽𝗹𝗮𝘁𝘁𝗶𝗻𝗴 𝗮𝗻𝗱 𝘀𝗲𝗺𝗮𝗻𝘁𝗶𝗰-𝗮𝘄𝗮𝗿𝗲 𝗱𝗲𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻 𝘁𝗿𝗮𝗰𝗸𝗶𝗻𝗴, our method significantly improves the precision and efficiency of robotic-assisted surgery.
📌 Key Contributions:
• First text-promptable Gaussian Splatting for 3D surgical scenes
• Semantic-aware deformation tracking for dynamic anatomy
• Region-aware optimization for sharper segmentation and smoother reconstruction
• State-of-the-art results on CholecSeg8K and EndoVis18 datasets
Paving the way for smarter, safer surgical systems. Check out the full paper: https://lnkd.in/euGHFma5
Thanks and congrats to the amazing author team:
YIMING HUANG, Long Bai, Beilei Cui, Guankun Wang, Hongliang Ren (CUHK); Kun Yuan (Unistra, TUM), Nicolas Padoy (Unistra), Nassir Navab (TUM), and Mobarak I. Hoque (UCL).