In this study, we introduce ๐ฆ๐๐ฟ๐ด๐ง๐ฃ๐๐ฆ, a novel framework that enables real-time, text-promptable 3D semantic querying in surgical environments. By integrating ๐๐ถ๐๐ถ๐ผ๐ป-๐น๐ฎ๐ป๐ด๐๐ฎ๐ด๐ฒ ๐บ๐ผ๐ฑ๐ฒ๐น๐ with ๐๐ฎ๐๐๐๐ถ๐ฎ๐ป ๐ฆ๐ฝ๐น๐ฎ๐๐๐ถ๐ป๐ด ๐ฎ๐ป๐ฑ ๐๐ฒ๐บ๐ฎ๐ป๐๐ถ๐ฐ-๐ฎ๐๐ฎ๐ฟ๐ฒ ๐ฑ๐ฒ๐ณ๐ผ๐ฟ๐บ๐ฎ๐๐ถ๐ผ๐ป ๐๐ฟ๐ฎ๐ฐ๐ธ๐ถ๐ป๐ด, our method significantly improves the precision and efficiency of robotic-assisted surgery.
๐ Key Contributions:
โข First text-promptable Gaussian Splatting for 3D surgical scenes
โข Semantic-aware deformation tracking for dynamic anatomy
โข Region-aware optimization for sharper segmentation and smoother reconstruction
โข State-of-the-art results on CholecSeg8K and EndoVis18 datasets
Paving the way for smarter, safer surgical systems. Check out the full paper: https://lnkd.in/euGHFma5
Thanks and congrats to the amazing author team:
YIMING HUANG, Long Bai, Beilei Cui, Guankun Wang, Hongliang Ren (CUHK); Kun Yuan (Unistra, TUM), Nicolas Padoy (Unistra), Nassir Navab (TUM), and Mobarak I. Hoque (UCL).