Robotics, Embodied AI, Navigation in vivo

NANJING, May 16, 2026 – Prof. Hongliang Ren of The Chinese University of Hong Kong attended the 38th Chinese Control and Decision Conference (CCDC 2026), which opened at the Nanjing Fengda International Hotel and featured a forum titled “Knowledge and Data-Driven Intelligent Diagnosis and Treatment“. The forum gathered leading experts in control theory, biomedical engineering, and artificial intelligence to explore how modern intelligent systems are reshaping the future of healthcare.

Chaired by Prof. Guanglin Li of the Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, the forum featured invited speakers (Profs. YT Zhang, Max QH Meng, L Meng, HL. Ren, HR. Li & Y Chen) sharing perspectives on how knowledge-driven models, data-driven methods, and intelligent control technologies can support the next generation of diagnosis, treatment, and clinical decision-making.

The forum’s central theme revolved around the integration of “knowledge-driven” and “data-driven” paradigms for intelligent diagnosis and treatment. Panelists deliberated on how cutting-edge technologies—including advanced AI theories, modern signal processing, and intelligent decision-making and feedback mechanisms—can be applied across the entire clinical workflow, ranging from model-based disease dynamic prediction and intelligent drug dosage regulation to personalized rehabilitation robots and closed-loop neuromodulation systems. This multi-disciplinary exchange aims to drive the transformation of diagnostic and therapeutic models from passive and static to active, dynamic, and closed-loop interventions.

Connecting Robotics Innovation with Intelligent Healthcare

Prof. Ren leads pioneering work in intelligent surgical robotics, soft continuum robots, and medical mechatronics, with a strong focus on translational biomedical engineering. His recent project, “Embodied Intelligence Systems for Fine Perception and Dexterous Manipulation in Flexible Endoscopy,” funded as a key national project, aims to develop perceptive, compliant, and intelligent surgical systems.

Following the talk, Prof. Ren received a Certificate of Appreciation from CCDC 2026 and was pictured with Forum Chair Prof. Guanglin Li.

Prof. Ren’s team’s developing miniature flexible robots capable of navigating narrow, tortuous lumen branches to perform multi-modal micro-biopsy and immune-sensing in the vicinity of small confined spaces.

The forum concluded with a forward-looking discussion on how the integration of AI, control theory, and robotics can address major clinical challenges, catalyze original technological breakthroughs, and provide strategic support for the development of intelligent healthcare system, bridging foundational robotics and mechatronics with clinical needs to create next-generation smart surgical systems.

On 13 May 2026, Prof. Ren Hongliang’s research group visited the Endoscopy Center at the Sixth Affiliated Hospital of Sun Yat‑sen University in Guangzhou. The visit was hosted by Prof. Hu Jiancong.

Activities

• 16:00 – 17:00: Tour of the endoscopy unit and introduction to the center’s clinical work (Prof. Hu).
• 17:00 – 18:30: Research presentations from the CUHK group in the seminar room. Prof. Ren gave an overview of the group’s recent work, followed by talks from four lab members:
  – Wu Zhijie on a vision‑language‑action model for endoscopic assistance
  – Wang Erqi on 3D intelligent perception and navigation for endoscopic ultrasound
  – Wang Guankun on multimodal models applied to continuum robotics
  – Zhou Rulin on a model‑based autonomous control system for surgery
• 18:30 – 18:45: Summary and open discussion chaired by Prof. Hu and Prof. Ren.

The visit provided an opportunity to exchange perspectives on clinical needs and technical developments in endoscopy and continuum robotics.

On Tuesday, 12 May 2026, Prof. Guangzhong Yang visited Prof. Ren Hongliang’s laboratory.

During the visit, lab members presented ongoing research through a series of demonstrations. Dr. Yang Yang, Dr. Gao Huxin, Dr. Liu Tangyou, Botao, Haoxuan, and other members showcased recent work including:

• Sub‑mm continuum robots
• Endoscopy systems
• Sensing technologies for medical applications

The visit provided an opportunity for technical exchange and discussion on future directions in medical robotics and minimally invasive devices.

Short bio of Prof. Guangzhong Yang

Prof. Guangzhong Yang received his Bachelor’s degree from Shanghai Jiao Tong University and his Ph.D. from Imperial College of Science, Technology and Medicine. He was a Principal Scientist at Royal Brompton Hospital London and later served as Lecturer, Reader, and Full Professor at Imperial College London, where he founded and directed the Hamlyn Centre for Robotic Surgery. He is currently Chair Professor and Founding Dean of the Institute of Medical Robotics at Shanghai Jiao Tong University. His research focuses on medical imaging, sensing, and robotics. He is a Fellow of the Royal Academy of Engineering, IEEE, IET, AIMBE, IAMBE, MICCAI, and CGI, a recipient of the Royal Society Research Merit Award, the Founding Editor of Science Robotics, and was awarded a CBE in the Queen’s 2017 New Year Honours for contributions to biomedical engineering.

Changsha, China, May 9, 2026 — Professor Hongliang Ren from the Department of Electronic Engineering, The Chinese University of Hong Kong, was invited to speak at High-Level Talent Forum III during the 41st Youth Academic Annual Conference of Chinese Association of Automation (YAC2026).

At High-Level Talent Forum III, Professor Ren delivered an invited presentation titled “Flexible Robots and Embodied Intelligence for Minimally Invasive Intraluminal Procedures.” His talk focused on recent advances in dexterous robotic motion generation and motion perception for image-guided minimally invasive procedures. He discussed how flexible robotic systems, multi-sensory perception, and embodied intelligence can support more precise, adaptable, and repeatable robotic intervention in confined anatomical environments.

Professor Ren’s research spans medical embodied intelligence, biomedical and surgical robotics, intelligent control, medical mechatronics, soft continuum robots, soft sensors, and multi-sensory learning for medical robotics.

About YAC

YAC is a national annual academic conference organized by the Chinese Association of Automation and its Youth Working Committee. The 2026 conference was held in Changsha from May 8 to 10, 2026, and hosted by Hunan University. It brought together researchers, young scholars, graduate students, and professionals from automation, artificial intelligence, robotics, intelligent systems, and related disciplines. The conference provided a platform for presenting recent theoretical advances, emerging technologies, and interdisciplinary research outcomes.

May 6, 2026 – The research group of Prof. Hongliang Ren was pleased to host Prof. Pierre Dupont as part of the Faculty of Engineering Distinguished Lecture series.

Prof. Dupont is a Professor of Surgery at Harvard Medical School, Chief of Pediatric Cardiac Bioengineering at Boston Children’s Hospital, and an IEEE Fellow. In his talk titled “Continuum Robotics for Minimally Invasive Interventions: Design Tradeoffs for Clinical Applications,” he presented an engineering perspective grounded in real‑world clinical challenges.

Prof. Dupont discussed three complementary continuum robot architectures – concentric tube robots, magnetic ball chains, and tendon‑actuated systems – each involving distinct tradeoffs in stiffness, steerability, force capability, and hysteresis.

Key highlights from the lecture:

• Concentric tube robots enable precise intracardiac catheterization and bimanual neuroendoscopy.
• Magnetic ball chains offer outstanding steerability for cardiac ablation procedures.
• Tendon‑actuated systems provide a balanced tradeoff between stiffness and dexterity for transcatheter heart valve repair.

The lecture illustrated how tailoring robotic designs to specific clinical constraints can meaningfully expand the capabilities of minimally invasive interventions.

Short bio of Prof. Pierre Dupont

Prof. Dupont received his B.S., M.S., and Ph.D. in Mechanical Engineering from Rensselaer Polytechnic Institute. He was a Postdoctoral Fellow at Harvard University, later a Professor of Mechanical and Biomedical Engineering at Boston University, and is now Chief of Pediatric Cardiac Bioengineering at Boston Children’s Hospital and Professor of Surgery at Harvard Medical School. He is an IEEE Fellow, a former Senior Editor for IEEE Transactions on Robotics, and a member of the Advisory Board for Science Robotics.

Audience engagement

The lecture attracted faculty members and students from engineering and medical backgrounds, followed by a lively Q&A session. Attendees appreciated Prof. Dupont’s clinically driven approach to robotic design, and the discussion continued informally after the talk.

🤖🪢
Thrilled to share our latest work published on Nature Communication, which redefines actuation for tendon-driven continuum robots — achieving full 3D omnidirectional motion and body twist using only a single tendon.

🧠✨ What we developed: A new class of continuum robots that:
🔹 Breaks Design Constraints: Eliminates the inherent trade-off between miniaturization and 3D manipulability by replacing multiple tendons with a single eccentric one.
🔹 Push-Pull-Twist Actuation: Achieves complex spatial movement through a unique driving mechanism.
🔹 High Efficiency: Features an outer diameter of 2.0–3.5 mm with a hollow ratio exceeding 57% — doubling the spatial utilization of traditional designs.
🔹 Open-Source Support: Includes a derived kinematics model and an open-source simulator for the robotics community.

🎯 Key Results:

• ✅ >1,000-fold Improvement: Massive increase in manipulability compared to conventional multi-tendon mechanisms.
• ✅ High Force Retention: Retains at least 70% of tip force across all directions.
• ✅ Versatile Demonstration: Proven success in teleoperation, navigation through tortuous environments, and “chopstick-like” continuum grippers.

💡 Why it matters: This work proves that miniature robots can maintain high dexterity and power without the bulk of traditional hardware, pointing toward the next generation of surgical actuators.

🌱 What’s next? We are exploring potential medical applications and the integration of these actuators into complex surgical procedures.

Thrilled to share our latest international collaboration! At NVIDIA GTC 2026 in San Jose, CA, the team led by Professor Hongliang Ren from The Chinese University of Hong Kong (CUHK), in partnership with NVIDIA and 35 leading global institutions, officially released Open-H-Embodiment, the world’s first and largest open-source dataset for medical robotics, now available on HuggingFace.

During the GTC keynote, Kimberly Powell, NVIDIA’s VP of Healthcare, highlighted this milestone. Our lab is honored to be a primary contributor, filling the critical gap in Embodied AI for medical robotics by providing high-fidelity data for contact dynamics and closed-loop control.

🧠✨ What we contributed & developed:

This project breaks the “perception-heavy, execution-light” limitation of traditional medical AI. Key highlights include:

🔹 778 Hours of Massive Multimodal Data: The dataset covers 400 complete clinical surgeries and 9 major robotic platforms (e.g., dVRK, CMR Versius, Kuka). It includes 65% clinical data, 23% bench-top experiments, and 12% simulation data.

🔹 Three High-Value Specialized Datasets from Our Lab:

• Dual-Source Ultrasound Dataset: Experts-level trajectories covering in-vivo porcine EUS and human forearm scanning, overcoming complex organ environments and multi-device calibration.
• Robotic Surgery Skill Dataset: Multi-modal data (RGB/RGB-D + Kinematics) for tissue manipulation and suturing, featuring millisecond-level synchronization and dual-mode control (teleoperation & automation).
• Flexible Endoscope Tracking Baseline: A standardized dataset addressing hysteresis and deformation in flexible endoscopy, supporting nanosecond-level time synchronization.

🔹 Surgical VLA & World Models:

• GR00T-H: A 3B-parameter Vision-Language-Action model based on NVIDIA Isaac GR00T, capable of long-horizon dexterous tasks like end-to-end suturing.
• Cosmos-H-Surgical-Simulator: An action-conditioned world model that boosts simulation efficiency by over 70x, bridging the sim-to-real gap.

🎯 Key Results: ✅ Global Standardization: First effort to unify medical robotic data across different devices and institutions under CC-BY-4.0. ✅ Efficiency Boost: Accelerated surgical simulation (600 sims in 40 mins) to generate high-fidelity video-action pairs. ✅ Clinical Relevance: Successfully captured nearly 500 hours of real-world clinical data for hernia, gallbladder, and uterine surgeries.

💡 Why it matters: This initiative provides the foundational “bedrock” for Medical Physical AI. By sharing high-quality, synchronized data for surgery, ultrasound, and endoscopy, we are lowering the barrier for researchers worldwide to develop autonomous surgical agents that are both explainable and adaptive.

🌱 What’s next? Our lab is continuing to deepen research in: 🔹 Reasoning-based autonomous control for surgical robots. 🔹 Cross-platform generalization of Medical VLA models. 🔹 Clinical translation of Embodied AI to improve patient outcomes.

Datasets address: https://huggingface.co/datasets/nvidia/PhysicalAI-Robotics-Open-H-Embodiment

Project website: https://github.com/open-h

#NVIDIAGTC2026 #MedicalRobotics #EmbodiedAI #HuggingFace #CUHK #OpenSource #HealthcareInnovation

Thrilled to share our latest #𝗦𝗰𝗶𝗲𝗻𝗰𝗲𝗔𝗱𝘃𝗮𝗻𝗰𝗲 work on a 𝗰𝗲𝗻𝘁𝗶𝗺𝗲𝘁𝗲𝗿-𝘀𝗰𝗮𝗹𝗲, 𝗳𝘂𝗹𝗹𝘆 𝘀𝗲𝗮𝗹𝗲𝗱, 𝗹𝗲𝗴𝗹𝗲𝘀𝘀 𝗮𝗺𝗽𝗵𝗶𝗯𝗶𝗼𝘂𝘀 𝗿𝗼𝗯𝗼𝘁 that can crawl on sand, jump, and steerably swim – powered by a 𝘀𝗶𝗻𝗴𝗹𝗲 𝘃𝗮𝗿𝗶𝗮𝗯𝗹𝗲-𝗼𝘂𝘁𝗽𝘂𝘁 𝘃𝗼𝗶𝗰𝗲-𝗰𝗼𝗶𝗹 𝗺𝗼𝘁𝗼𝗿 (𝗩𝗖𝗠).

At small scales, reliable 𝘸𝘢𝘵𝘦𝘳𝘱𝘳𝘰𝘰𝘧 𝘴𝘦𝘢𝘭𝘪𝘯𝘨 is tough: transmissions and active mechanisms mean moving parts and dynamic seals that are fragile and 𝘭𝘦𝘢𝘬-𝘱𝘳𝘰𝘯𝘦. We wanted an amphibious robot that stays sealed and robust – yet still supports multiple locomotion modes.

🧠✨ 𝗪𝗵𝗮𝘁 𝘄𝗲 𝗱𝗲𝘃𝗲𝗹𝗼𝗽𝗲𝗱:

An 𝗶𝗻𝗲𝗿𝘁𝗶𝗮-𝗱𝗿𝗶𝘃𝗲𝗻 𝗮𝗰𝘁𝘂𝗮𝘁𝗶𝗼𝗻 + 𝗽𝗮𝘀𝘀𝗶𝘃𝗲 𝗽𝗿𝗼𝗽𝘂𝗹𝘀𝗶𝗼𝗻 𝗱𝗲𝘀𝗶𝗴𝗻 that:

🔹 Uses a variable-output VCM inside a fully sealed rigid shell (no external moving parts)

🔹 Switches among three modes: jumping, full-stroke vibration (land), and small-stroke vibration (water)

🔹 Uses asymmetric, tilted passive fins for frequency-tuned steering in water (IDMP)

🔹 Explains hydrodynamics via aquatic tests, high-speed PIV, and CFD

All of this – 𝗼𝗻𝗲 𝗺𝗮𝗶𝗻 𝗹𝗶𝗻𝗲𝗮𝗿 𝗮𝗰𝘁𝘂𝗮𝘁𝗼𝗿 + 𝗽𝗮𝘀𝘀𝗶𝘃𝗲 𝗳𝗶𝗻𝘀. No exposed legs, gears, or propellers – making sealing and durability much easier at the centimeter scale.

🎯 𝗞𝗲𝘆 𝗥𝗲𝘀𝘂𝗹𝘁𝘀:

✅ 24-g prototype (57.5 × 36 × 36 mm) with a fully enclosed shell

✅ ~1.4 BL/s (~78 mm/s) on dry sand; 41.6 mm/s on flat ground

✅ Jump height up to 17.16 mm at 15 V; continuous “tumbler” jumping

✅ Load carrying: 960 g (~40× body weight) and escape under 5-kg loads

✅ In water: min turning radius 5.6 mm; straight swim at 35/44/60 Hz (~32/35/28 mm/s); peak yaw -22°/s (30 Hz) or 16°/s (40 Hz)

💡 𝗪𝗵𝘆 𝗶𝘁 𝗺𝗮𝘁𝘁𝗲𝗿𝘀:

This work shows how inertia + mode-switchable actuation can bridge the 𝗺𝗼𝗺𝗲𝗻𝘁𝘂𝗺-𝗳𝗿𝗲𝗾𝘂𝗲𝗻𝗰𝘆 𝘁𝗿𝗮𝗱𝗲-𝗼𝗳𝗳, enabling jumping and swimming in the same tiny robot. Passive asymmetric fins turn simple reciprocation into steerable thrust – 𝘄𝗶𝘁𝗵 𝗻𝗼 𝗮𝗱𝗱𝗲𝗱 𝗮𝗰𝘁𝘂𝗮𝘁𝗼𝗿𝘀.

🌱 𝗪𝗵𝗮𝘁’𝘀 𝗻𝗲𝘅𝘁?

Future work will focus on improving environmental adaptability via 𝘧𝘦𝘦𝘥𝘣𝘢𝘤𝘬 𝘤𝘰𝘯𝘵𝘳𝘰𝘭 and adaptive structures, and optimizing energy efficiency + onboard power 𝘮𝘪𝘯𝘪𝘢𝘵𝘶𝘳𝘪𝘻𝘢𝘵𝘪𝘰𝘯.

Special shoutout to the team –

Lingqi Tang, Yongzun Yang (co-first authors), Bing Li, Bingfu Zhang, Qiguang He, Hongliang Ren, Yao Li – for making this project possible.

🔗 Paper link: https://lnkd.in/gFDfZYKq

🔖 #ScienceAdvances #Robotics #AmphibiousRobots #Microrobots #InertiaDriven #Locomotion #VCM #PIV #CFD

🏥 Accurate visualization of subtle vascular dynamics remains a significant challenge in minimally invasive surgery, where dynamic complexities often limit decision-making reliability. Our paper introduces 𝗘𝗻𝗱𝗼𝗖𝗼𝗻𝘁𝗿𝗼𝗹𝗠𝗮𝗴, a framework designed to 𝗲𝗻𝗵𝗮𝗻𝗰𝗲 𝘃𝗮𝘀𝗰𝘂𝗹𝗮𝗿 𝗺𝗼𝘁𝗶𝗼𝗻 𝘃𝗶𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝘆 in endoscopic videos while preserving surrounding tissue structure. The approach integrates 𝗣𝗲𝗿𝗶𝗼𝗱𝗶𝗰 𝗥𝗲𝗳𝗲𝗿𝗲𝗻𝗰𝗲 𝗥𝗲𝘀𝗲𝘁𝘁𝗶𝗻𝗴 to minimize error accumulation over time and 𝗛𝗶𝗲𝗿𝗮𝗿𝗰𝗵𝗶𝗰𝗮𝗹 𝗧𝗶𝘀𝘀𝘂𝗲-𝗮𝘄𝗮𝗿𝗲 𝗠𝗮𝗴𝗻𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻 for adaptive vessel tracking.

📊 To validate robustness, we constructed 𝗘𝗻𝗱𝗼𝗩𝗠𝗠𝟮𝟰, a benchmark dataset spanning four surgical specialties and diverse intraoperative scenarios. Quantitative metrics and expert surgeon evaluations indicate improved magnification accuracy and image quality compared to existing methods.

🤝 We extend our sincere gratitude to our collaborators across The Chinese University of Hong Kong (An Wang, Mengya Xu, Yiting Chang, Prof Hongliang Ren), The University of Hong Kong (Rulin Zhou), Southern Medical University (苟龙飞, Prof Hao Chen), The First Affiliated Hospital of Wenzhou Medical University (Yiru Ye), Southern University of Science and

Technology (Prof Jiankun Wang), and Singapore General Hospital (Prof Chwee Ming Lim) for their invaluable contributions to this multidisciplinary work.

The paper is available at https://lnkd.in/ggPEFswF

#MotionMagnification #SurgicalAI #Endoscopy

Thrilled to share our latest work, 𝐆𝐞𝐨𝐋𝐚𝐧𝐆, a unified geometry-aware framework for language-guided robotic grasping.

Language-guided grasping is a key capability for intuitive human–robot interaction. A robot should not only detect objects but also understand natural instructions such as “pick up the blue cup behind the bowl.” While recent multimodal models have shown promising results, most existing approaches rely on multi-stage pipelines that loosely couple perception and grasp prediction. These methods often overlook the tight integration of geometry, language, and visual reasoning, making them fragile in cluttered, occluded, or low-texture environments. This motivated us to bridge the gap between semantic language understanding and precise geometric grasp execution.

🧠✨ 𝐖𝐡𝐚𝐭 𝐰𝐞 𝐝𝐞𝐯𝐞𝐥𝐨𝐩𝐞𝐝:

A novel unified framework for geometry-aware language-guided grasping that includes:

🔹 Unified RGB-D Multimodal Representation:

 We embed RGB, depth, and language features into a shared representation space, enabling consistent cross-modal semantic alignment for accurate target reasoning.

🔹 Depth-Guided Geometric Module (DGGM):

 Instead of treating depth as auxiliary input, we explicitly inject geometric priors derived from depth into the attention mechanism, strengthening object discrimination under occlusion and ambiguous visual conditions.

🔹 Adaptive Dense Channel Integration (ADCI):

 A dynamic multi-layer fusion strategy that balances global semantic cues and fine-grained geometric details for robust grasp prediction.

🎯  𝐊𝐞𝐲 𝐑𝐞𝐬𝐮𝐥𝐭𝐬:

✅ GeoLanG significantly outperforms prior multi-stage baselines on OCID-VLG for language-guided grasping.

✅ Demonstrates strong robustness in cluttered and heavily occluded scenes.

✅ Successfully validated on real robotic hardware, showing reliable sim-to-real transfer.

💡 𝐖𝐡𝐲 𝐢𝐭 𝐦𝐚𝐭𝐭𝐞𝐫𝐬:

This work shows that tightly coupling geometric reasoning with multimodal language understanding can significantly enhance robotic grasp reliability. By embedding depth-aware geometric priors directly into attention mechanisms, we reduce ambiguity and improve consistency in grasp decision-making.

GeoLanG provides a pathway toward more intelligent robotic systems that understand not just what object to grasp, but also how to grasp it robustly in complex real-world environments.

🌱 𝐖𝐡𝐚𝐭’𝐬 𝐧𝐞𝐱𝐭?

We are exploring extending this geometry-aware multimodal reasoning toward:

 🔹 Real-time interactive grasping

 🔹 Multi-step manipulation tasks

 🔹 Integration with motion planning and autonomous robotic control

#ICRA2026 #CUHK