Team presentations and award at ICRA2023

Congratulations to the following members for the papers accepted by ICRA2023 and presentations atย  ICRA2023:

Surgical-VQLA: transformer with gated vision-language embedding for visual question localized-answering in robotic surgery

L Bai, M Islam, L Seenivasan, H Ren*

arXiv preprint arXiv:2305.11692, ICRA 2023

Rethinking Feature Extraction: Gradient-Based Localized Feature Extraction for End-To-End Surgical Downstream Tasks

W Pang, M Islam, S Mitheran, L Seenivasan, M Xu, H Ren
IEEE Robotics and Automation Letters 7 (4), 12623-12630
Congratulations on the excellent work done and poster award in ICRA workshop New Evolutions in Surgical Robotics: Embracing Multimodal Imaging Guidance, Intelligence, and Bio-inspired Mechanisms held at ICRA 2023.
  • Domain Adaptive Sim-to-Real Segmentation of Oropharyngeal Organs Towards Robot-assisted Intubation, Guankun Wang, Tian-Ao Ren, Jiewen Lai, Long Bai, and Hongliang Ren
  • Relational Reasoning in VQA Models for Visual Question Answering in Robotic Surgery, Lalithkumar and Hongliang Ren

Team award at 48th International Exhibition of Inventions Geneva

Our Team (Ruoyi, Jiewen, et al..) project Vision-guided Fiberoptic Nasotracheal Intubation Robot won Silver Medal, at the 48th International Exhibition of Inventions Geneva,  in April 2023!

The project was also showcased at

  • 2023, June, Interview with TVB New Technology Health Informationๆ–ฐ็ง‘ๆŠ€ๅฅๅบท่ณ‡่จŠ for Intubation Robot
  • 2023, Hong Kong Convention and Exhibition Centre, HKTDC Hong Kong International Medical and Healthcare Fair, 16-18 May

Dr Ren Won Healthy Longevity Catalyst Award 2022

Dr. Ren won the Healthy Longevity Catalyst Award (Hong Kong) 2022 with research on intragastric balloons.

More information can be found at:

https://healthylongevitychallenge.org/winners/swallowable-encapsuled-multi-stable-intragastric-balloons-for-obesity-treatment-semibot/

CUHK bags three wins at Healthy Longevity Catalyst Awards (Hong Kong) 2022

CUHK bags three wins at Healthy Longevity Catalyst Awards (Hong Kong) 2022 Scholars from The Chinese University of Hong Kong (CUHK) won three awards at the Healthy Longevity Catalyst Awards (Hong Kong) 2022.

3 papers accepted by MICCAI2022

Congratulations to the following members for the papers accepted by MICCAI2022:

  • An et al Rethinking Surgical Instrument Segmentation: A Background Image Can Be All You Need
  • Lalith et al Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformer
  • Mengya et al Rethinking Surgical Captioning: End-to-End Window-Based MLP Transformer Using Patches

 

Team awards at The 8th Hong Kong University Student Innovation and Entrepreneurship Competition

Our Team projects Modular Parallel Robot and Magnetic Capsule won awards at The 8th Hong Kong University Student Innovation and Entrepreneurship Competition, organized by Hong Kong New Generation Cultural Association, on May 27-28, 2022!

Third-place Award: Magnetic Capsule, Presented by Sishen
Merit Award: Modular Parallel Robot, Presented by Wenchao

 

Team presentations at ICRA2022

Congratulations to the following members for the 3 papers accepted by ICRA2022 and presentations at  ICRA2022:

Godwin: Chip-Less Real-Time Wireless Sensing of Endotracheal Intubation Tubes by Printing and Mounting Conformable Antenna Tag 

Lalith: Global-Reasoned Multi-Task Learning Model for Surgical Scene Understanding

Ling: SIRNet: Fine-Grained Surgical Interaction Recognition

Godwin and Lalith are presenting at ICRA on site this year:
https://www.icra2022.org/

Dr. Ren invited to talk at 2021 ISMR workshops

Dr. Ren was invited to give 2 talks at 2021 ISMR (International Symposium on Medical Robotics) workshops

Talk 1: “Flexible Endoluminal Robotics with Minimal Invasiveness and Exposure” for workshop on “Model-based Design, Sensing, and Control of Continuum
Manipulators and Robotic Flexible Instruments

Talk 2: “Multidimensional Sensing and Perception for Dexterous Medical Robotics” for workshop on “Sensing and Feedback in Dexterous Medical/Surgical Robotics” respectively:

Related webpages: http://www.ismr.gatech.edu/workshop-program

 

Dr. Ren’s invited keynote speech at 2021 ICRA RoPat workshop on โ€˜Robot-Assisted Systems for Medical Trainingโ€™

Dr. Ren was invited to give a keynote speech at the 2021 ICRA (International Conference on Robotics and Automation) RoPat workshop on โ€˜Robot-Assisted Systems for Medical Trainingโ€™
Related webpage:
https://www.imperial.ac.uk/morph-lab/events/ropat21-icra-workshop/

Surgical motion generation and motion understanding towards augmented minimally invasive robotic procedures, Dr. Hongliang Ren

  • Abstract:

    Minimally Invasive Surgeries emerging in modern medical treatment have brought new opportunities and challenges for procedure-specific surgical motion generation and the associated motion understanding, which are the foundation of intelligent robotic manipulation and guiding interventions. Image-guided robotic surgery is expected to increase the precision, flexibility, and repeatability of surgical procedures but poses challenges for medical training.
    This talk will highlight some recent developments in dexterous robotic motion generation with motion understanding towards image-guided minimally invasive procedures. The procedure-specific telerobotic surgical systems can assist surgeons in performing dexterous manipulations using the master-slave console bilateral motion generation & mapping mechanism with variable stiffness.
    Meanwhile, surgical motion understanding aims to learn from the multi-domain surgical perceptions and describe the semantic relationship between instruments and surgical region of interest. Automatically understanding the instrument motions in robotic surgery is crucial to enhance surgical outcomes, enable surgical camera automation, and facilitate surgical training. To that end, we generate the task-aware saliency maps and scanpath of the instruments beyond tracking and segmentation, similar to the surgeonโ€™s visual perception, to get the priority focus on selected surgical instruments. Furthermore, generating a surgical report in robot-assisted surgery, together with surgical scene understanding, can play a significant role in document entry tasks, surgical training, and post-operative analysis.

  • Workshop video material (available at the workshop webpage): https://www.youtube.com/watch?v=rPSOs_ie-ZQ