Dr. Ren’s invited keynote speech at 2021 ICRA RoPat workshop on ‘Robot-Assisted Systems for Medical Training’

Dr. Ren was invited to give a keynote speech at the 2021 ICRA (International Conference on Robotics and Automation) RoPat workshop on ‘Robot-Assisted Systems for Medical Training’
Related webpage:
https://www.imperial.ac.uk/morph-lab/events/ropat21-icra-workshop/

Surgical motion generation and motion understanding towards augmented minimally invasive robotic procedures, Dr. Hongliang Ren

  • Abstract:

    Minimally Invasive Surgeries emerging in modern medical treatment have brought new opportunities and challenges for procedure-specific surgical motion generation and the associated motion understanding, which are the foundation of intelligent robotic manipulation and guiding interventions. Image-guided robotic surgery is expected to increase the precision, flexibility, and repeatability of surgical procedures but poses challenges for medical training.
    This talk will highlight some recent developments in dexterous robotic motion generation with motion understanding towards image-guided minimally invasive procedures. The procedure-specific telerobotic surgical systems can assist surgeons in performing dexterous manipulations using the master-slave console bilateral motion generation & mapping mechanism with variable stiffness.
    Meanwhile, surgical motion understanding aims to learn from the multi-domain surgical perceptions and describe the semantic relationship between instruments and surgical region of interest. Automatically understanding the instrument motions in robotic surgery is crucial to enhance surgical outcomes, enable surgical camera automation, and facilitate surgical training. To that end, we generate the task-aware saliency maps and scanpath of the instruments beyond tracking and segmentation, similar to the surgeon’s visual perception, to get the priority focus on selected surgical instruments. Furthermore, generating a surgical report in robot-assisted surgery, together with surgical scene understanding, can play a significant role in document entry tasks, surgical training, and post-operative analysis.

  • Workshop video material (available at the workshop webpage): https://www.youtube.com/watch?v=rPSOs_ie-ZQ 

Research Positions & PhD Scholarships on Robotics, AI, Perception

[RESEARCH AREA]
There are multiple openings for Ph.D. scholarships to perform research on Medical Robotics Perception & AI at The Chinese University of Hong Kong (CUHK). Particularly, the main areas of interest include biorobotics & intelligent systems, medical mechatronics, continuum, and soft flexible robots and sensors, multisensory perception, AI learning and control in image-guided procedures, deployable motion generation, compliance modulation/sensing, cooperative and context-aware sensors/actuators in human environments. For more details, please refer to the recent publications at Google Scholar or lab website http://labren.org/.
The prospective researchers/students will have opportunities to work with an interdisciplinary team consists of clinicians and researchers from robotics, AI & perception, imaging, and medicine.

[QUALIFICATIONS]
* Honorary Bachelor or Master Degree in Electronic and Computer Engineering (ECE), robotics, medical physics, automation, or mechatronics background
* Self-motivated and preferably with strong academic records (obtained a minimum CGPA of 3.5 out of 4.0 or equivalent)
* Outstanding academic experience (eg reputable research publications, National Scholarships) or recognitions from a top university
* You might be eligible for various Ph.D. Scholarship Schemes depending on your qualifications, so reach Prof Ren with background details
* If you already obtained a Ph.D. admission offer from a top overseas university (eg QS or THE top 50 universities) for 2021-22, you might be eligible for the Vice-Chancellor’s Ph.D. Scholarship Scheme 

[HOW TO APPLY]
Qualified candidates are invited to express their interests through an email with detailed supporting documents (including CV, transcripts, objective, research interests, education background, experiences, GPA, representative publications, demo projects), and if applicable, a copy of an offer letter from the top overseas university if available, to Prof. Hongliang Ren email: hlren@ieee.org asap.

Related websites:
Lab website: http://labren.org/
CUHK EE Ph.D. Program: http://www.ee.cuhk.edu.hk/en-gb/curriculum/mphil-phd-programme/admission
CUHK Vice-Chancellor’s Ph.D. Scholarship Scheme: https://www.gs.cuhk.edu.hk/admissions/scholarships-fees/scholarships#vcphd
CUHK HKPFS Hong Kong PhD Fellowship Scheme: monthly stipend of HK$26,600 (approx. US$3,410)

Dr. Ren invited to talk at 2021 ICEE workshop on Safeguarding Public Health During Infectious Disease Pandemics Using Medical Robotics, Wearable Technology, and AI

Dr. Ren was invited to talk at 2021 ICEE workshop on Safeguarding Public Health During Infectious Disease Pandemics Using Medical Robotics, Wearable Technology, and AI. 
Related webpages:
https://sites.google.com/ualberta.ca/2021-icee-workshop

Pilot Study of Trans-oral Robotics to Meet the Minimal Exposure Needs During Infectious Disease Pandemics, Dr. Hongliang Ren

  • Abstract: Swabbing tests have proved to be an effective method of diagnosis for a wide range of diseases. There are high risks of infection for surgeons during the face-to-face COVID-19 swab sampling due to the novel coronavirus’s infectivity. Teleoperated or self-administered swabs can mitigate potential occupational health hazards and reliance on healthcare workers during traditional swabbing procedures. We present some pilot studies on flexible transoral robotic approaches and mechanisms for swab sampling. One prospective robot comprises a flexible manipulator, an endoscope with a monitor, and a master device. A 3-prismatic-universal flexible parallel mechanism with 3 degrees of freedom (DOF) is used to realize the manipulator’s movements. The flexibility of the manipulator improves the safety of testees. Under the vision guidance from the endoscope, a master device can control the swab’s motion attached to the manipulator for sampling. We will also discuss other possible methods to apply closed kinematic chain theory to develop a self-administered viral swab to collect respiratory specimens. The proposed sensorized swab models utilizing hollow polypropylene tubes possess mechanical compliance, simple construction, and inexpensive components. These foldable telescopic structures with multiple kirigami cuts minimize components involved in the system as the characteristics are built directly into the material.

  • Reading material: Paper 1, Paper 2, Paper 3

KS Kumar, TD Nguyen, MS Kalairaj, VM Hema, CJ Cai… – Frontiers in Robotics and AI, 2021
C Li, X Gu, X Xiao, CM Lim, X Duan, H Ren – Frontiers in Robotics and AI, 2021
C Li, X Gu, X Xiao, CM Lim, H Ren – IEEE/ASME Transactions on Mechatronics, 2019

Team presentations at pre-ICRA2021

Congratulations to the following members for the papers accepted by ICRA2021 and presentations at pre-ICRA2021:

Menya Learning Domain Adaptation with Model Calibration for Surgical Report Generation in Robotic Surgery https://youtu.be/Eu-ryJ9OyTM
Godwin Chip-Less Wireless Sensing of Origami Structural Morphing under Various Mechanical Stimuli Using Home-Based Ink-Jet Printable Materials https://youtu.be/HXgW2S21OGI
Huxin Remote-Center-Of-Motion Recommendation Toward Brain Needle Intervention Using Deep Reinforcement Learning https://youtu.be/Py5Vw_hQryY
Bok Seng Origami-Inspired Snap-Through Bistability in Parallel and Curved Mechanisms through the Inflection of Degree Four Vertexes https://youtu.be/mCBPTVw5_kw
Changsheng A Miniature Manipulator with Variable Stiffness towards Minimally Invasive Transluminal Endoscopic Surgery https://youtu.be/b_zW9MHgG5g
Ruphan Multiphysics Simulation of Magnetically Actuated Robotic Origami Worms  https://youtu.be/UCkLuhoN0ME

7 papers accepted by ICRA2021 including 2 concurrently by RA-L

Congratulations to the following members for the papers accepted by ICRA2021 including 2 concurrently by RA-L:

Xiao et al Magnetically-Connected Modular Reconfigurable Mini-Robotic System with Bilateral Isokinematic Mapping and Fast On-Site Assembly towards Minimally Invasive Procedures https://youtu.be/V1N2OiN43vw (Talk)  https://youtu.be/PNneXuRXgZI (Demo)
Menya Learning Domain Adaptation with Model Calibration for Surgical Report Generation in Robotic Surgery https://youtu.be/Eu-ryJ9OyTM
Godwin Chip-Less Wireless Sensing of Origami Structural Morphing under Various Mechanical Stimuli Using Home-Based Ink-Jet Printable Materials https://youtu.be/HXgW2S21OGI
Huxin Remote-Center-Of-Motion Recommendation Toward Brain Needle Intervention Using Deep Reinforcement Learning https://youtu.be/Py5Vw_hQryY
Bok Seng Origami-Inspired Snap-Through Bistability in Parallel and Curved Mechanisms through the Inflection of Degree Four Vertexes https://youtu.be/mCBPTVw5_kw
Changsheng A Miniature Manipulator with Variable Stiffness towards Minimally Invasive Transluminal Endoscopic Surgery https://youtu.be/b_zW9MHgG5g
Ruphan Multiphysics Simulation of Magnetically Actuated Robotic Origami Worms  https://youtu.be/UCkLuhoN0ME

ICBME 2019 Special Symposium in Surgical Robotics

Themes

  • Computer-Assisted Surgery
  • Flexible Robotics and navigation in Surgery
  • Artificial Intelligence in Robotic Surgery

Date: Dec 11, 2019, EA

Speakers and Topics

1600 – 1615 Robotic Intervention Utilizing Bioengineering Based Therapeutic Methods
Ichiro Sakuma University of Tokyo
1615 – 1630 Augmented Reality for Orthopeadic Surgery
Jaesung Hong Daegu Gyeongbuk Institute of Science and Technology
1630 – 1645
Medical Robot Link Architecture Connected to Smart Cyber Operating Theater (SCOT)
Ken Masamune Tokyo Women’s Medical University
1645 – 1700
Transluminal Robotics with Delicate Continuum and Context Awareness
Hongliang Ren National University of Singapore
1700 – 1715
Robot-Assisted Interventions under Intra-Operative MRI-Based Guidance
Ka-Wai Kwok University of Hong Kong
1715 – 1730
Biomimetic Wrinkled MXene Pressure Sensors towards Collision-Aware Robots
Catherine Cai National University of Singapore


 

SAKUMA, Ichiro, University of Tokyo

  • Robotic Intervention Utilizing Bioengineering Based Therapeutic Methods
  • Biography
    Ichiro Sakuma received B.S., M.S., and Ph.D. degrees in precision machinery engineering from the University of Tokyo, Tokyo, Japan, in 1982, 1984, and 1989, respectively. He was Research Associate (1987), Associate Professor (1991) at the Department of Applied Electronic Engineering, Tokyo Denki University, Saitama, Japan. He was research instructor at Department of Surgery, Baylor College of Medicine, Houston, Texas from 1990 to 1991. He was Associate Professor at Department of Precision Engineering (1998), Associate Professor (1999) and Professor (2001), Graduate School of Frontier Sciences, the University of Tokyo. He is currently a Professor at Department of Bioengineering, Department of Precision Engineering, Director of Medical Device Development and Regulation Research Center, and Vice dean, School of Engineering, the University of Tokyo. He is the immediate past president of Japanese Society for Medical and Biological Engineering (JSMBE) (2014-2016). He is also Deputy Director for Medical Devices, Center for Product Evaluation, Pharmaceuticals and Medical Devices Agency (PMDA)His research interests includes 1) Computer Aided Surgery, 2) Medical Robotics and medical devise for minimally invasive therapy, 3) Analysis of cardiac arrhythmia phenomena and control of arrhythmia, and 4) Regulatory sciences for medical device development.He received various academic awards including, The Japan Society of Computer Aided Surgery, Best Paper Award (2006), Robotic Society of Japan, Best Paper Award (2010, 2015). In 2014, his group’s research was selected in 2014 as one of the most exciting peer-reviewed optics research to have emerged over the past 12 months by Photonics and Optics News (OSA)

 

Ken Masamune, Tokyo Women’s Medical University

  • Medical Robot Link Architecture Connected to Smart Cyber Operating Theater (SCOT)
  • Abstract
    Nowadays, several medical devices/systems including imaging machine, anesthesia, navigation system, biomonitoring devices, surgical bed, medical robots, et al., are installed in the operation room, however, it is unpleasant situation that all devices are performed in stand-alone mode, without time-synchronization, and it is difficult to combine/analyze some set of information from devices to make surgeon’s decision during surgery. To improve this situation, we’ve been developing an integrated operating room named “Smart Cyber Operating Theater (SCOT) with middleware ORiN system. In this presentation, we introduce a current SCOT project and the design concept of new open platform architecture for the integration of master/slave robotic devices and information guided robot especially for oral and maxillofacial surgery. This design will accelerate the development of any types of robotic interfaces/end effectors with fast validation.
  • Biography
    Ken Masamune received the Ph.D. degree in precision machinery engineering from the University of Tokyo, Japan, in 1999. From 1995 to 1999, he was a Research Associate in the Department of Precision Machinery Engineering, the University of Tokyo. From 2000 to 2004, he was an Assistant Professor in the Department of Biotechnology, Tokyo Denki University, Tokyo. Since 2005, he has been an Associate Professor in the Department of Mechanoinformatics, Graduate School of Information Science and Technology, the University of Tokyo. His current research interests include computer-aided surgery, especially medical robotics and visualization devices and systems for surgery.

 

Jaesung Hong, Daegu Gyeongbuk Institute of Science and Technology

  • AUGMENTED REALITY FOR SURGICAL NAVIGATION
  • Abstract
    In these days, augmented reality (AR) has become a key technology for surgical navigation. Using the AR technology, the shape of invisible organs are overlapped to the visible endoscopic or microscopic images. Therefore the surgeon can avoid damaging the healthy tissue, and reduce the incision area. In the AR-based surgery, optical tracker and camera are generally used. Optical tracker can measure the position and pose of multiple markers, and the relationship between the camera and target organs of patient can be measured in real-time by tracking of the markers which are mounted on the camera body and the patient. In the AR display, finding the relationship between the optical marker mounted on the camera body and the center of camera (camera registration) is particulary important. This relationship strongly affects the overall accuracy of AR display. In this talk, the latest AR technologies applied for the surgical navigation are introduced.
  • Biography
    Jaesung Hong is an associate professor and the Department Chair of Robotics Engineering at the Daegu Gyeongbuk Institute of Science and Technology (DGIST), South Korea. His research area is medical imaging and medical robotics for minimally invasive surgery.
    At the University of Tokyo, he has developed the world first US-guided needle insertion robot tracking a movable and deformable organ. This was reported in Physics in Medicine and Biololgy in 2004, and has been frequently cited (> 160). While he worked at Kyushu University Hospital in Japan, he developed various customized surgical navigation systems, which were clinically applied in approximately 120 surgeries. These included percutaneous ablation therapies for liver tumors, cochlear implant surgeries, neurosurgeries for gliomas, and dental implant surgeries.
    After moving to DGIST which is a research-oriented special university supported by Korean government, he developed a single port surgery robot and its master device for high force transimisson and large workspace as well as a portable, AR-based surgical navigation system, which has been tested in tibia tumor resections and orthognathic surgeries in collaboration with major Korean hospitals, including the Seoul National University Hospital of Bundang, Samsung Seoul Hospital, etc. He is one of a small number of specialists who is familiar with both engineering and clinical medicine.
    Until 2016, Prof. Hong has published approximately 42 journal papers including 30 SCI/SCIE papers with impact factors. Six of them are top 10% ranked journal papers. He also submitted or registered 15 domestic and 7 international patents. He has received 9 best paper/presentation awards, in addition to obtaining 10 research funds amounting to approximately 4.5M USD (including planned budgets).

 

Ka-Wai Kwok, University of Hong Kong

  • Robot-Assisted Interventions under Intra-Operative MRI-Based Guidance
  • Abstract
    Advanced surgical robotics has attracted significant research interest in supporting image guidance, even magnetic resonance imaging (MRI) for effective navigation of surgical instruments. In situ effective guidance of access routes to the target anatomy, rendered based on imaging data, can enable a distinct awareness of the position of robotic instrument tip relative to the target anatomy in various types of minimally invasive interventions. Therefore, such MRI-guided robots will rely on real-time processing the co-registration of surgical plan with the imaging data captured during the intervention, as well as computing the relative configuration between the instrument and the anatomy of surgical interest.
    This talk will present a compact robotic system capable to operate inside the bore of MRI scanner, as well as its solutions to technical challenges of providing a safe, effective catheter-based surgical manipulation. The proposed image processing system demonstrates its clinical potential of enhanced surgical safety by imposing visual feedback on tele-operated robotic instruments even under large-scale and rapid tissue deformations in soft tissue surgeries, such as cardiac electrophysiology and stereotactic neurosurgery. The ultimate research objective is to enable the operator to perform safe, precise and effective control of robotics instruments with the aid of pre- and intra-operative MRI models. The present work will be timely to bridge the current technical gap between MRI and surgical robotic control.
  • Biography
    Dr. Ka-Wai Kwok is currently assistant professor in Department of Mechanical Engineering, The University of Hong Kong, who completed his PhD training in The Hamlyn Centre for Robotic Surgery, Imperial College London in 2011, where he continued research on surgical robotics as a postdoctoral fellow. After then, Dr. Kwok obtained the Croucher Foundation Fellowship 2013-14, which supported his research jointly hosted by The University of Georgia, and Brigham and Women’s Hospital – Harvard Medical School. His research interests focus on surgical robotics, intra-operative medical image processing, and their uses of high-performance computing techniques. To date, he has been involved in various designs of surgical robotic devices and interfaces for endoscopy, laparoscopy, stereotactic and intra-cardiac catheter interventions. His work has also been recognized by several awards from IEEE international conferences, including ICRA’14, IROS’13 and FCCM’11. He also became the recipient of Early Career Awards 2015/16 offered by Research Grants Council (RGC) of Hong Kong.

 

Hongliang Ren, National University of Singapore, Singapore

  • Transluminal Robotics with Delicate Continuum and Context Awareness
  • Biography
    Dr. Hongliang Ren is currently an assistant professor and leading a research group on medical mechatronics in the Biomedical Engineering Department of National University of Singapore (NUS). He is an affiliated Principal Investigator for the Singapore Institute of Neurotechnology (SINAPSE) and Advanced Robotics Center at National University of Singapore. Dr. Ren received his PhD in Electronic Engineering (Specialized in Biomedical Engineering) from The Chinese University of Hong Kong (CUHK) in 2008. After his graduation, he worked as a Research Fellow in the Laboratory for Computational Sensing and Robotics (LCSR) and the Engineering Center for Computer-Integrated Surgical Systems and Technology (ERC-CISST), Department of Biomedical Engineering and Department of Computer Science, The Johns Hopkins University, Baltimore, MD, USA, from 2008 to 2010. In 2010, he joined the Pediatric Cardiac Biorobotics Lab, Department of Cardiovascular Surgery, Children’s Hospital Boston & Harvard Medical School, USA, for investigating the beating heart robotic surgery system. Prior to joining NUS, he also worked in 2012 on a collaborative computer integrated surgery project, at the Surgical Innovation Institute of Children’s National Medical Center, USA. His main areas of interest include Biomedical Mechatronics, Computer-Integrated Surgery, and Dynamic Positioning in Medicine.

 

Catherine Cai, National University of Singapore, Singapore

  • Biomimetic Wrinkled MXene Pressure Sensors towards Collision-Aware Robots
  • Abstract
    The use of surgical robots in the field of minimally invasive neurosurgical procedures can offer several benefits and advantages. However, the lack of force sensing hinders and limits their use in such procedures. Equipping surgical robots with pressure sensors can enhance robot-environment interaction by enabling collision awareness and enhance human-robot interactions by providing surgeons the necessary force feedback for safe tissue manipulation. With the emergence of soft robotics in biomedical applications, the attached pressure sensors are required to be flexible and stretchable in order to comply with the mechanically dynamic robotic movements and deformations. Inspired by the multi-dimensional wrinkles of Shar-Pei dog’s skin, we have fabricated a flexible and stretchable piezoresistive pressure sensor consisting of MXene electrodes with biomimetic topographies. This pressure sensor is found to be more sensitive in low-pressure regimes (0.934 kPa-1, <236 Pa), and less sensitive in the higher pressure regimes (0.188 kPa-1, <2070 Pa).

Seminar by Prof Wei Gao of Caltech on Skin-Interfaced Wearable Biosensors for Personalized Healthcare

A seminar on ‘Skin-Interfaced Wearable Biosensors for Personalized Healthcare’ was given by Prof. Wei Gao of Caltech.

Abstract: The rising research interest in personalized medicine promises to revolutionize traditional medical practices. This presents a tremendous opportunity for developing wearable devices toward predictive analytics and treatment. In this talk, I will introduce our recent advances in developing fully-integrated skin-interfaced flexible biosensors for non-invasive molecular analysis. Such wearable biosensors can continuously, selectively, and accurately measure a wide spectrum of sweat analytes including metabolites, electrolytes, hormones, drugs, and other small molecules. These devices also allow us to gain real-time insight into the sweat secretion and gland physiology. The clinical value of our wearable sensing platforms is evaluated through multiple human studies involving both healthy and patient populations toward physiological monitoring, disease diagnosis, and drug monitoring. These wearable and flexible devices could open the door to a wide range of personalized monitoring, diagnostic, and therapeutic applications.

Biography: Wei Gao is an Assistant Professor of Medical Engineering in Division of Engineering and Applied Science at the California Institute of Technology. He received his Ph.D. in Chemical Engineering at University of California, San Diego in 2014 as a Jacobs Fellow and HHMI International Student Research Fellow. In 2014-2017, he was a postdoctoral fellow in the Department of Electrical Engineering and Computer Sciences at the University of California, Berkeley. He is a recipient of IEEE Sensor Council Technical Achievement Award, Sensors Young Investigator Award, MIT Technology Review 35 Innovators Under 35 (TR35) and ACS Young Investigator Award (Division of Inorganic Chemistry). His research interests include wearable devices, biosensors, flexible electronics, micro/nanorobotics and nanomedicine. For more information about Gao’s research, visit www.gao.caltech.edu/.