An immersive micro-manipulation system using real-time 3D imaging microscope and 3D operation interface for high-speed and accurate micro-manipulation

Intracytoplasmic sperm injection (ICSI) is a critical assisted reproductive technique that currently requires highly skilled embryologists to operate micromanipulators using 2D optical microscopes and joysticks. This setup is challenging because it lacks depth perception and requires complex coordination. The authors sought to determine if an immersive virtual reality (VR) system—combining real-time 3D imaging and 3D input interfaces—could allow novice users to perform micromanipulation tasks with higher speed and accuracy than traditional methods.

The researchers developed an immersive system consisting of an inverted microscope equipped with an electrically tunable lens for real-time 3D imaging, a head-mounted display (HMD) for visualization, and two types of 3D input devices: a stationary pen-type interface and a wearable glove-type interface. The system maps the operator’s hand movements in a virtual space to the actual micromanipulator, allowing for intuitive 3D control. They evaluated the system through two experiments: a speed test (orbiting a microbead) and an accuracy test (touching the center of a microbead), comparing six combinations of display (2D vs. 3D) and interface (joystick, pen, or glove) against a skilled operator using a conventional setup.

The study found that the combination of 3D imaging and 3D operation interfaces significantly outperformed conventional 2D joystick methods. Specifically, the immersive system allowed novice subjects to achieve higher operation speeds and greater precision than the skilled operator using the traditional setup. Among the 3D interfaces, the wearable glove-type interface generally provided the highest performance for most subjects, suggesting that immersive VR can effectively lower the barrier to entry for complex micromanipulation tasks.

This research demonstrates that immersive teleoperation can overcome the limitations of traditional 2D microscopy in micro-scale tasks. By providing intuitive depth perception and natural 3D control, such systems could potentially address the shortage of skilled embryologists and improve the consistency of delicate procedures like ICSI.