A VR surgical training platform with hyper-realistic simulations uses full-body tracking and tactile feedback for maximum immersion. It integrates software and hardware to enable collaborative surgeries and tool skills training.
Industry:
Services:
TRL:
3 → 5
Project duration:
2 months
The major challenges the EnCata design and engineering team faced while working on the project were:
CAD Design
BOM Development
5-axis CNC-machine milling
CNC bending
Injection moulding DFM
Coating polymer / Anodizing
PCB prototype and assembly
Innovation in healthcare has been relatively slow compared to other industries such as software and electronics. There’s no lack of investment in healthcare innovation, but rather a lack of successful penetration given the barriers to entry due to the complexity of the market, which involves the need for FDA approval, the risk of costly failed innovations, and working with insurers.
Nowadays, there are critical issues in the way surgeons are trained, both in residency and beyond. Most medical students are trained for surgery using a variety of ‘theoretical’ and ‘practical’ learning tools. Theoretical tools include textbooks, manuals, guides, and videos, while practical training includes procedures on cadavers or on real patients with a senior surgeon present. However, the future of training combines both.
Today’s most common practical learning methods have limitations. A virtual environment, on the other hand, serves as a practical learning environment where learning from failure is permitted – even encouraged.
We have developed an advanced simulator for the most modern methods of surgery based on virtual reality technology that gives the most realistic simulation of actual surgery. Trained specialists can be inserted into any type of laparoscopic surgery, and the device’s special feature is the possibility of special training for future neurosurgeons.
To interact with the virtual world, the patented technology of full immersion in virtual reality MedVR Atlas is used. It implements a system for determining the spatial position of a person and the parts of their body. Thanks to this process, the learner interacts with the virtual world in a natural way without controllers. The MedVR Atlas technology allows for any interaction with a virtual patient.
The primary challenge we faced during the development process was ensuring the correct layout of the dissector, where the fixation and strain elements would not damage the handle of the enlarged unit. In real surgery, the dissector is a thin shaft with a handle, and the handle’s elliptical shape adds complexity. It is a sophisticated mechanism, incorporating hanger elements, weighted motors, sensors, and cables. Another obstacle was enabling the seamless collaboration of three mechanisms—two enlarged units and the laparoscopy system—within the constrained space of the operating table and their close proximity to each other. Lastly, we had to select motors and design a gearing system for the suspended nods, ensuring their performance matched the real forces exerted on the handle during surgery, while also meeting strict weight and dimension limitations.
The developed hardware includes dissectors and endoscopes which are connected to sensors and drivers for feedback. Also, it has VR glasses which allow simulating surgery using custom software.
Below are some specifications of the technology.
The physical design is centered around the high-quality VR simulation of a physician's working environment. The simulation is created using an in-house technological complex for creating full immersion.
The development process can be divided into five stages.
The first stage was the development of the industrial design of a software and hardware complex for simulating surgery.
The second stage involves developing the solo knot of the enlarged unit. This knot, a key component of the virtual laparoscopy simulator, captures the student's actions for data transfer and provides real-time feedback. Simultaneously, it reprograms the operation of the enlarged unit during real surgery. The knot closely mirrors the structure and functionality of the actual system, transferring all necessary forces and sensations to the student's hands.
The third stage involves developing a mathematical model to calculate the three-dimensional coordinates of a virtual tool's position, based on four angular coordinates. The virtual tools, such as scissors, clamps, needles, and others for the enlarged unit knots, as well as the camera for the endoscope knot, were positioned within these coordinates in the original software. Accurately pinpointing the location of two tools is crucial for the further development of the software.
The fourth stage focused on in-house manufacturing of the dissector's knot prototype. After the prototype was completed, testing was conducted to evaluate the software. Based on the results, additional data processing algorithms were incorporated into the software. A list of improvements for the enlarged unit was prepared for the next development stage.
The fifth stage was the modification of models and layout solutions for the next production of the table with two dissectors and laparoscopy (TRL 5-6). The proposed design accurately simulated the position of the enlarged units and provided tactile feedback during operation, resulting in minimal parasitic load:
Those changes helped to increase angles in which the proximity of the two dissectors does not interfere with their work with each other.
The first alpha prototype (TRL-5) is a fully functional laparoscopic simulation platform. The key technology behind it can be used for training in a wide range of fields, from astronaut training to neurosurgery.
were purchased for decreasing equipment price in further manufacturing
spent on mock-ups and preliminary tests to ensure confidence that we developed the device which any surgeon will use with pleasure
have been implemented to help software calculate the position of the enlarged unit and resistance which is required by an engine
