LERCO

Neurorehabilitation using artificial intelligence

The research program comprises four main activities.

Main Activity 1: Humanoid Robot in Medicine

The objective of this activity is to develop a functional model of a humanoid robot, including components that correspond to the physiognomy of the human body. Furthermore, it aims to design suitable software for this new type of robot, with the goal of making the humanoid robot applicable in the field of telemedicine, specifically in neurorehabilitation.

This activity will be implemented in several phases, each with defined objectives, expected outcomes, benefits, and findings:

  • Review of the current state of robotic systems in rehabilitation
    • Data collection and gathering of materials for defining the robot’s structure.
    • Creation of a review based on the collected data.
    • Refinement of parameters for the robot’s structure.

  • Analysis of the robot structure
    • The refined parameters will be processed by technical experts.
    • Design of the robot’s structure – skeleton.
    • Design of the robot’s structure – active movement components (servomotors).

  • 3D Projection of robot parts
    • Design of 3D components in specialized software.
    • Projection of parts and their integration into the skeleton.

  • Design of robot electronics
    • Design of electronics for controlling servomotors.
    • Wiring projection.
    • Selection of control modules.
    • Selection of sensors.
    • Design of a proprietary control system – electronics.

  • Procurement of robot skeleton parts
    • 3D printing of robot parts.
    • Finishing and quality control of parts.
    • Acquisition and assembly of servomotors, sensors, and the control system.

  • Assembly and testing of the robot
    • Gradual assembly and testing of parts (left/right lower limb, left/right upper limb, pelvis, spine, torso, head).
    • Connection of the control system and final assembly of the entire robot.

  • Design and programming of robot movements
    • Description of movements for each part of the robot from a physiotherapy perspective.
    • Programming and implementation of robot movements.
    • Testing of technical functionality.
    • Medical evaluation and adjustments based on feedback.

  • Research on the use of the developed robot for telerehabilitation
    • Design of a telemedicine solution for patient rehabilitation using the developed robot, supervised by a monitoring robot (system).
    • Development of communication software.
    • Testing of communication with healthcare professionals via the monitoring robot.
    • Feedback and software adjustments.

  • Intellectual property protection

Main Activity 2: Integration of Autonomous and Extended Reality (EX) Technologies in Neurorehabilitation

The goal of this activity is to develop innovative neurorehabilitation hardware and software components that are effective both as standalone systems and in combination with extended reality (EX). The aim is to maximize therapeutic outcomes and improve access to rehabilitation care for patients with neurological impairments.

The activity will be carried out in stages, with defined goals, expected outcomes, benefits, and insights:

  • Design and development of independent hardware and software
    • Development of hardware components that can function independently without VR.
    • Development of software for neurorehabilitation games and applications that are fully functional without VR.
    • Ensuring that hardware and software are optimized for use both independently and within EX.

  • Integration of EX into hardware and software components
    • Expanding hardware and software development to include EX functions and compatibility.
    • Design and implementation of EX elements to extend the capabilities of independent hardware and software.
    • Adaptation and optimization of hardware and software for smooth integration with EX systems.

  • Standalone and EX testing by experts
    • Testing of hardware and software independently and within EX.
    • Gathering feedback for both modes of operation.
    • Modifications and improvements for maximum efficiency in both modes.

  • Preclinical testing in both modes
    • Testing of hardware and software on patients in standalone and EX modes.
    • Comparison of efficacy and benefits of both approaches.
    • Data collection and analysis for each mode separately.

  • Implementation and optimization for both modes
    • Integration of hardware and software into clinical practice for both standalone and EX use.
    • Continuous improvements and updates based on user feedback.
    • Ensuring that both forms are user-friendly and easily accessible.

  • Analysis and optimization of treatment programs for standalone and EX use
    • Detailed evaluation of performance and efficiency in both modes.
    • Modification and enhancement of therapeutic programs based on the analysis.
    • Discussion and development in the context of the latest research findings.

  • Publication of results and intellectual property protection for both modes
    • Publication of results for both standalone and EX modes.
    • Intellectual property protection for the unique aspects of both approaches.

Main Activity 3: VR Simulation

The objective of this activity is to develop, test, and propose procedures for training surgical techniques in virtual reality (e.g., vertebroplasty, carpal tunnel release, craniotomy).

The activity will be implemented in stages, each with defined objectives, expected outcomes, benefits, and insights:

  • Selection of appropriate surgical procedure
    • Evaluation and selection of surgical procedures for simulation by physicians, assessing suitability for virtual reality.

  • Preparation of materials for VR-based surgical procedures
    • Comprehensive video documentation.
    • Complete textual documentation.
    • Description of common mistakes and extreme variants.

  • Programming a functional surgical procedure in VR
    • Preparation of wireframe models.
    • Consultation with physicians on medical topics versus software development.
    • Programming a functional version of the procedure.

  • Testing the VR surgery
    • Testing by the VR team.
    • Functionality testing by an internal team of physicians.
    • Testing by independent physicians.

  • Program revision
    • Processing feedback from testing and modifying the software.
    • Retesting the updated software.

  • Deployment of the simulation program in a cloud environment
    • Design of the administration system.
    • Cloud integration.
    • Administrative and organizational support for the use of the software (management/input/evaluation).
    • Further development based on testing feedback.

  • Publication of results and intellectual property protection

Main Activity 4: VR Surgery

The aim of this activity is to develop virtual reality applications to assist during brain surgeries and other procedures where the patient is conscious, such as AWAKE surgeries, or to facilitate relaxation during operations (shielding the patient from the surgical environment).

This activity will be carried out in stages, each with defined goals, expected outcomes, benefits, and insights:

  • Selection of appropriate surgery or surgical procedure
    • Evaluation and selection of surgeries where the patient is conscious for simulation by physicians, assessing suitability for virtual reality.

  • Preparation of materials for brain surgery/awake surgery in VR
    • Comprehensive video documentation.
    • Complete textual documentation.
    • Description of common mistakes and extreme variants.

  • Programming a functional surgery in VR
    • Preparation of wireframe models.
    • Consultation with physicians on medical topics versus software development.
    • Programming a functional version of the surgery.

  • Testing the VR surgery
    • Testing by the VR team.
    • Functionality testing by an internal team of physicians.
    • Testing by independent physicians.

  • Program revision
    • Processing feedback from testing and modifying the software.
    • Retesting the updated software.

  • Deployment of the simulation program in a cloud environment
    • Design of the administration system.
    • Cloud integration.
    • Administrative and organizational support for the use of the software (management/input/evaluation).
    • Further development based on testing feedback.

  • Publication of results and intellectual property protection

Collaboration with Other Research Programs and Entities

Due to the highly interdisciplinary nature of this project, the VP5 research team collaborates with other research teams, particularly:

  • VP7 – Consultations with medical fields of University Hospital Ostrava for the development of the robot and software to facilitate treatment using virtual reality or to train surgical techniques using VR.

For the practical application of the research, at least two collaborating entities (non-profit) will be involved during the experimental phase, contributing to:

  • The development of the humanoid robot.
  • The development of software for use in neurorehabilitation.