Neurorehabilitation using artificial intelligence

The research program consists of four main activities.

 Main Activity 1: Humanoid Robot in Medicine

The aim of this activity is to develop a functional model of a humanoid robot, including individual components corresponding to human body physiology, and to create appropriate software for this new type of robot. The goal is to make the humanoid robot model usable in the field of telemedicine, particularly in neurorehabilitation.

The activity will be implemented in several stages with defined objectives, expected outcomes, benefits, and insights:

• Review of the current state of robotic systems in rehabilitation:
• Data collection for robot structure definition
• Compilation of a review based on collected data
• Specification of parameters for robot structure
• Robot Structure Analysis:
• Processing of refined parameters by engineers
• Design of the robot structure – skeleton
• Design of the robot structure – active movement elements (servomotors)
• 3D Modeling of Robot Parts:
• Designing 3D parts of the robot in software
• Mapping the attachment of parts to the skeleton
• Robot Electronics Design:
• Designing electronics for servomotor control
• Cabling layout
• Selection of control modules
• Sensor selection
• Development of a proprietary control system – electronics
• Procurement of Robot Skeleton Parts:
• Printing robot parts on 3D printers
• Cleaning and quality control of parts
• Purchase and assembly of servomotors, sensors, control system
• Assembly and Testing of the Robot:
• Gradual assembly and testing of components (left/right lower limb, left/right upper limb, pelvis, spine, torso, head)
• Connecting the control system and assembling the entire robot
• Robot Motion Design and Programming:
• Description of robot movements based on physiotherapy needs
• Implementation of robot movement programming
• Testing of technical functionality
• Medical testing
• Adjustments based on feedback
• Research on Using the Developed Robot for Telerehabilitation:
• Design of a telemedicine solution for patient rehabilitation with the developed robot via a supervising robot (system)
• Communication software development
• Testing communication with a doctor through the supervising robot
• Feedback and software modification
• Intellectual Property Protection

Main Activity 2: VR Vitalis

The objective of this activity is to develop innovative neurorehabilitation hardware and software components that are effective both independently and in combination with extended virtual reality, maximizing therapeutic benefits and enhancing rehabilitation care accessibility for patients with neurological impairments.

This activity will be implemented in stages with defined objectives, expected outputs, benefits, and insights:

• Independent Hardware and Software Development:
• Development of hardware components that can function independently of virtual reality (VR)
• Creation of software for neurorehabilitation games and applications that are fully operational without VR
• Ensuring that hardware and software are optimized for both standalone and extended reality (EX) use
• Integration of EX into Hardware and Software Components:
• Extension of hardware and software development to include EX functions and compatibility
• Design and implementation of EX elements to expand the capabilities of standalone hardware and software
• Adaptation and optimization of hardware and software for seamless EX system integration
• Separate and EX Testing by Experts:
• Testing of hardware and software both standalone and within EX
• Feedback collection for both usage modes
• Modification and improvement of hardware and software for maximum efficiency in both modes
• Dual-Mode Preclinical Testing:
• Testing of hardware and software on patients in standalone and EX modes
• Comparison of effectiveness and benefits of both approaches
• Data collection and analysis for each mode separately
• Implementation and Optimization for Both Usage Modes:
• Integration of hardware and software into clinical practice for standalone and EX use
• Continuous improvement and updates based on user feedback
• Ensuring both modes are user-friendly and accessible
• Analysis and Optimization of Therapeutic Programs for Standalone and EX Use:
• Detailed evaluation of performance and effectiveness in both modes
• Adjustments and improvements of therapeutic programs based on analysis
• Discussion and development in the context of the latest research findings
• Publication of Results and Intellectual Property Protection for Both Modes:
• Publication of usage results for standalone and EX modes
• Intellectual property protection for unique aspects of both approaches

Main Activity 3: VR Simulation

The objective is to develop, test, and design procedures for training surgical techniques in virtual reality (e.g., vertebroplasty, carpal tunnel, craniotomy).

This activity will be implemented in stages with defined objectives, expected outputs, benefits, and insights:

• Selection of Suitable Surgery or Surgical Technique:
• Selection of appropriate surgery for simulation, assessing suitability for virtual reality use
• Preparation of Materials for Surgery Processing in VR:
• Comprehensive video documentation
• Complete textual documentation
• Description of common errors and extreme scenarios
• Programming of Functional Surgery in VR:
• Wireframe preparation
• Consultation with doctors on medical topics vs. software
• Programming of the functional version
• VR Surgery Testing:
• Testing by the VRL team
• Functionality testing by an internal team of doctors
• Testing by independent physicians
• Program Revision:
• Feedback processing from testing, software modification
• Retesting of software
• Deployment of the Simulation Program to a Cloud Environment:
• Administration design
• Cloud connection
• Administrative and organizational support for software use (management/entry/evaluation)
• Adjustment based on testing feedback
• Publication of Results and Intellectual Property Protection

Main Activity 4: VR Surgery

The goal of this activity is to develop applications combining virtual and augmented reality (AR), mainly to assist in brain and spine surgeries.

Development will focus on software for:

1. Brain surgeries with the awake technique, where the patient is conscious—e.g.relaxation during surgeries (shielding the patient from the surgical surroundings).
2. Spinal surgeries, where the synchronization of navigation and visualization of the surgical procedure through VR and AR enables the application of instruments during surgery, either in collaboration with or as a replacement for robotic systems.

The activity will be implemented in stages with defined objectives, expected outcomes, benefits, and insights:

• Selection of Suitable Surgery or Surgical Technique:
• Selection and design of awake surgery for simulation by doctors, evaluating its suitability for VR use
• Synchronization of the navigation system with the operational simulation in VR and AR
• Preparation of Materials for Brain/Spinal Surgery Processing in AR:
• Comprehensive video documentation
• Complete textual documentation
• Description of common errors and extreme scenarios
• Programming of Functional Surgery in VR and AR:
• Wireframe preparation
• Consultation with doctors on medical topics vs. software
• Programming of the functional version
• Surgery Testing:
• Testing VR and AR integration with the navigation system
• Functionality testing by an internal team of doctors
• Testing by independent physicians
• Program Revision:
• Feedback processing from testing, software modification
• Retesting of software
• Deployment of the Simulation Program to a Cloud Environment:
• Administration design
• Cloud connection
• Administrative and organizational support for software use (management/entry/evaluation)
• Adjustment based on testing feedback
• Publication of Results and Intellectual Property Protection

Collaboration with Other Research Programs and Partner Organizations

Due to the highly interdisciplinary nature of the project, the VP5 research team collaborates on specific activities with research teams such as:

• VP7 – consultations with medical fields at University Hospital Ostrava (FNO) for the development of the robot and software for treatment using virtual reality or for training surgical techniques in VR.

For the practical application of research, at least two collaborating entities (without generating profits for them) will be involved during the experimental research phase. These entities will participate in:

• Development of the humanoid robot
• Development of software for use in neurorehabilitation
• Development of software in VR Surgery