At the University of Alberta, Canada, a team led by Professor Hossein Rouhani is developing an augmented reality simulator that teaches people the right movement. It is intended for those who are undergoing rehabilitation and re-learn to walk and do simple things. But the system also has the potential to train athletes without the presence of a coach - at least physically.
The idea is to capture the user's movements, translate them into a digital 3D model, and then compare it with the reference models. For example, the movement of the hand of a tennis player serving the ball, or the balancing of the body by a tightrope walker is something that an experienced coach must show a beginner in person, which cannot be explained in words. The same applies to the rehabilitation of patients, because we are so used to walking without thinking that in a critical situation we simply get lost - but how to rearrange our legs and not fall?
To do this, the user is put on two types of sensors, bright markers to track his movements with cameras, and inertial sensors to accurately measure the vector and distance of movement of the limbs in space. With their help, the computer builds an accurate model of the user's movement, which is then displayed on the screen of the augmented reality glasses. A person gets the opportunity to see himself from the outside, and the trainer sees him remotely, without the need to be in the gym.
Next, a reference picture is superimposed on the student's virtual image, and he clearly sees where to move and how to turn to match it. This is how the training takes place - without the actual participation of the trainer, but with the effect of his presence. Now the prototype of the system is going to be tested on the newcomers of the university's sports team.