This week we first tested a simple Euclidean distance based matching algorithm and found the problem. After reading related papers, I learned about the DTW algorithm and the eigenvector-based matching algorithm. After discussion, we believe that collision detection can be used in the learning process, and a sphere collision can be attached to each joint. If the student's collision leaves the teacher's collision, it means that the student makes an error, and the system will give a prompt accordingly. It also solves the problem of time synchronization, and timely error correction can ensure that students correct their mistakes in time. The DTW algorithm is used for scoring during individual exercises to reduce erroneous judgments caused by temporal asynchrony.
In addition, in terms of interaction between people and the system, the HTC VIVE handle will bring inconvenience to users for this project. We decided to give up the interaction method through the handle and change it to voice and gesture (or body posture).
Next, we will implement the matching method based on collision detection, and further study the implementation method of DTW and voice interaction system.