Article Directory
1. Three-dimensional virtual sound technology
The three-dimensional virtual sound in the virtual environment is different from the familiar stereo sound. The
three-dimensional virtual sound comes from anywhere in a sphere around the ears of the listener, that is, the sound appears above, behind, or in front of the head
1. Features of 3D virtual sound
- Omnidirectional three-dimensional positioning refers to the real-time tracking of the position of the sound source in a virtual environment.
- 3D real-time tracking refers to the ability to track changes in the position of virtual sound sources or changes in virtual images in real time in a 3D virtual environment
2. Head related transfer function
- The head-related transfer function can be regarded as the function of the body features around the human body
- When the obtained head-related transfer function can accurately describe a person's auditory localization process, it can be used to simulate and reproduce the real sound scene
- Since the size and shape of each person's head and ears are different, the transfer function related to the head will also vary from person to person.
3. Speech recognition and synthesis technology
In the virtual reality system, voice application technology mainly refers to the technology based on voice processing, mainly including voice recognition technology and voice synthesis technology, it is a cutting-edge technology in the field of information processing
1) Speech recognition technology
Voice recognition i technology means that the computer system can recognize the specific meaning of the representative according to the input voice, and then complete the corresponding function.
A complete speech recognition system can be roughly divided into the following three parts:
- Speech feature extraction
- Acoustic model and pattern matching (recognition algorithm)
- Language Model and Language Processing
Language recognition method:
- Method based on vocal tract model and speech knowledge
- Pattern matching method
- Method using artificial neural network
2) Speech synthesis technology
Speech synthesis technology is to convert text information generated by the computer itself or externally input into voice signal output according to the voice processing rules, so that the computer can read the text information fluently, so that people can understand the content of the information by "listening"
2. Human-computer interaction technology
The natural human-computer interaction technology refers to a technology in which a person should be able to directly interact with various senses such as eyes, ears, skin, gestures, and voice in a virtual environment provided by a computer system .
The most commonly used interaction technologies in the field of virtual reality are:
- Gesture Recognition
- Facial expression recognition
- Eye tracking
- Speech Recognition
3. Virtual Reality Engine
The virtual reality system is a complex integrated system. The core part of the virtual reality system should be the virtual reality engine, which controls and manages the data, peripheral equipment and other resources in the entire system.
Observed from the role of the virtual implementation engine, its system, as the core of virtual reality, is in the most important central position, organizing and coordinating the operation of various parts.
A perfect virtual reality engine should have the following characteristics:
- Visual management interface
- Secondary development capability
- Data compatibility
- Faster data processing functions
From the perspective of its design, the virtual reality engine can be divided into four parts:
- Basic package
- Virtual reality engine packaging
- Visual development tools
- Software auxiliary library
