1. Import chatGpt to solve AI intelligent answering
Please import according to the previous article: How to use ChatGPT for low-code rapid development in unity? _Xiangshi Technology, let you see the future (nbhctec) blog-CSDN blog
2. Text also has conversion tools
Importable unity plug-in - RT-Voice PRO
2.2 TTS technical solutions from other three parties:
Microsoft Azure text-to-speech:
Text to Speech – Real AI Speech Generator | Microsoft Azure
Baidu AI:
Google Cloud Services:
https://cloud.google.com/text-to-speech#section-2
3. Open your mouth and speak
Obtain Unity Chan's model resources (with mouth shape BlendShape animation included), integrate the SyncLip mouth shape animation plug-in, and use sound to drive the model's mouth shape.
After step two, obtain the audio Clip and pass it to the SyncLip plug-in SDK in real time, allowing Unity Chan to obtain the ChatGPT information and have the corresponding mouth "shape" in the virtual world.
Step 4: Scenario debugging
You can find the AIDemo.unity scene in the project and directly fill in the obtained ChatGPT API Key to run the debugging preview directly.
The project is still being improved. At this stage, text input is used to replace "ask". Later, the author will also use speech recognition technology as the "input terminal" to achieve voice conversational chatting with Unity Chan, and finally have a complete "smart" Virtual humanoid Chan Chan Jiang.
Note: Contact me if you need unity project files!