Types of Chinese Videos
First of all, translating Chinese videos into English videos is a relatively complicated process, and there are several situations involved, which are briefly listed below:
Type 1: Video with Chinese commentary and Chinese subtitles;
The second type: videos with only Chinese commentary and no Chinese subtitles;
The third type: only Chinese subtitles, no Chinese commentary video.
Corresponding to the version of the video translated into other overseas languages, I will take the most complex effect as an example here, and the generated video will have English commentary and English subtitles.
Other types are included here.
Comparison of video effects before and after translation
Translate video process:
Here are some basic steps:
To extract the text in the original Chinese short video, you can use speech-to-text technology or manually enter subtitles.
Translate Chinese text into English text, you can use ChatGPT here, you need to send it the extracted questions, and let him translate it into the language you need, support the translation of small languages, the small languages are measured The translation effect is also very good.
To combine the translated English text with the original Chinese video, you can use speech synthesis technology, such as Amazon Polly, Google Text-to-Speech, etc.
4. For other elements of the video (such as images, subtitles, etc.), it can be processed with visual effect software to adapt it to the new voice content.
Technical difficulties in realizing the above process:
Sound or text extraction requires professional tools,
The use of ChatGPT requires the use of "magic" mainland restrictions;
The sound and text in the original video can be removed, and the sound can be muted, but it is more difficult to erase the text, especially the text in the middle of the video;
Translating text to generate voice requires professional tools. Most of the tools only support domestic timbres, not overseas, especially in small languages. AI dubbing is very rare;
Align the translated audio with the original video, otherwise the audio and video will be out of sync.
In addition to the above difficulties, there are some more trivial details. So it is more difficult, so can you still use ChatGPT to translate videos normally?
answer, yes
Flat replacement solution - Ghost Hand Editing integrates the AI editing tool of the ChatGPT translation engine
The initial translation effects are all processed by Ghost Hand Editing. The translation engine of Ghost Hand Editing integrates various translation capabilities such as Google , DEEPL, and ChatGPT, and has been optimized and adjusted.
Support translation content online error correction,
Specific operation process
Local upload/link capture video (platform link does not need to remove watermark to download);
Choose the type of translation, support text/voice translation, different functions;
Select the target language for translation, text style /(for text translation, it is not necessary to check the style, and the text position and style size will be automatically restored);
Then submit it for processing, and you can download the processed works in the works.
The operation process is very simple, without complicated tools and long waiting times.
Finally, I hope to help everyone, and friends who are interested in AIGC can communicate with each other.