SpringBoot+Vue realizes dynamic voice playback. Realize the effect:
- Click the broadcast voice button on the page to call the background interface to obtain the binary byte[]
- The front end gets the returned data, calls the browser control AudioContext to decode the audio stream, and realizes playback.
1. The background interface returns byte[]
1. Add an interface to the controller and return byte[]
- set produces="application/octet-stream"
- Set return type ResponseEntity<byte[]>
@PostMapping(value = "/v/voice", produces = "application/octet-stream")
public ResponseEntity<byte[]> voice(@RequestBody JSONObject param, HttpServletResponse response) throws IOException {
String text = param.getString("text");
// 以下代码调用阿里云接口，把文字转语音
byte[] voice = SpeechRestfulUtil.text2voice(text);
// 返回音频byte[]
return ResponseEntity.ok().body(voice);
}
This example is to call the Alibaba Cloud tts interface to convert text to voice
2. Add a parser in configureMessageConvertersByteArrayHttpMessageConverter
@Override
public void configureMessageConverters(List<HttpMessageConverter<?>> converters) {
MappingJackson2HttpMessageConverter jackson2HttpMessageConverter = new MappingJackson2HttpMessageConverter(objectMapper());
converters.add(jackson2HttpMessageConverter);
converters.add(new ByteArrayHttpMessageConverter());
}
2. The Vue front-end calls the interface to play voice
- Use axios to call the backend interface, set responseType=blob
- 1) Get the browser playback control audioContext
- 2) Use FileReader to read the obtained byte[]
- 3) FileReader binds the load event, and plays the voice after reading byte[]
function doVoice(){
axios({
method:'post',
url:req.voice,
responseType:'blob',
data:{
text:data.info} // 需要播放的文本
}).then(function (response) {
console.log(response);
if(response.status===200){
// 1）得到浏览器播放控件 audioContext
let audioContext = new (window.AudioContext || window.webkitAudioContext)();
let reader = new FileReader();
reader.onload = function(evt) {
if (evt.target.readyState === FileReader.DONE) {
// 3）FileReader绑定load事件，读取byte[]完成后播放语音
audioContext.decodeAudioData(evt.target.result,
function(buffer) {
// 解码成pcm流
let audioBufferSouceNode = audioContext.createBufferSource();
audioBufferSouceNode.buffer = buffer;
audioBufferSouceNode.connect(audioContext.destination);
audioBufferSouceNode.start(0);
}, function(e) {
console.log(e);
});
}
};
// 2）使用FileReader读取得到的byte[]
reader.readAsArrayBuffer(response.data);
}
})
.catch(function (error) {
// handle error
console.log(error);
})
.finally(function () {
// always executed
});
}