metaRTC集成FFmpeg实现回声消除(3A)等音频功能

概述

FFmpeg功能很强大，但在实现RTC方面功能比较弱，实现webrtc直播互动方面有两个短板，webrtc和回声消除等AEC/AGC/ANC功能，metaRTC集成FFmpeg新版本支持回声消除等AEC/AGC/ANC功能，助力FFmpeg实现webrtc直播互动。

下载源码

Release metartc2.0.120 with 3rdparty and runtime · metartc/metaRTC · GitHubhttps://github.com/metartc/metaRTC/releases/tag/2.0.120https://gitee.com/metartc/metaRTC/releases/2.0.120https://gitee.com/metartc/metaRTC/releases/2.0.120

 或者

GitHub - metartc/ffmpeg-metartc: 集成到ffmpeg的metaRTC集成到ffmpeg的metaRTC. Contribute to metartc/ffmpeg-metartc development by creating an account on GitHub.https://github.com/metartc/ffmpeg-metartcffmpeg-metartc: 集成到ffmpeg里的metaRTChttps://gitee.com/metartc/ffmpeg-metartc

编译

 编译srtp/openssl/speexdsp 这三个静态类库后，将其放到metartc2目录下

./configure --extra-libs='-L/path/metartc2 -lmetartccore2 -lpthread -lspeexdsp -lsrtp2 -lssl -lcrypto -ldl'
make
sudo make install

集成说明

libavformat/YangMetaConnection.h //头文件

typedef struct{
	void *context;
	void (*init)(void* context,int32_t sample,int32_t channel);
	void (*closeAec)(void* context);

	void (*echoCapture)(void* context,short *rec, short *out);
	void (*preprocessRun)(void* context,short *pcm);
	void (*echoStateReset)(void* context);
	void (*echoPlayback)(void* context,short *play);
	void (*echoCancellation)(void* context,const short *rec, const short *play,
			short *out);
}YangAec;
void yang_init_aec(YangAec* aec);
void yang_destroy_aec(YangAec* aec);

样例代码

//init aec
YangAec* aec=(YangAec*)calloc(sizeof(YangAec),1);
yang_init_aec(aec);
if(aec->init) aec->init(aec->context,48000,2);//opus默认采样率48k


//音频采集时调用
//capture_data 麦克风采集的音频数据 //默认采样率48k 每帧20ms
//out_data 回声消除、去除噪音后的数据
if(aec->echoCapture) aec->echoCapture(aec->context,(short*) capture_data, (short*)out_data);


//音频播放时调用
//play_data 播放音频的数据 //默认采样率48k 每帧20ms
if(aec->echoCapture) aec->echoPlayback(aec->context,(short*) play_data);


//delete aec
yang_destroy_aec(aec);