When I was writing an article recently, I found that many readers sent me private messages to ask questions about Android audio and video. Many students also have a strong interest in audio and video development, but they don’t have systematic learning knowledge. 仅靠自己苦苦钻研确实力不从心Today, I will take this opportunity to share Let's take a look at my exploration of learning audio and video development.
Basic knowledge points that need to be mastered in audio and video
- ffmpeg 强大的音视频处理库（cpu软编等）
- mediaCodec 安卓sdk自带的编解码器，（硬编）
- opengles 使用gpu进行图像处理
- h264,h265 图像编码压缩算法
- yuv420p ,nv21 ,yuv_420_888，I420 需要了解的视频编码格式
- yuv和rgb的相互转化
- ......
Why study audio and video technology?
开发薪水：In the public statistics of a recruitment website, 音视频行业的工资10k-20k占12%，20k-30k占45%，30k-k占35%，35k以上占13%。主要分布在20k-35k之间why is the salary for audio and video development so high? In fact, one of the main reasons is that audio and video technical talents are very scarce, and few people can complete audio and video development.
就业机会：Employment scenarios are widely distributed.
开发前景：The proportion of 5G landing audio and video in the Internet is getting higher and higher. The speed increase of 5G broadband has accelerated the application of the entire audio and video field, and there is a serious shortage of high-end audio and video fields!
Current status of the industry
核心竞争力：
After mastering audio and video, you don’t have to worry about being replaced by others, because the threshold of audio and video is destined to not be too much competition, so it is also a watershed to widen the gap with others.
高端人才相当缺乏：
In the BOOS direct recruitment, there are many audio and video development positions with an annual salary of 50W-70W in Beijing, Shanghai, Guangzhou and Shenzhen, which cannot be recruited all the year round, and most of the monthly salary of 20,000-30,000 are entry-level developers who have just started working in audio and video.
技术迭代慢：
音视频开发技术更新很慢, although the technical threshold is high , most of the technologies have been used for a long time but still maintain their vitality. It takes a long time for technical personnel to form. Many companies are engaged in audio and video development 35+, but these talents do not have to worry about being optimized at the age of 35.
Difficulties in audio and video self-study
1. 音视频自学非常困难，网上通俗易懂的难找到
2. 网上部分资源是对应的开源版本较低，比如雷霄骅(雷神)博客的FFmpeg版本较低
3. 音视频涉及大量的开源库和协议
4. 比如ffmpeg的编译，如果不熟悉各种编译报错
5. Janus编译涉及各种开源组件编译不通过
6. 比如WebRTC涉及的RTP RTCP SDP STUN等协议
7. 部分嵌入式音视频的朋友技术面窄，技术不深入
8. 比如有同学做了2年的音视频驱动，一帧音频能持续播放多久都不明白
如需要音视频开发进阶文档 添加 ∨:maniu966
Here I also try my best to solve these learning pain points for everyone, and compiled a copy 音视频开发进阶文档, so that beginners can get started in a more "soft and silky" way , and even veteran drivers can get a lot of gains.
(This document includes C/C++，Linux，FFmpeg webRTC opengl rtmp hls rtsp ffplay etc.) , you can get it by leaving a message or private message **【Audio and Video】**.
Emphasize: [Because of the length of the article: only the technical points are included in the article, if you need the full version, you can find the author to obtain it, leave a message: [audio and video]]
此外Android进阶开发各类文档/资料，也可关注公众号<Android苦做舟>获取。
1.Android高级开发工程师必备基础技能
2.Android性能优化核心知识笔记
3.Android+音视频进阶开发面试题冲刺合集
4.Android 音视频开发入门到实战学习手册
5.Android Framework精编内核解析
6.Flutter实战进阶技术手册
7.近百个Android录播视频+音视频视频dome
The following are some chapters of this development document:
Audio and video primary entry development
- Audio and video entry development (1): three ways to draw pictures
- Audio and video entry development (2): AudioRecord collects audio PCM and saves it
- Audio and video entry development (3): AudioTrack plays PCM audio
- Audio and video entry development (4): Camera API collects video data
- Audio and video entry development (5): MediaExtractor and MediaMuxer API analysis and packaging
- Audio and video entry development (6): MediaCodec API detailed explanation
- Introduction to Audio and Video Development (7): Summary of Audio and Video Recording Process
- ……
Audio and video intermediate advanced: OpenSL ES learning
- OpenGL ES Intermediate Development (1): Introduction to OpenGL ES
- OpenGL ES intermediate development (2): OpenGL ES environment construction
- OpenGL ES Intermediate Development (3): OpenGL ES Defines Shapes
- OpenGL ES Intermediate Development (4): OpenGL ES Drawing Shapes
- OpenGL ES Intermediate Development (5): OpenGL ES uses projection and camera views
- OpenGL ES Intermediate Development (6): Adding motion effects to OpenGL ES
- OpenGL ES intermediate development (7): OpenGL ES responds to touch events
- OpenGL ES intermediate development (8): OpenGL ES shader language GLSL
- ……
Advanced research on Android audio and video development
- Audio and video codec technology: audio coding technology
- streaming protocol
- multimedia file format
- FFmpeg learning
Emphasize: [Because of the length of the article: only the technical points are included in the article, if you need the full version, you can find the author to obtain it, leave a message: [audio and video]]
此外Android进阶开发各类文档/资料，也可关注公众号<Android苦做舟>获取。
1.Android高级开发工程师必备基础技能
2.Android性能优化核心知识笔记
3.Android+音视频进阶开发面试题冲刺合集
4.Android 音视频开发入门到实战学习手册
5.Android Framework精编内核解析
6.Flutter实战进阶技术手册
7.近百个Android录播视频+音视频视频dome