Audio and video development-audio and video learning materials

1. Why study audio and video?

2. How to learn systemic audio and video?

3. Audio and video related materials

Recently, a friend asked if I want to learn audio and video, how should I learn it, and is there any information?

This problem has also troubled me for a long time. I wanted to start learning about audio and video a few years ago, but I couldn't find the way, and I persisted for only two weeks. Looking back at this series of articles, I have written a lot before, although I still dare not say that I have already started, because the more I learn, the more knowledge I don't know, and the more things I need to learn. But why compared to the several attempts in the past few years, this time it lasted longer and there were continuous output of articles? This article is about self-examination and reflection, and I hope it will be helpful to friends who want to learn audio and video.

Why study audio and video?

I am doing android application development, android itself also has a lot of content that needs to be studied in depth, the more low-level and basic things are more versatile, such as design patterns, data structures, algorithms, communication mechanisms, multi-threading mechanisms, JVM virtual machines and many more. Combining the above content with specific business and scenarios, learn and apply well, it is also very beneficial to your own improvement. One of my role models is to have a deep understanding and ability in this area.

For me personally, the feelings of audio and video have been buried 4-5 years ago. At that time, I made a live on-demand sports app, and I came into contact with some audio and video related knowledge, but later due to external reasons in the direction of work , And more importantly, I don’t have enough cognition, and I don’t have a strong desire for the learning and development of audio and video.

During the National Day in 2020, I re-examined my plan and annual goals, and found that the most important personal goal, "audio and video development on the road", has not yet taken the first step in concrete terms. After a serious conversation with myself, I thought about two questions clearly

Why study audio and video
How to systematically study audio and video then began this series of learning practices, mainly for cognitive improvement, long-term and systematic thinking.

With the rapid development of short videos represented by Shake/Quick and long videos represented by Station B in recent years, a change has been made to the relatively hot live broadcast in about 16 years, but it is still in the audio and video field, let’s take a look. Down the latest data in "Trustdata Big Data"

The above content comes from [Trustdata Big Data]: https://mp.weixin.qq.com/s/otGI_yvvF_Q0L2mDrhtxyg

Through the top 20 rankings above, we can clearly see that there are 5 apps directly related to audio and video. What's more amazing is that almost all of the top 20 apps have audio and video related content. This is the current status or trend of the industry.

Audio and video are so popular now, is there still a chance to learn now?

The theory of pursuit on the right is also applicable to our learning and practice. The bottom layer of the rapid development of the audio and video industry is the increasing efficiency of information and communication, and the increasingly powerful and intelligent chip equipment. With the application of 5G and 6G, I believe that the future of audio and video is not a development direction, but a basic function like hydropower. It is also based on this change in cognition that I firmly believe in the development path of audio and video.

Code quoted [20 years of FFmpeg audio and video development]

In the next 10 years, the technology will still be those technologies, and the protagonist may change from mobile apps to AI and edge computing. If it were not for the xx battle, the 4T computing power of HiSilicon’s AI chips this year may drop below 10 US dollars. The large-scale mass production of chips and the drop in prices will drive a new round of changes in the industry. Software developers will also have corresponding brand-new opportunities. Audio and video, network communications, and OpenGL/ES must be mastered. They are engaged in related development, plus OpenCV, Tensorflow-lite. Deep learning foundation. My personal opinion is for reference only. So it is meaningless to simply talk about FFmpeg. Talking about audio and video, digital image processing, network communications, and FFmpeg-related may be more valuable. Where is the future of FFmpeg? A technology can only solve a specific problem in a suitable time period. Does the codec have been done by hardware and still need software development? No matter whether the codec is hard or soft, the amount of code is very small. A matter of dozens of lines of code. It is very small in a project. A large amount of code lies in network communication, image processing, and the logic of the software itself.

2. How to learn systemic audio and video?

A very important part of project management is the dismantling of tasks, and then gradually realizing them. In the past, I wanted to take a shortcut and learn it in one step. There is no quick way. Especially for a system with a huge knowledge system, it is very important to disassemble it and learn and practice gradually. Also during the National Day in 2020, through searching information and combining my own thinking, the following 6 stages of learning have gradually formed:

Basic knowledge of audio and video
FFmpeg command combat
FFmpeg project combat
Streaming media combat
Advanced development in WebRTC
WebRTC SFU server development

These are very important. These stages are the key nodes on the learning path and constitute a cognitive map. Then, at each stage, find the corresponding information and then disassemble the task into subtasks. Through the output and the input, the learning writing system is constantly iterated. .

3. Audio and video related materials (audio and video technical points, FFmpeg, learning route mind map)

1. Audio and video development technology points to explain the video learning materials Click: FFmpeg/WebRTC/RTMP audio and video streaming media advanced development