Let's talk audio and video

origin


At the beginning, the editor wondered whether to update this topic. There was really nothing to share, just some APIs and the use of some frameworks. It is an article at the end of the third quarter.

how to study


Looking at various frameworks, in fact, the best way to learn is to look at the source code of mature frameworks. There may be some super-class knowledge in it, which does not belong to the current scope of work, but can be conquered as part of hobbies.

  • I won’t talk about MDN
    , a website that everyone knows about code dogs, similar to the common sense that everyone knows, the earth is elliptical.
  • Blog
    By reading the blogs of predecessors, you can gain a lot of practical experience. This is the reason why the so-called stones from other mountains can be used to attack jade.
  • Write something casually
    The value of theory lies in providing support for practice. After the above steps, just write something casually, and you can basically get started.
  • his.js, this is the source code that I recommend everyone to read, because it is really well written

Build a live broadcast platform


The application scenarios of this technology are very wide. Let's briefly talk about how to use it in the form of a case. If we need a live broadcast platform now, how can we apply audio and video technology.
First of all, you need to understand webRtc, which is simply a real-time communication tool that satisfies peer-to-peer and can be used for push-pull streaming.
Secondly, we need to determine the network transmission protocol, because the video is divided into multi-frame pictures and audio, we just need to find a suitable three-party framework and conduct an access test. If you want to optimize performance, you can open another article and skip it here.
Is it very simple? There are only two steps. To put it bluntly, there are many mature solutions in the industry, and developers need to know a little bit to get started.
Finally, let’s talk about the principle. In fact, computers and other hardware devices receive a piece of audio and video, and then the three-party framework and the bottom layer of the web perform real-time conversion and docking, and then output streaming media to developers. At the same time, developers can perform customized operations according to specific APIs. ,It's that simple.

end


In fact, there are many concepts and agreements that are not mentioned in the article, because the editor feels that after entering the door, everyone can learn by themselves and continue to explore, which is also a kind of fun! Finally, I would like to wish everyone a happy National Day and happy every day! If you like the editor, don't forget to give a reward!

Guess you like

Origin blog.csdn.net/zjscy666/article/details/126942180