With the upgrade of Internet users consume content and interactive way, the content and infrastructure support interaction is also being quietly transformation. Upgrade mobile devices and the ability to shoot video spawned a network of people concerned about the live video field has attracted many Internet entrepreneurs or established companies to enter the field.
Seven cattle cloud as one to basic service capability known cloud computing company, at the end of June released a solution for live video real-time streaming network LiveNet and complete live cloud solution, many developers detail and use of the network and solutions scene is very interested.
Seven cattle combined real-time streaming network LiveNet practice and live cloud solutions, we will use seven articles, more systematic introduction to the key technology of the current hot all aspects of live video, live video to help entrepreneurs are more comprehensive, in-depth Learn video broadcast technology, to better technology selection.
This series of articles following outline:
(A) opening
(Ii) collection and processing
(Iii) encoding and encapsulation
(Iv) plug flow and transport
(No) modern players principle
(Vi) delay optimization
(Vii) SDK Performance Test Model
This article is "decrypted video broadcast technology," one of the series: the opening, we live in all aspects of the overall presentation of will.
1. Acquisition
Acquisition is playing links in the first ring, iOS narrow range of software and hardware systems because the hardware is better adapted, it is relatively simple. Android is different hardware models available in the market is very large, it is difficult to achieve a library fit all hardware. PC-side collection also with various camera driver-related, it is recommended to use the PC currently on the market with the best free open source software OBS.
2. Process
"80% of the anchor can not see no beauty at all." Not only is beauty, and many other video processing such as blur effect, watermark, etc. are also done in this session. Currently iOS end the more well known is GPUImage this library provides a rich end pretreatment effect, you can also write your own algorithm based on this library richer end result. Android also has transplanted GPUImage this library, called android-gpuimage. Meanwhile, Google officially open up a great library, covering many of the above treatment Android multimedia and graphic images related.
3. coding
There are two main difficulties encoding: a processing hardware compatibility issues. 2. Find a balance between high fps, low bitrate and sound quality. iOS end hardware compatibility is better, it can be directly used hardcoded. The support of hard-coding Android is much more difficult, the need to support a variety of hardware models, it is recommended to use soft knitting.
4. The plug flow and transport
Transfer involves many end: from the anchor end to end service, from the end edge node receiving the streaming service, and then from the edge node to the end viewer.
Plug-flow end number of concurrent users and end plug flow distribution in need of support should theoretically end, but after all, is to produce content in a minority of one hundred million, and the end consumer content players end is not an order of magnitude, but they plug flow stability and speed requirements much higher than the end of the play, which involves all players can see how the end of the broadcast, and broadcast end quality.
Many people now CDN Tucao do not fly, I have to admit the traditional CDN inadequate Xinyou in the new era. CDN can help you quickly achieve large-scale flow distribution, but steady stream of high-speed upload may also need to push yourself to do a lot of work. Therefore, the seven of us live cattle to build a proprietary real-time streaming network, then we will focus on the differences of the network and the traditional CDN.
5. transcoding
In order to anchor onto the stream to fit each platform end a variety of different protocols, need to do some work on the server side streaming, such as transcoding into different formats support different protocols such as RTMP, HLS and FLV, turn all the way to the appropriate multi-channel flow with a variety of network conditions and different resolutions of the terminal device.
At the same time, in order to meet the needs of some operators, such as some regulatory requirements, we also offer content identification, such as Kam Wong function on the server.
6. decoding and rendering
Decoding and rendering, i.e., audio and video playback, playback compatibility is currently preferred iOS end, in the case of using the HLS protocol acceptable delay is the best choice, we also provide the ability to play and RTMP HLS player SDK. Like there are compatibility issues with Android hardware decoding and encoding, the relatively good open source player is based on ffplay of ijkplayer, based on this we achieve a better Android SDK.
In addition to the SDK presentation, we will focus on the basic principles of the architecture of the player, as well as modern video player.
7. live scene solutions
In addition to the presentation live throughout the process, we will focus on today is the most fire scene broadcast live games and live as social, technical solutions introduced behind it. These solutions not only to seven live cattle such basic services may also involve technical support and other related scenarios, such as chat, point barrage of praise and lower social live.
In the next serial, we will introduce the first two aspects of playing at the live links Details: acquisition and processing.
-
Face a variety of video capture source on the market, application developers should live how to complete coverage?
-
The various needs of the market such as anchor beauty, watermark, even the wheat and other interactive how to meet?