This column will share a series of technical articles on Alibaba Cloud Video Cloud MediaBox, provide an in-depth analysis of the technical architecture, technical performance, development energy efficiency and best practices of the audio and video development tool, and start the audio and video development journey together. This article is the best practice of MediaBox. It focuses on the core capabilities, technical architecture, and rapid integration of the interactive live broadcast AUI Kit to introduce how to quickly access the interactive live video service through low code.
Ming Jing｜Author
With the development of Internet technology and the upgrade of network infrastructure, the audio and video industry is booming. Among them, live broadcast has penetrated into thousands of industries at a speed visible to the naked eye, becoming a national-level audio and video interactive form, which has not only changed people's lives It has also profoundly affected the economic and social development.
Under this wave, traditional industries have also begun to actively explore digital transformation. The demand for audio and video in various market segments continues to grow. It has become a consensus among all industries to empower industrial upgrading and transformation through live broadcast.
However, live broadcast technology seems ordinary, but it involves many technical links, from audio and video collection, pre- and post-processing, encoding, decoding, rendering, to transmission, distribution, etc. The audio and video development chain is long, the development threshold is high, and the technical complexity is very high. high. It is extremely difficult to build a live broadcast system from 0 to 1, which discourages many companies.
How to help traditional enterprises get rid of complex live broadcast system engineering so as to better focus on the business itself? Scenario-based interactive live broadcast solutions emerged at the historic moment.
01 Interactive live broadcast AUI Kit
Concept Note
The interactive live broadcast AUI Kit is a low-code solution for live broadcast scenarios formed by Alibaba Cloud based on a series of MediaBox audio and video terminal SDKs and modular packaging.
Based on the capability requirements of general live broadcast scenarios, the interactive live broadcast AUI Kit strictly follows the requirements of high availability and realizes functions such as live broadcast, on-demand broadcast, live broadcast interaction, chat barrage, playback, etc. It also follows the requirements of high ease of use and supports one-click connection. Participation helps enterprises quickly implement and create their own personalized live broadcast platform.
core competencies
One-click start of broadcast : Integrating the interactive live broadcast AUI Kit low-code development solution, the anchor can start the broadcast through computers, mobile phones, all-in-one live broadcast machines and other devices to attract viewers; the audience can watch the live broadcast through the live broadcast room list, or watch the live broadcast replay through the quick entrance. So as to meet different viewing needs.
Beauty effects : The interactive live broadcast AUI Kit supports basic beauty functions. Anchors can set whitening, skin smoothing, sharpening, rosy and other effects according to live broadcast needs, and easily create a "good-looking anchor" with millions of fans.
Chat barrage : The live broadcast room supports chat barrage to meet the real-time interaction needs of anchor assistants and viewers. Through the support of sharing, likes and other functions, it can increase the number of viewers and activity in the live broadcast room; at the same time, the interactive live broadcast AUI Kit also supports setting up live broadcasts Room announcements and bans, etc., further facilitate the management of the live broadcast room.
Lianmai PK : The interactive live broadcast AUI Kit solution supports Lianmai interaction between anchors and viewers, mobilizes the atmosphere in the live broadcast room, supports Lianmai PK, multi-person interaction and other live broadcast capabilities, and also supports management of the status of Lianmai/PK users.
Recording and playback : After accessing the interactive live broadcast AUI Kit, it can support the recording and playback of live broadcasts, quickly generate exciting short videos for secondary dissemination during and after live broadcasts, and greatly improve the efficiency of content dissemination.
02 Technical architecture
Technical realization
The interactive live broadcast AUI Kit solution includes client UI components and back-end service components.
The client UI component is based on MediaBox SDKs, providing standardized open source UI components, including basic components such as streaming, playback, room engine, beauty effects, IM interaction, and barrage. Components support one-click introduction, and integrators can integrate on-demand according to their own business needs, thereby reducing R&D costs, shortening R&D cycles, and improving business results.
The back-end service components can be deployed on the customer APP Server and directly access the Alibaba Cloud Live Broadcast Center to access live broadcast room management, continuous microphone management, playback configuration, video review, comment review, data interface and other capabilities. More importantly, it is delivered in the form of source code or image, providing a set of back-end services built based on function computing (FC), container image or source code, flexibly deployed and flexibly customized, and users only need 5 to 10 minutes to complete the service. It can complete the establishment of background services and greatly reduce the user's audio and video development costs.
In addition, App Server has been connected to commonly used PaaS layer functions such as live broadcast review and cloud recording, making it convenient for customers to integrate multiple audio and video capabilities in one stop. At the same time, the client component will interact with the server AppServer to implement the core scenario-based business logic.
In order to ensure the flexibility and scalability of the basic components of the interactive live broadcast AUI Kit, we have defined abstract interfaces for the basic components. While providing a set of standard implementation solutions, we also give users the right to choose. Users can choose other atomic-capable SDKs as solutions according to their own needs to realize their own business needs. This also ensures the flexibility and controllability of users in secondary development to the greatest extent, truly achieving "high cohesion and low coupling". ".
Architectural advantages
MediaBox interactive live broadcast AUI Kit low-code solution is based on Alibaba Cloud's technology base and long-term audio and video practice to provide customers with stable and reliable audio and video live broadcast services. On the one hand, Alibaba Cloud's high-quality nodes and bandwidth ensure second-level latency and support tens of millions of live broadcast concurrency capabilities; on the other hand, through the SDK's internal data system, stability system, automated testing system, and performance evaluation system, it effectively guarantees The business is running stably.
- AUI component level: component integration
In order to achieve the design goals of high availability, high ease of use, and unified specifications, the interactive live broadcast AUI Kit scenario-based solution highly reuses basic components to achieve a consistent multi-terminal experience. At the same time, we also provide some easy-to-use tools for customers to use scripts to introduce them with one click, thus greatly improving customers' integration efficiency.
- MediaBox SDK level: SDK integration
In order to achieve high ease of use and high flexibility of audio and video SDK, MediaBox SDK provides a variety of combination package forms, reducing the overall SDK package size for customers to flexibly choose and access efficiently. Customers only need to care about their business scope and choose the SDK type that is more suitable for their business.
In terms of ensuring the high reliability and performance of MediaBox, different SDKs share the same set of common components, which not only achieves the unification of basic audio and video components such as collection, pre- and post-processing, encoding and decoding, encapsulation/decapsulation, and rendering, but also achieves the following: The unification of basic business components such as crash capture, license authorization, and point reporting not only optimizes the stability of the SDK, but also improves the performance of the SDK.
- Device-cloud collaboration level: cloud-end integration
Relying on the highly reliable service of Alibaba Cloud's multi-integrated streaming media transmission network MediaUni's global 3200+ nodes, we provide users with closer access nodes and better network transmission lines, thereby reducing end-to-end latency and passing long-term verification The experience accumulated in optimizing QoS/QoE improves users’ video experience.
At the same time, based on the excellent audio and video technical capabilities of Video Cloud, we also provide a full range of cloud services, such as: live video services, video on demand services, intelligent media services, etc., covering rich media such as recording, mixing, transcoding, and review processing capabilities to provide customers with a stable, simple, and efficient one-stop audio and video solution to meet the multi-scenario audio and video business needs of the entire industry.
03 Quick integration
This section introduces how to quickly integrate AUI Kits in your App project to realize the interactive live broadcast function. The specific steps can be divided into the following four steps:
- Import source code
Obtain the interactive live broadcast code warehouse from the Alibaba Cloud product official website or GitHub, and import the corresponding basic component modules into your own project according to actual business needs.
- Configure License
MediaBox AUI Kits and MediaBox SDKs have a unified license acquisition method. You can apply for license usage rights for modules such as live streaming, short videos, players, and beauty effects in the Alibaba Cloud console, and you can also manage the licenses for each module.
The prerequisite for configuring the license is that you have obtained the license authorization for audio and video terminal SDK related capabilities.
- initialization call
The initialization call contains several parts, registering the project type, and replacing the APP Server address. A Manager class is provided in the App directory of each project. Refer to the setup() method to complete the initialization call.
The prerequisite for replacing the APP Server address is that you have set up the AppServer and obtained the access domain name. For the construction steps, please refer to the server integration on the official website: Interactive Live Broadcast Scenario_Audio and Video Terminal SDK_Alibaba Cloud Help Center
- Project configuration
For different platforms, you also need to perform related project configurations, such as: permission configuration, Android obfuscation configuration, Maven warehouse address, iOS compilation configuration, etc.
Through the above steps, you can quickly access the interactive live broadcast capability of Alibaba Cloud Video Cloud. For more details on the integration process, please see the official website: Interactive Live Broadcast Scenario_Audio and Video Terminal SDK_Alibaba Cloud Help Center
04 Outlook
MediaBox interactive live broadcast AUI Kit will continue to iterate towards the goals of high availability, high ease of use, and scenario-based development. At the product level, we dig deep into customer needs and conduct industry research to meet the audio and video scene needs of different customers; at the technical level, we continue to improve the ease of use, reliability and advancement of solutions through integrated architecture integration, thereby helping enterprises Access interactive live broadcasts in a more flexible, faster, more agile and lower-cost way.
If you have any questions or suggestions when accessing or using the interactive live broadcast AUI Kit, you are welcome to join the AUI customer support DingTalk group , communicate and share with us: DingTalk group link
