Evolution of audio and video service architecture

LiveVideoStackCon 2022 Audio and Video Technology Conference Beijing Station will be held at the Park Plaza Beijing from November 4th to 5th . This conference will continue the theme of [ Audio and Video + Infinite Possibilities ], inviting many companies, experts and scholars in the industry to In the past year or more, they have explored the application of audio and video in more fields and scenarios, their experience in polishing and optimizing technology in practice, and their thinking on technology and business value. They will share and discuss with you.

Evolution of audio and video service architecture

The rapid development of technology has driven the continuous update and iteration of audio and video related applications and products. Under the impact of the epidemic, online interactive communication, collaboration, game entertainment and other scenarios based on real-time audio and video technology have ushered in rapid development. These have a great impact on audio and video services. Overall, higher requirements are put forward for stability, interaction capabilities, delay, and quality of experience. This topic will discuss the process and exploration of the overall system architecture design and evolution including audio and video codec, transmission, capability realization, service guarantee, etc. under the severe challenge of user needs.


# Producer #

babeec16b78e61752067fe41b6a9cb0b.jpeg

Zhou Sijin

Producer

good future

Head of Live Technology

Zhou Sijin, a veteran of the audio and video industry, has been engaged in related work in the audio and video industry for 20 years, and has been engaged in the research and development of video conferencing related technologies from 2001 to 2015. In 2015, he followed the trend of live broadcasting and entered the Internet industry to start a business. In 2017, he founded Santi Cloud, which is one of the earliest RTC real-time audio and video service providers. Join TAL in 2020, responsible for TAL live broadcast technology. He has rich practical experience in audio and video in the fields of pan-entertainment and online education.


# Lecturers and Topics #

4fdb6ed28ad73898e7bbdfd1de21ca2a.jpeg

Topic1

How far are we from true "virtual reality"?

Virtual reality technology is the key to the metaverse. However, to promote its wide-scale popularization, a series of challenges must be cleared, including realistic audio and video experience, motion feedback, no dizziness, terminal portability, and cloud-side computing power Collaboration, strong interactive content, and controllable solution costs", etc. This speech will conduct in-depth analysis based on the above issues, and explore the corresponding technical architecture and solutions in audio and video experience, collaborative rendering, and strong interaction.

Content outline:

1. Key challenges for true virtual reality

2. The dynamics of academia and industry, whether there is a good solution based on the current technology and infrastructure

3. Explore the technical and commercial feasibility of the device-edge-cloud collaboration framework


ebf334db2f1a79d66709c51a68a0b873.jpeg

Topic2

Application practice of multi-cloud and multi-protocol converged audio and video system architecture of Jobbang

With the development of technologies such as RTC, online education has benefited a lot. However, the educational scene has its own special features. One of its goals is to impart knowledge, and to communicate clearly and accurately, many contents need to be coherent. This poses more stringent requirements and challenges for system design. This sharing starts from specific scenarios, combined with homework help’s accumulated experience in self-developed ZRTC system, and integration with traditional live broadcasting and third-party RTC services into a system, etc., focusing on online education scenarios, flexible design, High-quality, highly stable integrated audio and video architecture, issues to be considered, some ideas, practices and experiences.

Content outline:

1. Model Analysis of Online Education Live Streaming Room

2. Architecture design concepts, ideas and practices of the self-developed ZRTC system

3. Multi-cloud and multi-protocol fusion audio and video system architecture design and practical experience

4. Quality analysis, monitoring methods and troubleshooting methods

5. Summary



03572b34e98b93eaf6140d0e9317caed.jpeg

Topic3

OWT's Architecture Evolution to Respond to Diversified Audio and Video Demands

OWT was originally a development component centered on video conferencing. With the popularization and development of audio and video technology, we found that the application scenarios of customers have become more and more diversified. In response to various emerging needs, the architecture of OWT has evolved from a monolithic conference model to a layered micro-service model.

Content outline:

1. Introduction to OWT target scenarios and component functions.
2. Use some realistic requirements to illustrate the changing requirements and challenges that OWT encounters in the development of audio and video applications.
3. OWT has made layered (conference layer, stream control layer, and basic layer) and micro-service changes in the architecture to meet the diversified real-time audio and video requirements.



f6a6691d6d9d5cb514055fa8d86e1cdf.jpeg

Topic4

Practice and optimization of microblog RTC media service

With the development of audio and video technology, it has contributed to its application in various industries. As a mainstream social media platform, Weibo also has a wealth of audio and video-based product forms. The low latency and strong interaction of RTC not only brings challenges, but also enriches the live broadcast ecology of Weibo.
This sharing will be divided into three parts: the first part introduces the difficulties and challenges of RTC streaming media services, and compares the mainstream open source technology solutions in the industry; the second part introduces Weibo’s self-developed RTC solutions and implementation details, such as private protocols The design, compatibility of standard protocols, and routing and forwarding rules; the third part introduces the Weibo mixed stream server, focusing on the extended functions based on the mixed stream service, such as single-stream recording, cloud broadcaster, etc. Through the above three parts, we will introduce the practice and optimization of Weibo in self-developed RTC in detail, hoping to be helpful to everyone.

Content outline:

1. Background introduction

2. Difficulties and challenges in RTC media service design

3. Introduction to Weibo RTC Media Service Design Scheme

f24bf35ee6c6280a2ef5817a49c9dbbc.gif

↓ Click "Read the original text" to sign up now!

Guess you like

Origin blog.csdn.net/vn9PLgZvnPs1522s82g/article/details/127456119