The application of audio and video technology in the field of IoT (Internet of Things) has been in a state of continuous exploration and progress. From audio and video encoding and decoding to network transmission, we are witnessing the miracle of continuous reduction in latency.
With the advancement of technology, the development of smart hardware has become more efficient, and the production and consumption ends of content are also constantly upgraded. At the same time, we also see that client construction, service quality, and user experience improvements have become the focus of the industry.
In this topic, we will listen to the evolution and practice of RTC technology in the IoT field; and learn how to implement end-side mixed reality experiences on multiple sensors and achieve efficient audio and video playback in low-resource embedded devices. We can expect that with the continuous integration and innovation of IoT and multimedia technology, we will usher in more exciting industry changes and innovative applications.
01
The application practice of mixed reality images in the field of audio and video conferencing
Chen Yu
CTO of Shixi Technology
With the rapid development of the audio and video conferencing market, the demand for audio and video interaction continues to increase. As an important participant in end-to-side audio and video solutions, Vision Technology continues to deploy sensing and computing at the edge in order to promote a better conference experience, aiming to achieve a fast, stable and cost-effective experience in the mixed reality field.
This sharing will be divided into several parts. The first part introduces the progress made by Seexi Technology in improving audio and video quality on the device side. The second part introduces the mixed reality experience achieved by Seexi Technology on the device side through a variety of sensors. The third part introduces Shixi’s construction and prospects in the field of mixed reality imaging.
02
Wanjiaan RTC’s exploration and practice in the IoT field
Huang Cuiping
Wanjiaan RTC terminal R&D technical director
With the development of the smart home industry, the business scale of IoT for consumer ToC has exploded. Compared with traditional ToB products, ToC products are more complex and require higher hardware computing power and power consumption. Traditional ToB solutions trade off higher latency. The stable and complete transmission of the network will affect the user’s real-time communication experience.
ToC's IoT products need to transform to real-time communication in terms of network models, terminal low-latency and high-reliability transmission protocols, etc., to achieve a user experience without perceived delay.
03
A critical moment in the evolution of All Things Cloud RTC technology
Zhang proud
Chief Architect of Wanwu Cloud AIoT Product Department
The audio and video services of Wanwu Cloud satisfy 350,000 customers by providing real-time audio and video interaction capabilities for remote operations such as cloud scheduling, cloud access, and cloud customer service, and providing real-time audio and video interaction capabilities for edge-side local agent business services. Communication terminal call requirements. These communication terminals include law enforcement cameras, door stations, indoor stations, Black Cat No. 1, Black Cat No. 2, Pineapple No. 1, pass visitor machines, elevator 5-way intercom, Help Station APP and web agents (dispatch/customer service/pass ).
How to improve call quality and SLA, how to build automation tools and methods, and how to build stable and reliable RTC products through operational means to meet the real-time audio and video interaction needs of all parties' applications?
04
Implement efficient audio and video playback in embedded low-resource systems
Zhang Bingru
RT-Thread Community Technology Department Embedded Software Engineer
With the development of Internet of Things and artificial intelligence technology, the real-time demand for audio and video transmission and processing of embedded devices is increasing, which puts forward higher requirements for smooth and low-resource video encoding and decoding technology and hardware platforms. As the mainstream embedded IoT operating system in China, RT-Thread actively explores real-time, low-resource, and high-availability software and hardware integrated audio and video solutions, bringing more possibilities to embedded audio and video playback.
This speech will focus on the topic of achieving efficient audio and video playback in low-resource embedded devices. The sharing will be divided into three parts. First, it introduces the project background and hardware platform, and explains how to use hardware peripherals to accelerate processing and play audio and video smoothly on an embedded microcontroller with small memory. Then, the challenges and solutions faced during the implementation process will be discussed in depth from aspects such as protocol analysis, performance optimization, and resource tailoring. Finally, we share the technological breakthroughs and innovations in practice, as well as the actual benefits brought by the ultimately realized high-performance, low-power video playback system.
LiveVideoStackCon 2023 Audio and Video Technology Conference Shenzhen Station sincerely invites you to participate.
Time: November 24-25, 2023
Location: Shenzhen Sentosa Hotel (Jade Branch)
Inquiry: 13520771810 (same number on WeChat), [email protected]
