Weekly, overview the dry goods in the field of audio and video technology.
News contribution: [email protected].
transporting network
6 reasons why real-time 5G live video streaming is essential
As discussed in detail in the blog recently, trends in video-centric social activities, immersive entertainment, education, telemedicine, etc. make the network's support for the rich personal experience of real-time video a feature of the new era of cyberspace. From dispersed labor input to video surveillance, to immersive collaboration in engineering design, construction, training, surgery and other aspects, real-time video transmission is also becoming an important part of various applications in business life.
https://www.red5pro.com/blog/6-reasons-real-time-5g-live-video-streaming-is-essential/
Introduce XDN (Experience Delivery Network)
The ubiquitous video on the Internet has brought us into a transition point, and the support for real-time video interactive experience has begun to define the next era of online participation.
https://www.red5pro.com/blog/introducing-xdn-experience-delivery-network/
Android
Count down those major official updates to Android in 2020
Unknowingly, 2020 is coming to an end. Although there are many difficulties this year, the Android community’s enthusiasm for updating has not diminished. At the same time as the Google I/O conference was cancelled, the official also provided us with a series of high-quality programs: Now In Android[1], Kotlin Vocabulary[2], 11 Weeks of Android[3]. This article will take you to take a look at the latest developments related to Android since this year, and try new features that we can use in the future.
https://mp.weixin.qq.com/s/bh-lI7Ue5x_LmSfZBg_Hsg
Codec
Overview of AV1 ecological status
AV1 (Alliance for Open Media Video 1) is a new-generation video coding standard released by the AOM Alliance (Alliance for Open Media) in June 2018.
https://mp.weixin.qq.com/s/NK2KFfGRD7zfEjANhn2LIw
JPEG Pleno image coding technology
This article is from ICIP2020. The speaker is Dr. Cristian Perra from the University of Cagliari, Italy. The topic is JPEG Pleno image coding technology.
https://mp.weixin.qq.com/s/kybALVa3OQ3imwuhwzDweA
Fraunhofer Multifunctional Video Decoder (VVdeC)
Fraunhofer Multi-Function Video Decoder (VVdeC) is a fast implementation of VVC x86 software decoder. The decoder supports most of the standard functions available in the Main10 profile, but support for some advanced functions still has to wait.
https://github.com/fraunhoferhhi/vvdec
Tencent open sourced the first domestic H.266/VVC video player
The open source of Tencent O266player is not only another important milestone in the development of Tencent's video codec technology, but also an important layout for Tencent to promote the continuous evolution of the multimedia technology ecosystem. In the future, Tencent Multimedia will unite various industries to export the latest technology to the industry through standard formulation and product development, and provide new technical assistance for the construction of digital industries.
https://mp.weixin.qq.com/s/FiLF9b_m8COjahN8aKg9Nw
Video codec standard system at home and abroad
Regarding domestic and foreign video codec standards, the typical standard organizations or alliances involved include MPEG, ISO, ITU, AOM, AVS, etc. From the perspective of the codec system, the existing standards organizations can be roughly divided into three camps. This article will talk about the evolution of MPEG, ITU, AOM, and AVS.
https://mp.weixin.qq.com/s/yNmKDUtDrNtkZgP_RHjwfw
ICIP2020: Analysis of the complexity of VVC intra-frame coding
This article comes from the ICIP2020 paper "COMPLEXITY ANALYSIS OF VVC INTRA CODING".
https://mp.weixin.qq.com/s/-5YvoR2vRuzIqCLS_pK9Jg
Audio and video technology
The road of "cloud-in-one" smart media production and speech production
In the link of smart media production, production is the core and intelligence is the auxiliary. So how does AI technology integrate into the entire production process? Zou Juan, senior technical expert of Alibaba Cloud Smart Video Cloud, gave a detailed explanation on the technological evolution of smart media production and production in a speech at LiveVideoStackCon 2020 in Beijing.
https://mp.weixin.qq.com/s/E0AHuqT9IfkgNvrwst-bdA
Q audio live broadcast compilation optimization and binary integration scheme
Q Audio Live is extracted into a pod library and introduced into two independent apps, QQ Music and Fan Live. For live broadcast services, the live broadcast SDK is locally introduced and integrated into the Demo through the pod for daily live broadcast business development, and is streamlined through Demo Project scale to improve research and development efficiency.
https://mp.weixin.qq.com/s/5q_PLdLeuuuQnsLrbzaOeQ
Large-scale multilingual audio and video dubbing
Realize automatic language translation corresponding to lip sync.
https://arxiv.org/abs/2011.03530
Real-time audio and video help online education outlets
The full name of TRTC is Tencent Real-time Audio and Video. It is a cloud service provided and sold on Tencent Cloud through SDK and REST API. Jiang Lei, product architect of Tencent Cloud TRTC client, will start from the changes in the online education market under the influence of the epidemic, and introduce the pits and pit fillings in the real-time audio and video practice process and some new attempts.
https://mp.weixin.qq.com/s/2XMYXVxoeIJ0irl9R-FPtg
Mainstream VR headset FOV measured: very different from official data
In order to compare the actual FOV of 15 VR headsets, VDC (Virtual Dimension Center) in Fellbach, Germany used a special head model to conduct simulation measurements. It was found that the Pimax 8K field of view angle of 15 headsets reached 141.5°. The Pico G2 field of view is only 78.5°, and the actual FOV look and feel of almost every headset is different from the official specifications.
https://mp.weixin.qq.com/s/RfTcHLeebTMYMDvQ2SQ7Fg
AI intelligence
The improved version of YOLO V4 Tiny is here! Speed 294FPS without loss of accuracy YOLO V4 Tiny (with paper download)
In order to improve the real-time performance of target detection, this paper proposes a fast target detection method based on YOLOv4-tiny. It first uses the two ResBlock-D modules in the ResNet-D network instead of the two CSPBlock modules in Yolov4-tiny, thereby reducing the computational complexity. Secondly, an auxiliary residual network block is designed to extract more object feature information to reduce detection errors.
https://mp.weixin.qq.com/s/fPlnMnwq2R-Pat5Jx1lFMg
algorithm
Key algorithms in large-scale live video broadcasting
With the stagnation of most sports events, concerts, festivals and other gathering activities in 2020, we will find that the potential demand for streaming media transmission to support large-scale events is huge in 2021. How will companies in the industry distribute real-time streaming events to meet these potentially unprecedented demands? A recent article published in Algorithm Series delves into the mathematics and workflow decision-making algorithms that adjust the delivery of large-scale real-time video events.
https://mp.weixin.qq.com/s/EB7lccvXhRvcxb7KNA_tGg
Activity recommendation
LiveVideoStackCon 2020 U.S. Station
The most original technology in the Bay Area, the most cutting-edge application practice in the world.
No need to travel across the ocean, we are waiting for you online!
Click [Read the original text] to learn more about the conference