[Special Express] MD-VQA, AB experiment, audio and video quality construction and application on mobile phones

  //  

How can we better optimize QoE? What are the challenges of audio and video technology on the user side? On July 29th, LiveVideoStackCon Shanghai Station QoE and Data Drive Special Session will answer your questions.

QoE and data-driven

In audio and video applications, a large amount of data reported by users has been obtained, including but not limited to audio and video quality data, user behavior data, etc. What kind of conclusions can these data provide us? How to establish a relatively complete evaluation system based on these data, and define and quantify the corresponding indicators. What kind of indicators can measure the quality of audio and video systems well? And what indicators can reflect the real feelings of end users? How to continuously optimize according to key indicators?

Topic introduction

TOPIC1 "Success is also remarkable, failure is also remarkable - how to interpret AB experimental data scientifically"

Bingyan Xiaohongshu Experimental Platform Leader

AB experiments are an important basis for rapid iteration of companies based on distributed decision-making, and are also an important basic component for building a data-driven culture. The design of the AB experiment framework itself is not complicated, but the extended questions about how to interpret the experimental data and how to make experimental decisions often make users scratch their heads.

A typical example is that the indicators I care about do not rise very much, and the indicators that I can't beat fluctuate up and down. This sharing session will first introduce some basic principles of the AB experimental framework, then introduce the statistical hypothesis testing basis behind the interpretation of the indicator trend, and finally use some examples to illustrate the core point: how to use a design is not 100% accurate tools to draw valuable business conclusions.

This sharing session will introduce the principle of AB experiment splitting, and then use the experimental example of Xiaohongshu to iterate the client's super-resolution ability to specifically explain "why significance is needed to assist the interpretation of experimental indicators", "why purely relying on significance cannot be objective Interpreting Experimental Data in a Reasonable Way" and "How to Make Experimental Decisions Scientifically".

TOPIC2 "How MD-VQA Improves the Quality of Taobao Live Streaming"

Li Kai Taotian Group Senior Algorithm Expert

The industry's demand for quality evaluation of UGC videos (including short videos, live broadcasts, etc.) is becoming stronger and stronger, while the academic world lacks credible evaluation standards. This sharing mainly introduces Taobao's self-developed multi-dimensional video quality assessment system (Multi-Dimession Video Quality Assessment).

Based on the characteristics of the human visual system, MD-VQA comprehensively considers the low-level perception of typical distortion types and the high-level cognition of content semantics from multiple dimensions, and combines motion information to represent the impact of motion on visual subjectivity, and then through the fusion of time and space To measure the absolute quality of the video. MD-VQA won the first place in the NTIRE 2023 video quality evaluation competition. At present, it has been fully applied to Taobao content business including live broadcasting and shopping, forming daily monitoring of large-scale image quality and detection of low image quality. The iteration of the enhanced algorithm helps to improve the quality of the content on the platform.

TOPIC3 "Audio and Video Quality Construction of Bixin Live Streaming"

You Guangxin Compassionate technical expert

With the business development of Bixin Live, the requirements for audio and video technology are getting higher and higher. Based on considerations of cost, stability, and quick response, the audio and video capabilities that Bixin Live relies on are gradually switched to self-developed , which requires continuous operation of audio and video quality. This sharing is mainly divided into two parts. The first part introduces the construction of Bixin Live Audio and Video Index Monitoring Market. The second part introduces the continuous operation of audio and video quality, and optimizes audio and video related performance indicators (pull stream establishment time, pull stream delay, freeze rate, etc.).

TOPIC4 "Application and Challenges of Audio and Video Technology on Mobile Phones"

Wu Hao Xiaomi Senior Software R&D Engineer

With the increasingly powerful functions of mobile phone cameras, the demand for 4k, 8k, and feature video shooting, editing, and playback is increasing. With the popularity of short video applications, a large number of short videos are downloaded to mobile phones for storage and playback. Simple playback can no longer meet the needs of the majority of users, and puts forward higher requirements for the audio and video technology of mobile phones. This sharing is divided into four parts: the first part introduces the current status of audio and video scenarios in the mobile phone industry and related challenges; the second part talks about resource occupation and experience challenges, and how to balance experience and resource occupation; the third part introduces the next part Common optimization ideas and solutions in the scenario; the fourth part introduces some future prospects.


3b4c022e5528c2a5d345b07ada9a5b2a.png

Scan the QR code in the picture or click " Read the original text " 

buy tickets now

Guess you like

Origin blog.csdn.net/vn9PLgZvnPs1522s82g/article/details/131566256