(Basic logic of this article: Introduction to audio and video raw data analysis tools → Introduction to encoding data analysis tools → Introduction to package format analysis tools)
If a worker wants to do a good job, he must first sharpen his tools. In audio and video development, in order to analyze audio and video data conveniently, quickly and intuitively , it is best to have some visual analysis tools to help us. This article introduces common visual audio and video analysis tools.
1. Audio and video raw data analysis tools
1.1、Adobe Audition
Adobe Audition[1] is a professional audio editing and processing tool developed by Adobe, which supports multiple audio tracks, multiple audio effects, and multiple audio formats. It is natural to use it to analyze audio data in formats such as PCM and AAC.
Since PCM data is bare audio data and does not contain digital audio element attribute information, when opening a PCM data file, as shown in the figure below, it is necessary to specify the corresponding sampling rate, number of channels, bit depth, byte order and other information to Open correctly.
Adobe Audition
The following figure is the interface after opening the sample PCM audio data, and you can see the corresponding two-channel waveform:
Adobe Audition
Adobe Audition has very rich functions, and there is a lot of professional introduction information on the Internet, we will not introduce too much here.
1.2、YUVToolkit
YUVToolkit[2] is an open source cross-platform tool for playing and analyzing native YUV data. It has these functions:
-
Most YUV formats and RGB formats are supported. For example: I420, I422, I444, YV12, YV16, YV24, UYVY, YUY2, NV12, grayscale; RGB24, RGBX32, XRGB32.
-
Supports parsing image resolution, frame rate, color model from filename. For example: file name
test-640x480-30FPS-I420.yuv. -
Using Direct3D and OpenGL for rendering, it can support up to 720P, 60FPS, and simultaneous rendering of 4 videos.
-
It supports comparing images and calculating MSE and PSNR frame by frame, and visually displays the distortion.
-
Support for using Javascript. For example: you can use a script to open multiple files at once.
-
It can be extended with plug-ins to support more video formats, quality evaluation methods, and rendering engines.
The following figure is to play two YUV data, and compare and calculate MSE and PSNR:
YUVToolKit
1.3、YUVView
YUVView[3] is an open source cross-platform YUV data playback and analysis tool developed based on QT. It has the following functions:
-
Most YUV sampling formats are supported. For example: 4:4:4, 4:2:2, 4:2:0, 4:4:0, 4:1:0, 4:1:1, 4:0:0.
-
Support bit depth 8-16 bit.
-
Support ITU-R.BT709, ITU-R.BT601, ITU-R.BT2020 color space conversion.
-
Chroma interpolation uses nearest neighbor or bilinear interpolation.
-
Chroma position and UV plane order can be freely configured.
-
Supports compressed YUV storage format.
-
Most RGB formats are supported.
-
H.265 (HEVC) files are supported.
-
Supports generating analysis data for video files and displaying them in superimposed layers.
-
Supports comparative analysis of differences between different files.
[Learning Address]: Advanced Development of FFmpeg/WebRTC/RTMP/NDK/Android Audio and Video Streaming Media
[Article Benefits]: Receive more audio and video learning materials packages, Dachang interview questions, technical videos and learning roadmaps for free, including ( C/C++, Linux, FFmpeg webRTC rtmp hls rtsp ffplay srs, etc.) If you need it, you can click 1079654574 to join the group to receive it~
The following figure shows the functional interface of YUVView:
YUVView
The following figure shows Luma Intra Direction on a HEVC code stream:
YUVView- Overlay Statistics
For more information, see: YUVView Introduction[4]
2. Coding data analysis tools
2.1、StreamEye
StreamEye[5] is a commercial media analysis software. Here are some of its functions:
-
Provides visual interfaces such as stream view interface, HEX view interface, pixel view interface, and information view interface.
-
Support reference files, image difference comparison, master-slave control mode.
-
You can view and analyze video stream information, image frame information, block information, flag bit information, DPB information and many other data.
-
Support H.264, H.265, VP9, AV1, VVC and other encoding formats.
The image below is a visualization of the decoded picture buffer (DPB) using the bar chart navigation, along with the details and representation of the blocks:
StreamEye: decode image buffer and block information
The following figure is a navigation using thumbnails, partitions and motion vectors to demonstrate the coding syntax structure:
StreamEye: Demonstrating Grammatical Structures
The image below is the SAO filter overlay, buffer analysis and visualization at the pixel level:
StreamEye: Pixel-Level Visualization
The image below is an ALF filter overlay, image overview demo:
StreamEye: Image Overview Demo
3. Package format analysis tool
3.1、MP4Box.js
MP4Box.js[6] is an online MP4 format analysis tool. It supports importing network video and local video, and can visually display the structure and data of MP4 Box.
The figure below shows the MP4 Box in a tree structure:
MP4Box.js
3.2、MediaParser
MediaParser[7] is an open source MP4 format analyzer with relatively simple functions. It supports displaying MP4 Box and node data information in a tree structure, and can also give data location information by Sample.
The following figure is the functional interface of MediaParser:
MediaParser
3.3、MediaInfo
MediaInfo[8] is an MP4 basic information display tool.
The figure below is the functional interface of MediaInfo:
MediaInfo
3.4、FLVParser
FLVParser[9] is a tool that can parse online FLV streams and output the Tag and detailed information of the FLV streams.
The following figure is the functional interface of FLVParser:
FLVParser
3.5、VLC
VLC[10] is an open source cross-platform multimedia player that can play most multimedia files and view media information.
The figure below is the functional interface of VLC:
VLC
3.6、Native HLS Playback
Native HLS Playback[11] is a Chrome browser plug-in to support direct playback of HLS/M3U8/TS streams on Chrome. In this way, with Chrome's Inspect/Network function, you can view the specific information of the HLS stream.
The following figure is the functional interface of Native HLS Playback:
Native HLS Playback
3.7、Play HLS M3u8
Play HLS M3u8[12] is also a Chrome browser plug-in to support direct playback of HLS/M3U8/TS streams on Chrome. In this way, with Chrome's Inspect/Network function, you can view the specific information of the HLS stream.
The figure below is the function interface of Play HLS M3u8:
Play HLS M3u8