In October 2022, the latest technological achievement of the openKylin community Virtualization SIG VirtIO-GPU hardware video acceleration mechanism hardware decoding function has been recognized by the international open source community, filling the technical gap in the field of virtual graphics card video hardware decoding in the upstream international open source community.
Recently, under the efforts of the Virtualization SIG group, the VirtIO-GPU hardware video acceleration mechanism has realized the hardware encoding function of H.264 and H.265, and has been reported and publicized by the international news phoronix, and has received extensive attention from the international media. At present, the technology-related patches have been merged by the upstream open source projects of Mesa and Virglrenderer, and will be released in the Mesa 23.0 version next quarter.
Related news link: https://www.phoronix.com/news/Virgl-Encode-H264-H265
Technology Introduction
At present, with the vigorous development of mobile Internet technology, live video, video chat, short video, etc. have been fully integrated into everyone's life. However, in virtualization fields such as cloud desktops, video encoding is generally software encoding, that is, it is completely processed by the CPU, and its performance has always had a serious bottleneck.
In order to solve the above problems, openKylin Virtualization SIG adds hardware video encoding function to Virtio-GPU , which can enable the virtual machine to perform hardware video encoding with the help of the graphics card on the physical machine side, greatly improving the video encoding performance of the virtual machine, thereby improving users' performance in live video, Use experience in scenarios such as video chatting and video editing.
Current Progress
Currently, the Virtio-GPU hardware video acceleration framework supports the decoding and encoding functions of H.264 and H.265 video specifications (only supports YUV420 image format), and does not support video specifications such as VP8/9:
For the decoding function , Virglrenderer has been integrated in version 0.10.1 and later, and Mesa is expected to be integrated in the official version 22.3.0. For the encoding function , Virglrenderer is expected to be integrated in 0.10.4, and Mesa is expected to be integrated in 23.0.0. details as follows:
In addition, the openKylin community has completed the integration of patches in Virglrenderer, Mesa, qemu and other warehouses before the upstream community, and related functions are expected to be released in openKylin 1.0 . At the same time, aspiring partners are also welcome to join the openKylin community Virtualization SIG to communicate, develop and evolve together with everyone, and build openKylin community system virtualization technology.
- openKylin community Virtualization SIG:
- https://gitee.com/openkylin/community/tree/master/sig/Virtualization
- Virglrenderer project patch:
- https://gitlab.freedesktop.org/virgl/virglrenderer/-/merge_requests/940
- Mesa project patch:
- https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/18831
Innovation is endless and technology leads the future. openKylin, as my country's first desktop operating system root community, will accelerate technological collaborative innovation, continue to participate in international open source community exchanges and cooperation, further enhance its influence in the international open source technology community, and build a technical voice .
The openKylin (Open Kylin) community aims to take "co-creation" as the core, on the basis of open source, voluntariness, equality, and collaboration, to build a partner ecosystem with enterprises in an open source and open way, and to jointly create a top-level desktop operating system community. Promote the prosperity and development of Linux open source technology and its software and hardware ecology.
The first batch of council member units in the community include Kylin Software, Puhua Basic Software, Zhongke Fangde, Kylin Principal, Meditation Software, Yiming Software, ZTE New Fulcrum, Yuanxin Technology, China Electronics 32, Jide System, Beijing Lin Zhuo, Advanced Operating System Innovation Center and other 13 industry colleagues and industry organizations.
Review: openKylin