HMS Core graphics and image technology shows the latest functions and application scenarios, accelerating the construction of digital and intelligent life

[July 15, 2022, Hangzhou] HUAWEI Developer Day (Huawei Developer Day, HDD for short) Hangzhou Station kicked off. Today, with the continuous development of the digital economy, developers have more in-depth and diversified development needs for graphics and images. From virtual environment reconstruction to user interaction to visual presentation, developers have a complete demand chain for the digital world. In the HMS Core.Sparkle application innovation sub-forum, HMS Core technology and product experts and domestic industry developers discussed the current status and application of graphics technology. Huawei showed developers the latest HMS Core 3D Engine functions and AR Engine on Taobao. Extremely homey applications, VR Engine, 3D modeling services, etc., jointly explore the development path of mobile applications in the digital world.

Building the cornerstone of a 3D digital world

As the cornerstone of building a 3D digital world, HMS Core 3D Engine provides a real-time 3D engine with high performance, high image quality, and high scalability, as well as convenient and efficient visual development tools to help developers create high-quality 3D applications.

In terms of 3D rendering, it supports real-time global illumination, dynamic multi-light sources, and provides post-processing functions such as depth of field, ambient light occlusion, anti-aliasing, etc., to highly restore realistic light and shadow effects; the multi-dimensional particle system supports CPU/GPU particle rendering, which can simulate explosions, Natural scenes such as flames, rain and snow, and special effects such as swords, lights, swords and shadows; real-time skeletal animation, facial expression animation, animation redirection, and fusion of multiple animation state machines can achieve smooth 3D animation effects.

3D Engine can not only help to create cartoon virtual digital human, sign language realistic digital human and virtual stage effect, but also launched a new high-fidelity 3D GIS plug-in together with SuperMap, which can help 3D GIS to achieve higher definition and more realism through 3D rendering technology. digital world scene.

Virtual stage effects rendered by 3D Engine

Real and virtual seamless connection

HMS Core's technology in AR (Augmented Reality) and VR (Virtual Reality) has also contributed to the construction of the digital world.

HMS Core AR Engine provides the key algorithm of virtual-real fusion, which solves the three problems of coordinate unification, scene unification, and camera unification, so that virtual objects can be placed in real scenes. In terms of AR capabilities that help virtual-real integration, such as motion tracking, environmental tracking, and human and face tracking, technical indicators have been improved. After Taobao Jiyoujia integrates AR Engine, it has AR measurement function. Using high-precision environmental SLAM technology, mobile phone scanning can easily build a house environment. As of June 2022, AR Engine has become the world's top 3 mobile device AR development platform, with 1.7 billion installations, 2,800+ active third-party applications, and 120+ models covered.

HMS Core VR Engine , together with XR devices, Harmony OS, and content platforms, builds the ecological foundation of the XR world. VR Engine is a platform for Huawei VR content developers. Developers use Huawei VR SDK for development. After the development is completed, it is uploaded to the Huawei VR App Store. After approval, consumers with Huawei VR glasses can directly purchase and download the application content. The main hardware form of HUAWEI VR is VR glasses and Huawei series mobile phones. After the VR glasses are connected to the mobile phone, the mobile phone VR application runs through the integrated VR Engine. For example, Huawei's VR Glass integrated with VR Engine has won many awards at home and abroad after its launch. Users can connect to different products through a pair of glasses, and can also support mobile phones, PCs, and clouds across platforms.

Helping 3D animation production and sign language barrier-free communication

In terms of 3D animation production, the HMS Core 3D modeling service has newly opened the automatic bone binding function, that is, based on AI technology, it can give motion capabilities to bipedal humanoid 3D models. The automatic bone binding function has the advantages of high automation, super robustness, and excellent skinning effects. For example, multiple images of bipedal humanoid objects are captured by ordinary mobile phones to achieve high-precision modeling; One-click driving can be achieved through mainstream engines in the industry. If the 3D modeling service is combined with AR, more ways to play can be unlocked, such as letting the model walk into the real scene, and bringing the electronic pet to your sofa, bed, etc.

In terms of sign language digital human, on the basis of enhancing hand-controlled actions, HMS Core sign language service endows sign language digital human with non-hand-controlled features, including posture, facial expression and mouth shape, which are closer to real sign language actions and significantly improve the overall availability of sign language. intelligibility. At present, the sign language service is open to high-frequency scenarios such as media content production, education and learning, and daily communication.

With the development of graphics technology, which is an important part of building the 3D digital world, the boundaries between the virtual world and the real world will gradually blur. HMS Core helps developers take the road of future application development and empowers more applications to enter the digital world. the world, and jointly promote the prosperity of the digital ecology.

Learn more details>>

Visit the official website of HUAWEI Developer Alliance
to obtain development guidance documents
HUAWEI Mobile Services Open Source Warehouse Address: GitHub , Gitee

Follow us to know the latest technical information of HMS Core for the first time~

Guess you like

Origin juejin.im/post/7120537930703044621