FBEC Conference | Zhao Zhijie, CTO of Raycloud Technology: Infrastructure in the Metaverse Era - Real-time Cloud Rendering

The FBEC Future Business Ecosystem Link Conference was held on February 24, 2023 at the Sheraton Hotel, Futian, Shenzhen. The conference was guided by the Guangdong Game Industry Association and the Shenzhen Internet Cultural Market Association, and hosted by Gyro Technology.

The theme of the conference is "Moving Forward with Courage, Chasing the Light", with the perspective of "explorers" with forward-looking insights into the industry, and the journey of "light" as the main line, focusing on Metaverse, XR, games, e-sports, and digital marketing and other cutting-edge industries, presenting the cutting-edge achievements of science and technology in an all-round way, discussing the era and business issues, planning the future value of new technologies, new businesses, and new models, and joining the peers of the times to embark on the courageous way of chasing light under the new era of drama change!

FBEC Main Venue C: The Power of Belief - The FBEC Global Metaverse CEO Summit is co-hosted by the Management Committee of Wuhan East Lake New Technology Development Zone and Gyro Technology, and Zhao Zhijie, CTO of Raycloud Technology, was invited to bring the theme "Infrastructure in the Metaverse Era - ——Real-time Cloud Rendering" wonderful speech. Zhao Zhijie believes that the future trend of Metaverse must be more and more refined and larger scene construction, which cannot be separated from the support of real-time cloud rendering technology.

01 One of the supporting technologies of Metaverse is real-time cloud rendering

I am Zhao Zhijie from Raycloud Technology, and today I will share with you my insights on real-time cloud rendering.

Our point of view is that one of the supporting technologies of Metaverse is real-time cloud rendering . The future trend of the metaverse is definitely more and more refined and larger scene construction. How to support the realization of these things is inseparable from the support of real-time cloud rendering technology.

Before talking about real-time cloud rendering, let's talk about the concept of rendering. At present, rendering is inseparable from our life. Regardless of film and television works, or the realization of various games, rendering technology is inseparable behind it. In the past, the rendering process was usually deployed locally. When the rendering process is deployed in the cloud, we call it cloud rendering. In the current trend, we hope that cloud rendering capabilities will become stronger and stronger, which can make up for the low performance disadvantages of lightweight terminals.

Regarding the recently popular AIGC, AIGC is actually a way of rendering. Through this method, it will enhance the sense of reality and high-level experience we experience in the metaverse, and enhance the experience of the metaverse.

In the Metaverse, people can switch identities at any time and perform various operations in it, whether it is studying, or working, making friends, shopping, traveling, etc. In order to achieve a better experience and better image effects, we need the support of a better cloud real-time cloud rendering service system.

02 The development of real-time cloud rendering technology depends on the following aspects

Real-time cloud rendering technology can reach the current level of development, which mainly depends on the improvement and promotion of the following technologies:

•  In the 5G era , the 5G network brings the introduction of technology;

•  The development of cloud computing provides better scalability for cloud computing, and users can obtain better and more unlimited resources through the network.

•  The development of the game engine not only has a huge driving effect on the game industry itself, but also brings users a better experience in terms of authenticity and simulation. Therefore, the basic development of the game engine also greatly promotes the entire technology.

• There is also the development of graphics card technology , which is also inseparable for applications in all industries.

03 Principles of real-time cloud rendering technology

The principle of real-time cloud rendering technology is very simple . When we use mobile phones or lightweight terminals to operate, in general, its application size and screen effects are limited. For example, if we want to see a very realistic virtual human with hundreds of thousands of hairs on a mobile phone, it is impossible to achieve real-time rendering with the computing power of mobile phones and Pads.

Regarding how to achieve high-quality rendering and large-scale scene output on lightweight terminals such as mobile phones, our idea is to deploy heavy computing power related to graphics and images in the cloud. With the help of high-performance servers, the cloud can perform heavy calculations of graphics and images on the cloud . After the real-time rendering of the cloud is encoded and decoded, it is then transmitted to various terminals through the network, except for mobile phones and tablets. Including VR equipment, etc., which solves the problem of insufficient computing power of lightweight terminals.

04 Features of Raycloud Technology's real-time cloud rendering technology

First of all, it depends on the operating platform of the application. No matter what the application is, the platform needs to be hosted on the cloud rendering platform first, and the real computing nodes on the platform can call the application in real time on the computing platform and run it in real time.

Second, real-time cloud rendering integrates leading SaaS services . Log in to our website and experience SaaS services with only a few simple steps. The process is very simple.

Third, rely on independent research and development agreements. For some large-scale development projects, using today's mainstream engine software, the package size becomes larger and larger, from hundreds of megabytes to tens of gigabytes. When the application needs to be uploaded to the cloud, the transmission speed will be limited. bottleneck. And through our self-developed protocol, the upload process can be greatly accelerated, and a 10G file can be uploaded in a few minutes . In addition, our protocol can be accessed through a browser, which is very convenient for sharing. You can push it to users through WeChat and applets.

05 3DCAT technical advantages

Next, let’s briefly talk about our technical advantages, including: supporting various engines, adapting to the WebRTC protocol, supporting the provision of multi-standard, adaptive stream capabilities, etc.

We have an industry-leading scheduling function, and also support multi-system platform scheduling, and support flexible setting of scheduling policies . We now use different cards to match the corresponding task performance. For example, Unity applications do not have high requirements for graphics cards, and 1660 can meet them, while some applications have higher requirements for graphics cards, such as Pascal, etc. At this time, we can specify different applications and different types of graphics cards. And can also provide a browser to monitor and manage the background.

06 3DCAT is divided into two versions: public cloud and private cloud

Regarding real-time cloud rendering, we have our own brand called 3DCAT , which is divided into two versions: public cloud and private cloud.

The architecture of the public cloud is relatively simple. The bottom layer is X86, which is attached with a self-developed streaming system. After logging in to our website and registering, it only takes a few steps to complete. This principle determines that our compatibility with terminals is particularly good, whether it is a mobile phone, a tablet, a PC, or even a VR headset, it can be output in the same way. In addition, we also support WeChat, Mini Programs, etc.

In order to allow users to have a better experience, we have established a variety of edge computing nodes in China . When users have requests, the system automatically judges and calls the computing center closest to users to provide users with a better network services, reducing user delays and waiting.

Whether it is resource costs or services, we have corresponding advantages, because we have provided cloud rendering-related services for more than 10 years, and we are more guaranteed for application security. For example, when browsing some 3D online data on a mobile phone, it will be cached to the local terminal. From the perspective of security, the security of real-time cloud rendering will be much higher. We have also passed TPN certification, and we are one of the few domestic manufacturers with TPN certification.

Advantages of our program include:

•  Cloud deployment : everything is deployed in the cloud;

•  Global support : In addition to providing platforms, it also provides integrated solutions from application production to distribution;

•  All things can be managed in a unified way : in the past, to install or run interactive applications, you need to install and run them one by one, but now you can manage all the applications in a unified way, such as after an upgrade or content replacement, all When the user opens it again, it will be a uniformly updated screen;

•  Combination of terminal and cloud : All complex calculations are concentrated in the cloud, and the lightweight terminal becomes a receiving tool, so that the terminal configuration requirements can be reduced;

•  Simple operation : all operations are very convenient and can be realized in just a few steps;

•  Data security : content is stored in the cloud, data is separated from users, effectively protecting intellectual property rights, and the platform has obtained TPN authoritative certification

In addition to the public cloud just mentioned, we also provide private cloud solutions. The private cloud solution is especially suitable for units with very high security requirements, such as military units, or scenarios with relatively high performance requirements, such as VR headsets . For the same content, flat applications do not have high bandwidth requirements, but VR headsets have relatively high bandwidth requirements. Generally, the push stream bit rate can reach 40-60 MB, so the privatization solution is also particularly suitable for performance. Scenes with relatively high requirements.

07 3DCAT has rich implementation cases

Finally, let me talk about the cases we have landed. One is Matterverse (dimension leap), which can also be opened on mobile phones through real-time cloud rendering. Through cloud rendering, it can perform various interactions and realize various operations of virtual characters.

We also have some experiences of our own with the popular digital people . The current trend is to go in a more and more realistic direction, but with the current computing power of mobile phones, it is not easy to create a very realistic digital human, and we can push this picture to the mobile terminal in real time through real-time cloud rendering .

There is also a case in the automotive field. We have cooperated with Audi accordingly . With the help of real-time cloud rendering technology and even ray tracing technology, we can achieve real-time interactive high-precision image output.

The cases mentioned above are all running on the real-time cloud rendering platform. I hope that more and better applications can run on our platform in the future. Thank you!

Text source: VR Gyro

​ The content of this article "FBEC Conference | Raycloud Technology CTO Zhao Zhijie: Infrastructure in the Metaverse Era - Real-time Cloud Rendering" is compiled and published by 3DCAT real-time cloud rendering solution provider. If you need to reprint, please indicate the source.

Guess you like

Origin blog.csdn.net/RealTime_3DCAT/article/details/130347113