Take the construction practice of EasyTwin digital twin fusion rendering engine as an example
EasyTwin digital twin fusion rendering engine is a low-code digital twin application development platform, which can realize entry-level B/S architecture digital twin application development with productization.
The EasyTwin architecture is divided into 4 layers, resource layer, rendering layer, function layer, editor layer, and the upper layer depends on the lower layer modules.
Resource layer: It is the bottom module of EasyTwin, which defines various data formats in EasyTwin. These resources provide the most basic data basis for the upper module, such as grid, material, and texture resources provide the rendering layer with the data required for model rendering. Animation clips and bones provide the animation system with the data needed for animation playback. Script files and state files provide the data needed for logical editing of entities and components.
Rendering layer: Provides 3D visualization capability for EasyTwin. This layer mainly relies on the rendering capabilities provided by Threejs, using PBR and shadows for realistic scene rendering, using post-processing technology to improve picture effects (anti-aliasing, color correction), using skinning technology to achieve character animation, and sprite rendering technology for POI rendering .
Functional layer: using component architecture to provide various functional components required in the development of the digital twin system. This layer implements twins and various functional components, and expands functions by mounting components to twins. For example, by mounting the model component to the twin, the twin has the ability to render the model; by mounting the script twin, the twin has its own code logic; by mounting the state component, the twin has the ability to edit the state.
Editor layer: This layer provides a GUI for scene editing, and can edit scenes directly through the visual interface, such as: model import, model position adjustment, scene import and export, resource management, and component editing.
The configuration function of EasyTwin can better solve the defects of pure code development and the development of twin scenes by packaging WebGL through the game engine supporting H5. On the premise of ensuring the rendering effect and scene performance, it can realize efficient development of scenes, rapid reuse and follow-up Low cost maintenance.
Take the material editing system, scene object state and data asset library as examples.
Material Editing System
The general Web3D project development process is that the modeler creates 3D models and model materials in modeling software (such as Blender), and then imports them into the Web3D engine for display. However, when the model is imported into the Web3D engine, the modeler will always find that the rendering effect and The preview effect in the modeling software is different. Modelers need to adjust parameters in the modeling software, and then import them into the engine to preview the effect, which is very inefficient.
There are many reasons for the inconsistent rendering effect. The most important factor is that the underlying implementation of the PBR material system of different engines is different, so the rendered images are also different. We use the same model and material, and the pictures are still different under different rendering engines. The picture below shows the rendering effect of the same model under three engines (Threejs, Babylon, Cesium). It can be seen that even if they are all 3D engines on the Web side, their rendering effects are different.
Figure 4 Rendering effects of different Web3D engines
In order to improve the work efficiency of modelers, EasyTwin opens the engine material system to the editor layer, allowing users to directly create material resources in the editor and adjust material parameters. In this way, after the modeler imports the model into EasyTwin, he can directly modify the material parameters of the model in EasyTwin, and then he can preview the final rendering effect, without having to go back to the modeling software to adjust the material parameters.
Users can adjust the PBR material parameters with an interface, and preview the material rendering effect in real time. At the same time, EasyTwin will also provide a rich material library. After the model is imported into EasyTwin, the material in the material library can be used to replace the material of the model.
scene object state
EasyTwin abstracts different states for objects in twin scenes, thereby simplifying the interaction between objects and other scenes.
Under normal circumstances, to achieve different styles of signage through external data, it is first necessary to create different styles of signage in the scene and record its unique value (id). By controlling the development of the signage, the style switching can be completed. When objects in the scene When more and more interactions, the cost of implementation will also increase dramatically.
However, if the method of object state is adopted, then it is only necessary to set different style states for this sign, and switch its state through the state list. Even if the interaction is complex, the interaction relationship between various objects in the scene can be clearly clarified.
More digital twin project consultation & free trial of low-code digital twin platform: Yizhiwei-EasyV digital twin | Smart city park factory water conservancy double carbon | 3D map data visualization big screen
digital assets
Digital assets include model libraries built into the engine, digital elements, and industry template libraries.
Model library: Contains various types of general equipment models and equipment part models, which can be quickly assembled to build target styles and effects in the form of assembly. By stacking and rotating transformations of various general models, a simulation consistent with the real production environment can be obtained. The high-fidelity restored business model supports the construction and development of 3D modeling business scenarios in the next step.
Digital elements: Provide commonly used digital elements, which can add various types of digital elements such as scatter points, information panels, flying lines, paths, fences, iframes, etc. in the 3D scene. At the same time, multiple sets of styles are preset for selection, and elements can be switched with one key style. In the digital elements, the spatio-temporal business data fusion can be realized through manual dots, three-dimensional coordinates (X, Y, Z), and latitude and longitude coordinates, and combined with real-time data to control the status of the corresponding digital elements, so as to achieve the virtual reality of the real world correspond.
Template library: The industry template library includes the digital restoration of the industry's medium-level core production indicators and production processes, high-fidelity restoration of the production environment and key detection situations, and realizes one-stop management of business scenarios through digital elements and professional special effects. Quickly build customer-specific digital twin scenarios to achieve the goal of reducing costs and increasing efficiency. The digital asset library of the digital twin visualization platform is rich in content and regularly updated. The latest industrial production equipment models and related twin models have been updated, and the link between the asset library and the digital twin visualization platform has been opened. use.
Project delivery based on the EasyTwin low-code digital twin fusion rendering engine mainly involves the following roles:
PM/PD：
Connect with Party A to determine requirements and provide prototype drawings;
Determine the reference picture for the effect presentation of each part;
Follow up changes in project requirements, and coordinate with customers and project implementation teams;
Visualization/UI Designer:
Produce design proposals and design drafts according to PM/PD requirements documents/prototype drawings/references;
Make the UI after the design draft is finalized;
Assist PM/PD to provide reference drawings to modelers;
Restore the 3D scene in the engine, and control the consistency of 2D to 3D art effects;
Modeler:
Provide customized models according to business needs;
Front-end development engineer:
Communication data format and data docking;
Cooperate with the designer to design the interaction mode of the screen and the scene, and complete the interactive configuration scene configuration;
Access data in EasyV and EasyTwin;
More digital twin project consultation & free trial of low-code digital twin platform: Yizhiwei-EasyV digital twin | Smart city park factory water conservancy double carbon | 3D map data visualization big screen