For many industries, tracking critical data generated in core production environments and work scenarios in real time is a necessary but challenging goal. Whether it is oil field production monitoring in the petroleum industry or vehicle communication and control in the field of Internet of Vehicles, the real-time collection, transmission, analysis and processing of data require the integration of multiple complex systems and the coordination of different data sources and equipment. This is a complex task that involves the design of system architecture, optimization of data flow, and guarantee of data security.
At the EMQX Enterprise 5.1 online conference held on August 31, EMQ introduced the major updates and improvements included in this version, as well as the application cases of EMQX Enterprise in various fields. EMQ engineers from home and abroad introduced the latest features of EMQX Enterprise 5.1 - a newly designed visual operation interface and data integration, a new architecture that significantly improves reliability and scalability, the next generation IoT transmission protocol MQTT over QUIC, and File transfer based on MQTT protocol. At the same time, two experts, Wang Weijiang from North China Oilfield in the petroleum industry, and Tang Zhiming from Zero-Shu Technology in the field of Internet of Vehicles, also discussed how they use EMQX Enterprise to innovate data and system architecture design in their respective industries to achieve better results. Efficient and more integrated data processing and application experience.
The following is a highlight review of the conference:
EMQX Enterprise 5.1 update highlights
The newly released EMQX Enterprise 5.1 version has updated the following important capabilities, which can be applied to different industry scenarios:
New Dashboard, one-stop cluster management and data integration: Li Guowei, product manager of EMQX Enterprise, introduced the design of the new Dashboard and the menu structure re-optimized for different user roles. While improving the visual experience, the new Dashboard has more convenient data integration capabilities and a more friendly visual user experience. At the same time, it organically combines cluster status monitoring, various functional configurations, and visual configurations of rule engines and data integration. Help users to quickly use EMQX to build IoT development and solutions.
The innovative Mria cluster architecture improves device access capabilities by 10 times: EMQ's software engineer in Sweden, Dmitrii Fedoseev, demonstrated the innovative self-developed Mria cluster architecture. The cluster scale of EMQX Enterprise 5.1 version has been greatly improved. A single cluster can support up to 23 nodes and carry more than 100 million MQTT connections. Compared with the current version, the access capability has been improved by 10 times. The Mria architecture also greatly improves the reliability and scalability of the cluster. Through the Core-Replicant node design, enterprise users can adjust the cluster size in real time according to business needs to flexibly expand business scale, or optimize operating costs according to needs.
MQTT over QUIC, the next generation IoT transmission protocol: William Yang, a software engineer at EMQ in Sweden, explained that EMQX has become the first groundbreaking product to integrate QUIC into the MQTT transport layer. This innovation effectively solves the problem of data transmission in weak network environments. For example, high-quality and stable message communication can be ensured in moving cars. As an important member of the OASIS standards organization, EMQ also actively promotes the standardization of MQTT over QUIC to provide more secure and efficient data transmission solutions in the Internet of Things and communications fields.
File transfer based on MQTT simplifies the IoT system architecture: Ilya Averyanov, a software engineer at EMQ in Sweden, introduced the extended functions developed on the basis of the standard MQTT protocol specifically for file transfer. This function not only unifies the IoT data transmission channel and simplifies the system architecture, but also reduces application complexity and maintenance costs. This function has wide application value in a variety of scenarios, such as supporting batch uploading of vehicle signal files in the Internet of Vehicles to achieve automated safety monitoring, or uniformly reporting diversified production equipment data in the Industrial Internet to achieve in-depth data analysis. , monitoring and optimization of production processes.
Oilfield digitalization, vehicle-cloud integrated data base
Smart oil field
Wang Weijiang, software director of the Science and Technology Information Center of the No. 1 Oil Production Plant of North China Oilfield, shared at the press conference how he uses various new data solutions to optimize the front-line production environment, personnel and cost management of oil.
From the perspective of the overall software architecture design of the first oil production plant, "EMQX is deployed in our production network. It is the core of the data in our production network. It is responsible for collecting data from well stations, pipelines, and hauling, and then processing it Processing, through MQTT and data persistence, distributes data for third-party consumption. At the same time, it can also bridge from MQTT to distribute and publish data collected from other systems. Third-party systems can receive it through subscription Data collected by other data systems.”
Teacher Wang Weijiang said that during the year and a half of cooperation, EMQ's project helped the No. 1 Oil Production Plant collect performance diagrams and operating condition data of 833 oil wells. The amount of oil well performance map data is huge, and 829 data points must be collected for one well. Combined with other data collection, such as cameras, oil pipelines, metering points, etc., the project collected a total of more than 700,000 points. At the same time, through this project, the No. 1 oil production plant also established its own cloud collection platform to effectively improve the real-time nature of the business.
Teacher Wang hopes to use various new functions of version 5.1 in the future, such as file transmission based on MQTT, to achieve all-round monitoring of oil field production, such as collecting the voiceprint, operating status, and alarm pictures of field equipment. He also hopes to improve the two-way data collection capabilities and improve the application effects of the oilfield production monitoring platform and production command and management platform based on time series databases. It also enhances visual orchestration rules and processes data flows, making data integration more intuitive and the open process more convenient.
Car and cloud integrated
Tang Zhiming, the head of R&D of the basic platform of Zero Beam Technology, shared how he uses EMQX to build a data connection channel for the Internet of Vehicles.
The channel first connects to the T-Box devices (remote information devices) in the two car brands of Zero Beam Service: Zhiji and Feifan; then, the obtained information flow is distributed to the EMQX cluster through load balancing, and EMQX has a built-in rule engine Messages will be delivered to different targets according to business rules to achieve data filtering and routing; after that, the messages are bridged from EMQX to Kafka for data storage and transmission; finally, these data are connected to the business system for various processing. These systems may include remote control, remote diagnosis, OTA updates, SOA services, etc. Throughout the process, operation and maintenance personnel will also use monitoring tools (such as Prometheus and Grafana) to track the cluster performance and status of EMQX.
Today's trend of automobile intelligence and electrification has put forward higher requirements for the underlying software system of automobiles, said teacher Tang Zhiming. As the number of vehicles continues to grow, the Internet of Vehicles platform faces several major challenges: as vehicle sales increase, how to maintain stable, high-concurrency connections for a large number of vehicles and computers; how to ensure that messages are transmitted in an unstable network environment while the vehicles are moving. Real-time and reliable transmission; how to achieve flexible data offloading and storage based on different data requirements on the business side; and how to ensure the security of data and connections in all processes.
In the future, Mr. Tang also hopes to use the MQTT over QUIC protocol to speed up the upload and download speed of remote vehicle software upgrade files, as well as other 5.1 new features, to improve the data channel of the Internet of Vehicles.
Next-generation IoT transport protocols drive data intelligence
The newly released EMQX Enterprise 5.1 introduces several important capabilities: MQTT over QUIC IoT transmission protocol for unstable networks, device access capabilities for larger clusters, large file transfer solutions based on the MQTT protocol, and more convenient data Integration capabilities and friendly user experience; these capabilities can be applied to different industry scenarios.
Since its establishment in 2017, EMQ has served more than 500 corporate users in more than 50 countries around the world, including more than 50 of the world's top 500 companies. Help enterprises achieve digital, real-time, and intelligent transformation. At present, the company's products are widely used in scenarios such as Internet of Vehicles, Industrial Internet of Things, AIoT, petroleum and petrochemicals, energy and electricity, providing IoT edge computing, cloud intervention, and all-round support and guarantee for more than 250 million IoT terminals around the world.
Combining its deep technical expertise in the Internet of Things and data transmission and its understanding of various external industries, EMQ believes that by solving the data pain points of various industries, data will no longer be just a number, but a path to a broader vision, allowing Every industry decision-maker has a more comprehensive understanding of their own production environment, allowing them to make more informed decisions.
Welcome to scan the QR code on the poster below to download and try out the new version of EMQX Enterprise 5.1 :
