Distributed GIS refers to the use of the most advanced distributed computing technology to process multi-source heterogeneous geospatial information distributed on the network, integrate spatial services on different platforms on the network, and build a physically distributed and logically unified Geographic Information System.
The SuperMap distributed GIS technology system includes distributed spatial data storage and management technology, distributed spatial analysis and processing technology, cloud native GIS technology and edge GIS technology, supporting the storage, management, analysis, and processing of massive classical spatial data and spatial big data , Visualization and release, to achieve a major breakthrough in the "five high and one large" of GIS in high availability, high concurrency, high flexibility, high performance, large capacity, and high credibility, and build a new distributed collaborative model of cloud-side integrated GIS .
SuperMap Distributed GIS Technology System
01 Distributed spatial data storage and management technology
In order to realize the unified management of multi-source heterogeneous spatiotemporal data such as natural resource supervision, aerospace remote sensing, navigation and positioning, SuperMap proposes a flexible and distributed spatiotemporal data integration model, which combines distributed storage systems to establish a unified data management engine. Improve the efficiency of data access and query, and can support the storage and management of PB-scale spatiotemporal data.
The key technologies of SuperMap distributed spatiotemporal data integration model include distributed spatial file system based on integrated model, distributed SQL spatial database, and distributed NoSQL spatial database. Among them, the spatiotemporal data in different storage formats are accessed through different SuperMap data engines, and the integrated model is used for distributed conversion, which provides complete basic support for subsequent distributed GIS software.
SuperMap distributed spatial data engine
For example, with the support of the SuperMap distributed spatial data engine, the HDFS data source can be directly opened in the SuperMap iDesktopX desktop product for data browsing and map mapping.
HDFS map mapping based on SuperMap iDesktopX
In the 10i (2020) version, SuperMap also introduced spatial blockchain technology to effectively ensure the quality and authenticity of geospatial data, and provide a new application model for spatiotemporal data with high security, traceability and high credibility.
The functional characteristics of the space blockchain cover SuperMap components, desktop and server GIS products, and the basic components of the space blockchain based on distributed ledger technology. It provides decentralized storage management for spatial data and is realized by the application of blockchain encryption technology. The anti-tampering of spatial data is improved. Supports the joint storage of blockchain spatial data Fabric and IPFS, supports spatial blockchain data query, editing, and historical tracing functions, and supports spatial blockchain map services, data services and data history services.
SuperMap space blockchain technology
02 Distributed spatial analysis and processing technology
In order to improve the efficiency of geospatial data processing, SuperMap proposes a distributed spatial computing technology of "distribution-parallel-coordination" in the field of geospatial information, which can support the processing and analysis of single-table billion-scale spatial data. The entire process time from storage to release of hundreds of millions of spatial data is reduced from several months to several hours. Compared with traditional spatial analysis and calculation efficiency, it is increased by 50 times, and it supports the rapid release and efficient visualization of super-large-scale spatio-temporal data.
As of version 10i (2020), SuperMap has supported more than 200 distributed spatial data processing tools, provided more than 70 distributed spatial analysis operators, and provided a kernel-level extended Spark spatial data model, in addition to its own basic data on Spark The model (RDD/DataFrame) is extended (FeatureRDD), and it also supports user-defined extensions to implement custom operators, complete data processing, spatial query, element connection, attribute statistics, buffer analysis, trajectory analysis and other common functions, as well as customers Customize other related functions.
Distributed spatial analysis and processing process
03 Cloud native GIS technology
In order to realize the high availability, high flexibility and ease of use of the GIS distributed computing process, SuperMap applies cloud native technology to distributed GIS products, reconstructs the distributed GIS service process based on the microservice architecture, and uses the container as the deployment carrier to achieve Automated orchestration and operation and maintenance management. This realizes the rapid batch deployment and elastic scaling of thousands of GIS microservices; through the effective and dynamic scheduling of GIS resources, it can quickly respond to emergencies and realize the optimal use of resources under the existing hardware environment; relying on the microservice architecture to realize GIS The system quickly expands horizontally, reducing system deployment time by 90%. Lay the foundation for the efficient construction and operation of large and complex distributed GIS systems.
• Support GIS functions to be split into microservices, which can be elastically scaled on demand.
• Achieve comprehensive microservices for map, 3D, big data, and AI functions.
• Support containerized deployment, providing GIS node rolling upgrade, elastic scaling and failure recovery.
• Support seamless upgrades, and support partial upgrades/rollbacks without service interruption.
• Provide Kubernetes-based general automated orchestration to realize real-time monitoring of all microservice resources.
• Add cloud native GIS to expand development capabilities.
Microservice topology diagram of distributed GIS site
In the 10i (2020) version, the GIS microservice package has been further split, and the package size, resource occupation, and startup speed have been significantly improved, making the cloud-native GIS lighter, finer, and faster, and improving the GIS System scaling efficiency.
04 Edge GIS Technology
Edge computing GIS technology refers to the use of various features of edge computing to support the various elements of GIS applications, including the release and distribution of GIS content, the proxy and acceleration of GIS services, and online analysis and calculation, in a more flexible way The way to use geographic information resources efficiently and cost-effectively. SuperMap provides the industry's unique edge GIS product-SuperMap iEdge, which supports the construction of cloud-side-end integrated application systems.
Edge computing GIS technology is an important supplement to SuperMap distributed GIS technology, involving several key capabilities:
• Edge front-end proxy: between the GIS cloud center and the client, proxy acceleration of GIS services, providing a better service access experience.
• Edge service aggregation: Aggregate GIS services from different sources and contents into one service to realize the integration of multi-source and heterogeneous geographic information and services.
• Edge content distribution: Cloud GIS center automatically distributes tile data to edge GIS nodes, realizing automatic update of edge GIS content.
• Edge analysis and calculation: GIS analysis and calculation are performed on-demand at the edge to effectively improve the performance of GIS services.
In edge analysis and calculation, maps can be rendered based on local data, PostGIS data and HBase data, and based on local data, PostGIS data and HBase data spatial query, attribute query, and perform measurement, coordinate conversion, spatial relationship, spatial calculation and other GIS Analyze and process operations, make full use of the capabilities of edge devices, and improve the overall analysis and calculation efficiency of GIS.
Edge GIS server
SuperMap distributed GIS breaks the limitations of traditional technology such as high concurrency processing ability, coarse calculation and analysis scheduling, low timeliness, low utilization of distributed node resources, inability to quickly and flexibly schedule, and high pressure on the GIS computing center. It is at the edge of the cloud. New achievements have been made in the multi-layer distributed spatial computing technology system, GIS microservices, distributed spatial engines, edge computing, etc., forming a full range of distributed GIS foundations from GIS core, server to browser, desktop and mobile The software form can effectively support the rapid customization and flexible construction of ultra-large-scale spatiotemporal data applications, and promote the application upgrade of basic surveying and mapping, natural resource planning, smart city construction, large-scale engineering project construction, resource and environmental management, national defense construction, emergency disaster reduction and other industries.