In recent years, remote sensing technology has developed by leaps and bounds. Multiple remote sensing platforms such as aerospace, aviation, and near space have continued to increase. The spatial, temporal, and spectral resolution of data has continued to increase. The amount of data has soared. Remote sensing data has become more and more characteristic of big data. . The emergence of remote sensing big data provides unprecedented opportunities for related research, but how to deal with these data also poses great challenges. Traditional workstations and servers have been unable to meet the needs of large-scale, multi-scale massive remote sensing data processing.
Represented by Earth Engine (GEE) and PIE-Engine, online visualization computing and analysis cloud platforms for global-scale earth science data (especially satellite remote sensing data) are more and more widely used. The GEE platform stores and synchronizes satellite images such as MODIS, Landsat, and Sentinel, climate and weather, and geophysics data sets that are currently commonly used in the field of remote sensing, exceeding 80PB. At the same time, it relies on millions of super servers around the world to provide sufficient computing power for these The data is processed. Compared with traditional remote sensing image processing tools such as ENVI, GEE has incomparable advantages in processing massive remote sensing data. On the one hand, it provides abundant computing resources, and on the other hand, its huge cloud storage saves a large amount of data download for researchers. And the time of preprocessing, the calculation and analysis visualization of remote sensing data represent the most advanced level in this field in the world, and it is a revolution in the field of remote sensing.
1. Platform and basic development platform
Introduction to GEE platform and typical application cases;
· Introduction of GEE development environment and commonly used data resources;
Introduction to GPT models such as ChatGPT and Wenxinyiyan
· Introduction to JavaScript basics;
· GEE remote sensing cloud important concepts and typical data analysis process;
· GEE basic object introduction, vector and raster object visualization, attribute viewing, API query, basic debugging and other platforms to get started.
2. GEE basic knowledge interacts with AI models such as ChatGPT
Basic image operations and operations: mathematical operations, relational/conditional/Boolean operations, morphological filtering, texture feature extraction; image masking, cropping and mosaic, etc.;
· Element basic operations and operations: geometric buffer, intersection, union, difference operations, etc.;
Collection object operations: loop iteration (map/iterate), merge Merge, union (Join);
· Data integration Reduce: including image and image set integration, image synthesis, image area statistics and domain statistics, group integration and area neighborhood statistics, image set linear regression analysis, etc.;
· Machine learning algorithms: including supervised (random forest, CART, SVM, decision tree, etc.) and unsupervised (wekaKMeans, wekaLVQ, etc.) classification algorithms, classification accuracy evaluation, etc.;
Data asset management: including local vector and raster data upload, cloud vector and raster data download, statistical result data export, etc.;
· Drawing visualization: including bar charts, histograms, scatter plots, time series and other graphic drawing.
GPT model interaction: Combine the above basic knowledge points with AI tools such as ChatGPT to conduct interactive demonstrations, including skills such as auxiliary question answering, code generation and correction.
Interactive demonstration of important knowledge points mini-case and GPT model
1) Landsat, Sentinel-2 images automatically remove clouds and shadows in batches
2) Combine Landsat and Sentinel-2 to calculate vegetation index and annual synthesis in batches
3) Statistical analysis of the number of available images and the number of cloud-free observations in the study area
4) Synthesis of annual NDVI vegetation numbers in China and search for the greenest DOY time of the year
5) Moving window smoothing of time series optical image data
6) Stratified random sampling and sample export, sample local evaluation and data upload to the cloud
7) Trend analysis of rainfall in China in recent 40 years
Case 1: Flood Disaster Monitoring
Based on Sentinel-1 radar and other images, the disaster-affected area is monitored by taking typical flood disasters as an example. The case content includes multi-source image data processing and the construction of different water body recognition algorithms, such as OSTU global automatic segmentation and local adaptive threshold method, and the use of different methods to determine the disaster area, disaster area statistics and visual output, etc.
Case 2: Flood Sensitivity and Risk Modeling
Combining spatial data sets such as ESA10m resolution land cover products, terrain (elevation and slope), MERIT global hydrological data, JRC surface water data products, etc., with the help of cloud platform to calculate the distance between different land types and open waters, the height above the nearest drainage system ( HAND) and rainfall frequency (a representative of rainfall intensity and duration) are used as input parameters for simulating flood sensitivity, and then the weighted linear combination WLC method is used to draw a flood sensitivity distribution map. The content involves reclassification and grading of different data products, Euclidean distance calculation, image set map cycle and analysis modeling, etc.
Case 3: Water Quality Monitoring
Combined with Landsat 8/9 and JRC surface aquatic products in the past ten years, use such as NDSSI normalized differential suspended sediment index, NDTI normalized differential turbidity index, etc. to monitor water quality changes in water catchment areas, and collect statistics on catchment areas Monthly water quality changes. The content involves time series image preprocessing, vegetation index calculation, monthly and yearly image synthesis, image set Reducer operation, null value filtering and mapping, etc.
Case 4: River profile monitoring
Demonstrate the application of Earth Engine to river hydrology and geomorphology. Specifically demonstrate how to use the cloud platform to distinguish rivers from other water bodies, perform basic shape analysis, extract the centerline and width of rivers, and detect changes in river shape over time. The content involves open source package calling, RivWidthCloud key code interpretation, time series image processing, water body remote sensing recognition and data export.
Case 5: Groundwater change monitoring
Using observations from the GRACE satellite to assess changes in groundwater storage in large river basins, including applying remotely sensed estimated total storage anomalies, land surface model output GLDAS, and in situ observations to resolve groundwater storage invariance. The content involves using GRACE to draw changes in total water storage, water storage trends, and solving changes in groundwater storage in river basins. The practice knowledge points include image set filtering, set Join, map loop, trend analysis, visualization, etc.
Case 6: Remote sensing mapping of mangroves
Combining Sentinel-1/2 multi-source remote sensing images and machine learning algorithms to draw mangrove distribution maps. Topics include optical and radar data processing, machine learning algorithm application, inversion accuracy evaluation, variable importance analysis, result visualization, raster and vector conversion, etc., and will demonstrate how to use mangrove habitat feature information (such as terrain, and sea Connecting, etc.) to fine-tune the classification results and realize the drawing of high-precision distribution maps.
https://link.zhihu.com/?target=https%3A//mp.weixin.qq.com/s%3F__biz%3DMzUyNzczMTI4Mg%3D%3D%26mid%3D2247652611%26idx %3D1%26sn%3D37819ba835f7eeae9ed54c47784d13a5%26chksm%3Dfa77ca3ecd004328507d0e39c804eb09abf6a1092102dc3c5b13c4022f2fe0c98d4f48aef936%2 6token%3D1724138116%26lang%3Dzh_CN%23rdrecommended reading
Application and typical cases of GEE remote sensing cloud big data in forestry