Data visualization Data storage is based on different needs, and there may be a lot of data to be crawled. At this time, the data needs to be saved for subsequent cleaning, analysis and statistical operations. Commonly used storage methods include database storage and file storage. Among them, using the database method to store data involves different database systems, and each database system is also very different and more complicated. If the amount of data is not large and statistical analysis is relatively simple, then file storage can be preferred. Next, combine the file operation and crawler knowledge learned earlier to store the crawled data and visualize it.
Significance of data visualization: As a kind of external memory, visualization stores information to be processed outside the human brain, which can supplement the limited memory of the human brain and help solve the problem of limited memory and attention of the human brain. At the same time, graphical symbols can direct the user's attention to important goals and can effectively convey information.
Traditional visualization methods can be roughly divided into two categories: exploratory visualization and explanatory visualization.
Exploratory visualization: In the data analysis stage, the information contained in the data is not clear, and it is hoped to quickly discover characteristics, trends and anomalies through visualization. This is a process of passing information in the data to visualization designers and analysts
Interpretive visualization: In the stage of visual presentation, based on known information or knowledge, they are communicated visually to the public.
The tasks of data analysis usually include: positioning, identification, differentiation, classification, clustering, distribution, arrangement, comparison, inner and outer connection comparison, association and relationship, etc.
Data Visualization Data Storage Learning Objectives
(1) Crawl data and store data in TXT, JSON, CSV, Excel files.
(2) Read and parse data stored in JSON format
(3) Use the JSON format data presented by the web page