Application of Technology in Great data IOT
If the person is an Internet connection, then the connection is matter of things, a variety of intelligent devices and sensors. The relative number of people, the number of smart devices much more, people are not online all the time, and intelligent networking device is transmitting data all the time, so things need big data technologies.
Application of things in big data technology, on the one hand is the big data storage and computing, on the other hand is the edge computing management. We look at things big data platform architecture.
1 . Intelligent gateway upload data through the message queue to the IOT large data platform, Storm and other streaming data acquired is calculated from the message queue engine, processing of the data in three aspects. After the data is written to convert to clean up large data storage systems. Call rules and machine learning model, to upload data to calculate if a certain trigger implementation of the rules, and will control the information sent by the device management server, intelligent gateway, and further control terminal smart devices. Real-time statistics and monitor the application of data sent to the application device for the user to view management. 2 .Spark other computing engine off timing of the write data storage system for batch calculation processing, the amount of full statistical analysis and machine learning, and updates the machine learning models. 3 The application can also be sent directly controlled by the device management command to the intelligent gateway server, smart device control terminal. This constitutes a typical IOT "end - cloud - terminal" architecture, wherein the two end devices and intelligent sensors are side, end, and application devices, and the cloud is large data cloud computing platform.
End sensor: real-time data acquisition, using a mobile data network upload the data to the intelligent gateway, the gateway smart preliminary data processing is calculated according to the rules and machine learning model, then the calculation results at the mobile terminal data network may send control smart device.
Intelligent Gateway: Because the sensor may be deployed in many places far away, but a huge number, it is impossible to directly access the sensor data cloud services is, but not all of the sensor data needs to be uploaded in real time cloud. So, there is a need for site management in the field of pre-sensor server. Intelligent Gateway is the distance field sensors recent computer.
Since the intelligent gateway is arranged in the IOT job site, and sensors very close, at the edge of the entire cloud, so the calculation on the smart gateway, also known as edge computation .