Thinking program of industrial enterprise data service applications

I. Background

Industrial Big Data is the key to the future of the global industrial market competition. Whether Germany Industry 4.0, the US Internet industry is still the basis of the implementation of China's manufacturing power strategy, national innovation strategy of manufacturing industry are gathering and feature big data analysis, as well as a future manufacturing system to build a worry-free environment.
Committed to advancing the development of intelligent industry, strategic planning big data application service is a key part of the wisdom of the factory system. By recent exchanges with industrial enterprises, large amounts of data were accumulated value of the pre-MES refined into the direction of interest of many leading companies. At the same time, based on the business needs of mobile office, mobile applications for reporting statistics show the way and data analysis needs are very urgent. It can be said, big data analytics has an increasingly important role in the future of intelligent manufacturing planning, it is necessary to combine the current market demand for data services product development.

Two technical architecture

1, the target technology

① configurable and extensible: data acquisition, data analysis, and other task scheduling message push service should be based on the class profile manner corresponding function, scalable and flexible application of the system convenient.
② support multiple data sources: data collection should be required to support various types of source data source and target data according to business sources, including mainstream relational database.
③ friendly interface, high experience: simple mobile application APP to operate, attractive interface, graphic display should have some interactive features.
④ oriented programming interface: In order to ensure the independence of the system and open the system Yaoan interface standard function calls and function packages.
⑤ Data Security: Use a firewall and isolation mechanisms to achieve a one-way one-way transmission of data acquisition, industrial production data to ensure network security (collection terminal can access the Internet, Internet users can not access the collection terminal).

2, performance goals

① page response time of ≤2.5 seconds, the phone application operation response time ≤3 seconds.
② system throughput ≥600 (requests / sec).
③ system supports concurrent user count ≥200.

3, Technical Requirements

(1) the data source may be configured to
the task data source configuration mainly to achieve acquisition frequency, the configuration of the source data parameters, the target data parameter, the source table, the target table, a source field, a target field, etc., to achieve the configuration by designing the structure of XML documents storage.
(2) Data acquisition
data can not be too many data acquisition task is historical data collection tables in the configuration file, in order to ensure the efficiency of the source and target databases, each table each acquisition, with no more than 1000 for the when appropriate, collect additional data to the target database for each thread to sleep problems add 10 milliseconds to avoid large quantities of data added to the table a long time locked, causing time-outs and other retrieval operations suspended animation systems such as the impact of the experience of one.
(3) Data Synchronization
for customers to upgrade to SQL Server version 2008R2 or later, after the upgrade function to open the CDC library collection, collection of open tables tracking table. Then, read the trace table data synchronization procedure, the data table in the target sync operation. Since the function is log-based CDC, and therefore less impact on database performance, a practice which is relatively Microsoft's official recommendations, but there will be some upgrade risk (needs discontinued).

4, the structure of the background art system

Technical background service system architecture is shown in Figure:

① background service front-end implementation (EasyUI and Echarts): all the needs, back-office services for the front-end design background service system using Jquery-based front-end display packaging EasyUI open source framework and Echarts charts show the frame.
② front-access security implementation (Mesnac.shiro): Apache Shiro security framework for Java is a powerful and easy to use, provides authentication, authorization, encryption and session management capability, the application from the command line, web and mobile applications to large-scale enterprise applications any application to provide security.
③ phone APP interface (Mesnac.Webservice): JAX-RS is a new technology introduced in Java EE6. JAX-RS that is Java API for RESTful Web Services, is an application program interface to the Java programming language that supports transfer (REST) architectural style create Web services in accordance with Representational State. JAX-RS uses Java SE5 introduction of Java annotations to simplify Web services client and server development and deployment.
④ regular service implementation (Mesnac.quartz): Quartz open source job scheduling framework written entirely in Java, provides a simple yet powerful mechanism for conducting job scheduling in Java applications. Quartz allows developers to schedule jobs based on time interval. It implements the relationship between work and triggers many to many, but also the multiple jobs associated with different triggers.
⑤ phone APP service push (Mesnac.jpush): This project is using the push Aurora, is a personal APP for all developers, corporate developers an open, free of push messaging can be achieved through a simple API for each call APP kind of message distribution platform for mobile phones.
⑥ common operations package (Mesnac.Util): often use some external tools in the development process, and therefore the operation of these common base class library Mesnac.Util encapsulated in, for example, string parsing, to read the resource file, an external file read, XML parsing, JSON format parsing, IP acquisition and so on.
⑦ underlying business service implementation:
Mesnac.action: Struts is an open source framework, the purpose is to reduce the use of Struts MVC design model development time using Web applications. If you want to mix the advantages of using Servlets and JSP to build scalable applications, Struts is a good choice.
Mesnac.service: Spring framework is due to the complexity of software development created, Spring is using the basic JavaBean to do things may have previously only done by EJB. However, Spring is not limited to the use of server-side development, the vast majority of Java applications can benefit from the simplicity, testability and loose coupling from the perspective of Spring.
Mesnac.dao and Mesnac.model: Hibernate object-relational mapping framework is an open source, it had a very lightweight JDBC object package will establish a database table POJO and mapping relationships. It is a fully automatic ORM framework can automatically generate SQL statements executed automatically, so that Java programmers can use arbitrary object programming thinking to manipulate the database.

5, data services application APP technology architecture

App data service application technical architecture as shown below:

(1) Cordova
Cordova is a new name to the Apache Foundation PhoneGap take, history is the reason Adobe PhoneGap core code will contribute to the Apache Foundation, will now Apache Cordova as a top-level project to run. Cordova API provides a set of device-related, through this set of API, mobile applications with JavaScript can access native device features.
(2) AngularJS
AngularJS was born in 2009, created by Misko Hevery, who, after being acquired by Google, is an excellent front-end JS framework that has been used in a variety of Google products which, like Gmail, Maps, Calender and so on. AngularJS has many features, the most central is MVVM, modular, automated two-way data binding, semantic tags, dependency injection.
(3) Ionic
Ionic is a powerful HTML5 application development framework, AngularJS end mobile solutions can help developers to use Web technologies such as HTML, CSS and Javascript to build mobile applications near native experience. UI interactions ionic focused look and feel, as well as applications and is particularly suitable for the development of HTML5 mobile applications based on Hybird mode.

Three solutions application effect

通过大数据分析，工业数据服务APP对企业运营的全业务进行针对性的监控、预警、跟踪。大数据系统可以在第一时间自动捕捉数据变化，再以最快捷的方式推送给指定负责人，使相关人员在最短时间内获知生产信息。
本APP在收集生产和管理流程各环节的实时与历史数据后，将所有数据进行整合互联，然后基于商业理解对信息进行分类储存和分析加工，并与决策行为连接起来，帮助企业进行决策，减少失误，把握时机，实现了通过数据资源来创造商业价值。
本APP已在多个公司运行，效果良好。以某企业数据服务项目为例，APP从MES系统数据接口和设备PLC、传感器处进行数据采集，建立工艺参数分析算法模型，解决工艺分析过程中数据量大、分析不具体的问题，提高工艺调节水平；将快检数据与现场生产结合起来，形成报表，对比机台及班组差异；建立生产能力分析算法模型，总体分析计划、生产、合格率等情况，对整体满足情况全面分析，提供生产指导；建立原材料质量分析算法模型，提升质量应对水平，分析各原材料质量水平、选择合格供应商；建立胶料质量分析算法模型，提供CPK、PPK等分析控制图，并结合工艺、生产实绩进行相关性分析；实现了手机APP端的数据可视化展示。
此外，软控轮胎工业数据服务APP在应用角度，还具有以下特点：
①在一定程度上实现对MES等信息系统积累的历史数据的价值再提炼，通过大数据分析模型的建立所衍生的新功能，可以令MES增值10%以上。
② 解决了移动办公及异地管理中的数据统计和数据分析及时性问题。
 异地办公及管理效率提升20%。
 数据统计及时能力提升20%。
 提供报表定时推送能力（根据订阅情况推送）。
③ 提供了海量设备数据的存储机制，为建立数据分析模型及后期的设备诊断奠定基础。
 leased elastic computing power of cloud computing, combined with the large data processing technology, can be achieved on GB, even TB-level data for rapid processing device, which is an existing plant server processing power can not be done.
 through the device data analysis, equipment failure warning model, reduce equipment failure rate of 15%.
④ the establishment of product quality data analysis process, laying the foundation for an effective quality control model building. Through the establishment of quality control model, effective analysis of the factors affecting the quality, improve the quality control more than 10%.