To Hadoop out of POC (proof of concept) stage, data governance is a major factor in its lack of data management for big data, especially in the face strict supervision of financial companies, is essential.
Last December, after financing a billion dollars, Hadoop platform for publishers Hortonworks recently announced that customers with Aetna, Merck, Target and SAS technology partners to cooperate to carry out data governance projects. The ultimate goal is to provide a higher standard of Hadoop data management, the Hadoop deeper into the enterprise computing.
To Hadoop out of POC (proof of concept) stage, data governance is a major factor in its lack of data management for big data, especially in the face strict supervision of financial companies, is essential.
Hortonworks director Andrew Ahn said the company and end-users together to create flexible rules engine, the data flow can be specified. The project developed software includes Apache Falcon lifecycle management, Apache Ranger security framework and the new policy rules engine, such as saving audit data store associated metadata.
Ahn familiar with the financial rules out big data. He previously worked at the New York Stock Exchange and Pacific Stock Exchange, engaged in application development. He said there are a lot of big data work by the "guardianship" of.
He said: "We have a serious problem between management and big data." He believes that companies need to meet the requirements of the US Securities and Exchange Commission. Large enterprises in the deployment of Hadoop is also facing similar challenges.
US Securities and Exchange Commission and other regulatory agencies, requires the company to save transaction history data. Although the Falcon system can set some policies, many companies still need to more advanced policy processes. Therefore, there is the new project.
Hortonworks expected, the software is expected to be released in the beginning of the quarter. The plan also required to submit proposals it is to become an official project of the Apache Software Foundation.
Highly recommended reading articles
40 + annual salary of big data development [W] tutorial, all here!
Zero-based Big Data Quick Start Tutorial
web front-end development based tutorial
Big Data engineers must understand the concept of the seven