Massive unstructured data storage challenges, fir rock data objects stored perfect solution

"In the past few years, big data industry is more concerned about how to deal with the massive, multi-source and heterogeneous data, but we must recognize that these are just tip of the iceberg. Currently, structured data accounts for only 20% of the total amount of data, and the rest 80% are present in the form of files of unstructured and semi-structured data associated with unstructured data showing potential outbreak, object storage market in recent years to maintain strong growth, IDC expects the software-defined storage (SDS) market over the next five compound annual growth rate will reach 28.8%. "

Massive unstructured data storage challenges, fir rock data objects stored perfect solution

Forced had become the traditional IT architecture storage change "past tense" unstructured data

Today, many companies have realized that structured data is only a small part of the company that owns the data. And business information system for a large number of transactions, structured data analysis and statistical process control as compared to unstructured data has some specific and lasting value, that value is in sharing, retrieval, analysis and other use of the process generation and amplification, and ultimately have an impact on business operations and strategy.
Over the years, cedar rock data by IT research information on the hundred well-known customer finance, education, healthcare, manufacturing and other industries found that the number of unstructured data capacity, the file has already far exceeded the processing power of a traditional NAS storage , enterprise storage products from requirements to form "self-transformation" has become more urgent.
Meanwhile, IDC data show that in 2020, enterprise data overall will reach 44ZB, of which 80% of the data will be unstructured data (pictures, videos, archiving, and enterprise-level backup data), object storage market will reach 19.8 billion dollar, which also confirms the fir rock for object storage for future development trend of judgment from the side.
Rock in Sequoia view, software-defined storage will finance, education, health care and other traditional industries revolutionize IT infrastructure improvements, especially for large number of files, retrieve unstructured data imputation tone low extraction efficiency, traditional architecture demand elasticity can not be configured storage space and other issues will be completely changed.

During the service of a hospital in Shenzhen, Shan Yan found that electronic medical records, clinical image files (such as CT, X ray, ultrasound, high-precision motion pictures, etc.), non-core data imputation system, query and access to other issues become the biggest challenge faced by the traditional architecture.
For example, when making access to image data after the data archive offline, do not describe any metadata management, data lookup with the directory structure of the file system is very time consuming.

When the number of files reaching the one million medical records of nearly ten million, there will be a substantial decline in memory performance; and data on the hospital server still is an island state, storage resources and data between the server and not shared.

Of course, these problems arise not only in the medical industry, the education sector in traditional storage architectures encountered problems is also very prominent. Cedar Rock in the object storage architecture to build a university found that among the functions of the body of the University College of Information Systems and two relatively fragmented, and therefore very difficult in terms of system security and maintainability.

The School of Architecture, School of Media, Film Academy, Institute of Clothing Technology and other professional college will produce large amounts of unstructured data operations, such as CAD drawings, video works, graphic design, clothing samples, etc., scalable data storage space and storage security put forward higher requirements, it is necessary to be able to meet next in teaching, research and other locations that require data storage, but also to meet job submission, class data sharing, research and data analysis, retrieval and other diversified demand.
In addition, the banks, the securities industry in the ordinary course of business, customer identification, remote account opening video, scanned copies of contracts, call center voice, data and other business-related electronic documents is the most common of unstructured data.

The average file size from KB to MB or even GB level range, the last two years the volume of documentation showing rapid growth in the state. From the point of view of storage capacity, even these small files occupy more than 80% of the total capacity of the data financial institutions.

According to regulatory requirements, banking, securities, insurance and other financial institutions are required to implement zone "double record", that is its own financial products and consignment sales process of synchronizing audio and video products, "two recorded" implementation of the provisions will bring massive nonstructural data. These problems are so rigid traditional IT architecture has a deep sense of powerlessness.

Massive unstructured data storage challenges, fir rock data objects stored perfect solution

Object storage to center stage Angeles rock redefine a new standard in enterprise storage

With the shortcomings of the traditional IT architecture increasingly prominent, fir rock represented by a group of innovative storage vendors began to redefine the standard of enterprise storage. From inception in 2014, aiming it early rock fir object storage market and continue cultivating.

经过四年的快速发展,杉岩目前在全国范围内拥有近百家合作伙伴,业务范围覆盖政府、金融、运营商、教育、医疗、电力和制造等十余个行业,用户数据量部署总和超过100PB。

其研发的杉岩海量对象存储(SandStone MOS)已成为海量非结构化数据存储的主流解决方案,其在广发证券档案中心、武汉大学智慧校园云存储平台的成功应用得到了行业用户的广泛好评。

对于海量数据的存储问题,杉岩海量对象存储(SandStone MOS)解决方案采用去中心化分布式架构,同时利用软件定义的方式实现了单一名字空间条件下数百PB级规模的容量扩展,业务可以随时随地访问而不受数据存储位置的限制。

在提升海量小文件访问性能方面,SandStone MOS利用哈希计算实现了数亿级文件的高效访问。针对文件检索困难,SandStone MOS支持标签功能,文件存储时会自动设置标签,从而更好地与业务结合,满足高效检索。
比如,在银行业务场景下,当业务人员想要提取相关视频音频文件时,可以根据文件标签进行检索调阅。

此外,SandStone MOS在易用性与可维护性方面也超越了同级别产品,其采用“x86通用服务器+存储软件”的分布式解耦架构,将底层存储空间与上层业务逻辑空间进行分离,软硬件的升级不会影响到整个系统的正常运行

即使系统有再多应用更新,也不会影响存储空间的使用。值得一提的是,SandStone MOS首创的分布式存储数据盘漫游功能,可以帮助企业用户渐进式的进行老旧硬件设备更换,不影响业务的正常运行

在对象存储领域的专注与持续创新,换来的是行业的高度认可。去年8月,杉岩数据成为首家通过Intel中国云计算创新中心测试并发布报告的软件定义存储厂商。

与此同时,杉岩数据作为国家信息化标准委员会云计算标准工作组成员单位及中国开源云联盟理事单位,先后参与了分布式存储国家标准的制定工作及Ceph行业白皮书的编写工作。

Today, the object storage being brought out more vitality, a storage revolution is on. Fir rock data represented innovative storage vendors, is by constantly cultivating object storage areas, to help companies build smarter IT infrastructure, promote the traditional storage towards a more efficient, more intensive, comprehensive evolution direction easier to use.

Guess you like

Origin blog.51cto.com/14636092/2467475