Under the digital transition trend, enterprises how to implement data governance?

In the last one we talked about the business can be self-analysis products from Wing Hung service data sets, IT administrators how to manage the business people to analyze it?

Insurance for a class customer case
Wing Hung is a Insurance customers need business users to self-analysis, at the peak of more than 350 concurrent, enterprise IT management unit amount of data you want to query the size of priorities for management and control of all IT and operational staff and then let business users to self-analysis.

How do I set?

Because the property insurance companies have data stored in the Cloudera Impala cluster. The Insurance IT management department will be allocated according to the size of the amount of data each user, service type queue, and set the default query parameters detailed in the queue, especially mem_limit parameters and the maximum number of concurrent, so you can better limit the user's influence between, in order to avoid malicious users use to limit users to set up their own mem_limit parameters, as far as possible have to ensure the stability of Impala cluster.
1, the Impala database level, IT administrator or DBA can be set after the session establishment.

Set the queue limit

set request_pool = queue_it;

Queue corresponding to the user, after creating a data source connection (connection), the session may be provided by the change set request_pool = pool_name manner submitted request.

Set the maximum memory usage limit

set mem_limit=10G;

Set memory 10G (the amount of memory on a single node), impala often over resource estimate SQL statements needed, so it is strongly recommended that before executing SQL, SQL query using a set mem_limit limit memory consumption.

2, Wing Hung product settings

Providing session attribute set in the data source connection.

2 for different types of users, IT administrators set the desired allocation according to the data size, queue service type.

Under the digital transition trend, enterprises how to implement data governance?
Implementation steps:

Select Wing Hung source of product data, impala:

Under the digital transition trend, enterprises how to implement data governance?
After setting the connection information based Impala data source, the data source selecting attributes FIG advanced settings.

Directly queue_it in the queue name, and click Add Advanced Properties restrictions mem_limit = 2G.

As shown below, IT departments data source Impala_it, as follows:
Under the digital transition trend, enterprises how to implement data governance?

Companies want to implement advanced attribute data governance, Wing Hung Impala data sources to understand the next
data source Impala_finance finance department, as follows:
Under the digital transition trend, enterprises how to implement data governance?

Companies want to implement data management and control, advanced properties Wing Hung Impala data sources to understand the next
resource tree both stored on the data source, as shown below:
Under the digital transition trend, enterprises how to implement data governance?

Companies want to implement advanced attribute data governance, Wing Hung Impala data sources to understand the next
user Insurance sector (user_finance) corresponding to the selected data source directly in the production of data sets to query data.

Under the digital transition trend, enterprises how to implement data governance?
Above is about using advanced properties Wing Hung product introduction Impala data source, Wing Hung Technology powerful product features, not only to help companies implement data management personnel, but also so that more business people capable of self-analysis queries. About function Wing Hung product introduction, we will continue to update. Wing Hung want to experience the powerful data analysis technology can be a key to download Yonghong Desktop installation experience.

Guess you like

Origin blog.51cto.com/14637453/2466623