dss_linkis (dataspherestudio-1.1.1, linkis-1.1.1) expansion tool installation - data exchange tool Exchangis

Table of contents

Two data exchange tool Exchangeis installation

2.1 Dependent environment

2.2 Preparations

2.3 Exchangis installation

2.4 ExchangisAppConnInstallation


Two data exchange tool Exchangeis installation

2.1 Dependent environment

My installation environment is as follows, which is a little bit different from the one given on the official website

DataSphere Studio1.1.1

Link1.1.1

JDK8

Hadoop2.8.5

hive2.4.3

scoop1.4.7

MySQL8 (the official website requires MySQL≥5.5)

2.2 Preparations

Keep the deployment user of Exchangis consistent with that of Linkis, mine is root

Add data source authentication token for Exchangis:

INSERT INTO `linkis_mg_gateway_auth_token`(`token_name`,`legal_users`,`legal_hosts`,`business_owner`,`create_time`,`update_time`,`elapse_day`,`update_by`) VALUES ('EXCHANGIS-AUTH','*','*','BDP',curdate(),curdate(),-1,'LINKIS');

Insert the hive data source environment configuration by executing the following sql statement in the linkis database. Note that ${HIVE_METADATA_IP} and ${HIVE_METADATA_PORT} in the statement need to be modified before execution, for example, ${HIVE_METADATA_IP}=127.0.0.1, ${HIVE_METADATA_PORT} =3306:

INSERT INTO `linkis_ps_dm_datasource_env` (`env_name`, `env_desc`, `datasource_type_id`, `parameter`, `create_time`, `create_user`, `modify_time`, `modify_user`) VALUES ('开发环境SIT', '开发环境SIT', 4, '{"uris":"thrift://${HIVE_METADATA_IP}:${HIVE_METADATA_PORT}", "hadoopConf":{"hive.metastore.execute.setugi":"true"}}',  now(), NULL,  now(), NULL);

INSERT INTO `linkis_ps_dm_datasource_env` (`env_name`, `env_desc`, `datasource_type_id`, `parameter`, `create_time`, `create_user`, `modify_time`, `modify_user`) VALUES ('开发环境UAT', '开发环境UAT', 4, '{"uris":"thrift://${HIVE_METADATA_IP}:${HIVE_METADATA_PORT}", "hadoopConf":{"hive.metastore.execute.setugi":"true"}}',  now(), NULL,  now(), NULL);

2.3 Exchangis installation

Exchangis backend installation

Download the installation package

Release Exchangis 1.0.0 Release Notes · WeBankFinTech/Exchangis · GitHub

Create directory mkdir /usr/Exchangis-1.0.0 after transferring the installation to the server

Move the installation package to the directory, unzip and install tar -zxvf

The directory structure after decompression is as follows:

|-- config : One-click installation and deployment parameter configuration directory

|-- db : database table initialization SQL directory

|-- Exchangis-extds

|-- packages : Exchangis installation package directory

|-- sbin : script storage directory

Edit config.sh under config

Edit db.sh for the installation script to create the information table

sh Exchangis-1.0.0/sbin/install.sh to enter interactive installation

Initialize the data table when installing for the first time

The Eureka address will be displayed after sh daemon.sh start server

Enter Eureka and you can see that the exchangeis service has started running

Exchangis front-end installation

You can choose to download the compiled installation package ( https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Exchangis/Exchangis1.0.0/dist.zip )

You can also compile it yourself and execute it in the root directory

cd web

above sea level i

npm run build

Get the compiled dist.zip front-end package from /web

It is recommended to decompress the front-end package in the same directory as the back-end. Note that the Exchangis front-end is installed on the machine where dss is installed

unzip

Modify the nginx/Exchangis.conf configuration file

vi /etc/nginx/conf.d/Exchangis.conf

niginx -s reload refresh nginx

2.4 ExchangisAppConnInstallation

Before deploying ExchangisAppConn , please complete the installation of Exchangis1.0.0 and other related components, and ensure that the basic functions of the project are available.

You can directly download the installation package ( https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Exchangis/Exchangis1.0.0/Exchangis-appconn.zip )

Or compile and package yourself

cd {EXCHANGIS_CODE_HOME}/Exchangis-plugins/Exchangis-appconn

mvn clean install

Self-compilation will find the Exchangis-appconn.zip installation package under this path :

{EXCHANGIS_CODE_HOME}/Exchangis-plugins/Exchangis-appconn/target/Exchangis-appconn.zip

Move the zip to dss/dss-appconn to decompress

Enter the directory dss/bin

sh appconn-install.sh to enter the interactive installation

You need to enter the string Exchangis and the ip and front-end port of the Exchangis service , be careful not to make mistakes

If the input is not the Exchangis front-end port during installation, although the installation will be successful, an error will be reported when dss creates the project:

com.webank.wedatasphere.dss.framework.project.exception.DSSProjectErrorException: errCode: 71000 , desc: Failed to check whether the project name is repeated to the third-party application, reason: IllegalStateException: Expected BEGIN_OBJECT but was STRING at line 1 column 1 path $

Create a project in the dss workspace, and if the project appears in Exchangis at the same time, the download is successful

Guess you like

Origin blog.csdn.net/weixin_44382736/article/details/128769498