Table of contents
Two data exchange tool Exchangeis installation
2.4 ExchangisAppConnInstallation
Two data exchange tool Exchangeis installation
2.1 Dependent environment
My installation environment is as follows, which is a little bit different from the one given on the official website
DataSphere Studio1.1.1
Link1.1.1
JDK8
Hadoop2.8.5
hive2.4.3
scoop1.4.7
MySQL8 (the official website requires MySQL≥5.5)
2.2 Preparations
Keep the deployment user of Exchangis consistent with that of Linkis, mine is root
Add data source authentication token for Exchangis:
INSERT INTO `linkis_mg_gateway_auth_token`(`token_name`,`legal_users`,`legal_hosts`,`business_owner`,`create_time`,`update_time`,`elapse_day`,`update_by`) VALUES ('EXCHANGIS-AUTH','*','*','BDP',curdate(),curdate(),-1,'LINKIS');
Insert the hive data source environment configuration by executing the following sql statement in the linkis database. Note that ${HIVE_METADATA_IP} and ${HIVE_METADATA_PORT} in the statement need to be modified before execution, for example, ${HIVE_METADATA_IP}=127.0.0.1, ${HIVE_METADATA_PORT} =3306:
INSERT INTO `linkis_ps_dm_datasource_env` (`env_name`, `env_desc`, `datasource_type_id`, `parameter`, `create_time`, `create_user`, `modify_time`, `modify_user`) VALUES ('开发环境SIT', '开发环境SIT', 4, '{"uris":"thrift://${HIVE_METADATA_IP}:${HIVE_METADATA_PORT}", "hadoopConf":{"hive.metastore.execute.setugi":"true"}}', now(), NULL, now(), NULL);
INSERT INTO `linkis_ps_dm_datasource_env` (`env_name`, `env_desc`, `datasource_type_id`, `parameter`, `create_time`, `create_user`, `modify_time`, `modify_user`) VALUES ('开发环境UAT', '开发环境UAT', 4, '{"uris":"thrift://${HIVE_METADATA_IP}:${HIVE_METADATA_PORT}", "hadoopConf":{"hive.metastore.execute.setugi":"true"}}', now(), NULL, now(), NULL);
2.3 Exchangis installation
Exchangis backend installation
Download the installation package
(Release Exchangis 1.0.0 Release Notes · WeBankFinTech/Exchangis · GitHub)
Create directory mkdir /usr/Exchangis-1.0.0 after transferring the installation to the server
Move the installation package to the directory, unzip and install tar -zxvf
The directory structure after decompression is as follows:
|-- config : One-click installation and deployment parameter configuration directory
|-- db : database table initialization SQL directory
|-- Exchangis-extds
|-- packages : Exchangis installation package directory
|-- sbin : script storage directory
Edit config.sh under config
Edit db.sh for the installation script to create the information table
sh Exchangis-1.0.0/sbin/install.sh to enter interactive installation
Initialize the data table when installing for the first time
The Eureka address will be displayed after sh daemon.sh start server
Enter Eureka and you can see that the exchangeis service has started running
Exchangis front-end installation
You can choose to download the compiled installation package ( https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Exchangis/Exchangis1.0.0/dist.zip )
You can also compile it yourself and execute it in the root directory
cd web
above sea level i
npm run build
Get the compiled dist.zip front-end package from /web
It is recommended to decompress the front-end package in the same directory as the back-end. Note that the Exchangis front-end is installed on the machine where dss is installed
unzip
Modify the nginx/Exchangis.conf configuration file
vi /etc/nginx/conf.d/Exchangis.conf
niginx -s reload refresh nginx
2.4 ExchangisAppConnInstallation
Before deploying ExchangisAppConn , please complete the installation of Exchangis1.0.0 and other related components, and ensure that the basic functions of the project are available.
You can directly download the installation package ( https://osp-1257653870.cos.ap-guangzhou.myqcloud.com/WeDatasphere/Exchangis/Exchangis1.0.0/Exchangis-appconn.zip )
Or compile and package yourself
cd {EXCHANGIS_CODE_HOME}/Exchangis-plugins/Exchangis-appconn
mvn clean install
Self-compilation will find the Exchangis-appconn.zip installation package under this path :
{EXCHANGIS_CODE_HOME}/Exchangis-plugins/Exchangis-appconn/target/Exchangis-appconn.zip
Move the zip to dss/dss-appconn to decompress
Enter the directory dss/bin
sh appconn-install.sh to enter the interactive installation
You need to enter the string Exchangis and the ip and front-end port of the Exchangis service , be careful not to make mistakes
If the input is not the Exchangis front-end port during installation, although the installation will be successful, an error will be reported when dss creates the project:
com.webank.wedatasphere.dss.framework.project.exception.DSSProjectErrorException: errCode: 71000 , desc: Failed to check whether the project name is repeated to the third-party application, reason: IllegalStateException: Expected BEGIN_OBJECT but was STRING at line 1 column 1 path $
Create a project in the dss workspace, and if the project appears in Exchangis at the same time, the download is successful