(E) Mlsql deploying Docker build large data clusters

main content

• mlsql deployment

premise

• zookeeper normal use
• spark normal use
• hadoop normal use

Installation package

Micro Cloud Download | tar package directory under

• mlsql-cluster-2.4_2.11-1.4.0.tar.gz
• mlsql-console-1.4.0.tar.gz
• mlsql-engine_2.4-1.4.0.tar.gz

First, prepare the environment

Upload image to docker

docker cp mlsql-cluster-2.4_2.11-1.4.0.tar.gz cluster-master:/root/tar
docker cp mlsql-console-1.4.0.tar.gz cluster-master:/root/tar
docker cp mlsql-engine_2.4-1.4.0.tar.gz cluster-master:/root/tar

Decompression

tar xivf mlsql-cluster-2.4_2.11-1.4.0.tar.gz -C /opt/mlsql
tar xivf mlsql-console-1.4.0.tar.gz -C /opt/mlsql
tar xivf mlsql-engine_2.4-1.4.0.tar.gz -C /opt/mlsql

Second, start-up and configuration MLSQL Engine

The default port 9003, you can manually modify

Enable yarn

--master local[*]

Replaced

--master yarn-client

Authorize

chmod 777 start-default.sh

Second, start-up and configuration MLSQL Cluster

The default port 8080, you can manually modify their own

1. New Database in mysqlmlsql_cluster
2. The root directory db.sqlintroduced
3. Modification application.docker.yml, the "MYSQL_HOST" placeholder replaced MySQL address, and, if necessary, modify the corresponding database, the user name, password, etc.
4. start-default.sh start

Third, start-up and configuration MLSQL Console

The default port 9002, you can manually modify their own

1. New Database in mysqlmlsql_console
2. The root directory introduced db.sql
3. Modification application.docker.yml, the "MYSQL_HOST" placeholder replaced MySQL address, and, if necessary, modify the corresponding database, the user name and password.
4. Now you can call ./start-default.shstarted

access