One. azkaban solo server mode
1. Advantages:
(1) Easy to install: no MySQL example is required. It packages H2 as the main persistent storage.
(2) Easy to start: Web server and execution program server are running in the same process.
(3) Full function: It contains all Azkaban functions. It can be used normally, and plug-ins can also be installed for it.
2. Environmental preparation
CentOS7 system (close firewall), JDK1.8 or above.
3. Installation and deployment
(1) Decompress the installation package of azkaban solo server, unzip it to the specified location, and modify the file name generated after decompression to azkaban-solo-server.
tar -axvf azkaban-solo-server-3.81.0-1-g304593d.tar.gz -C /usr
(2) Modify conf/azkaban.properties Note: add server address http
default.timezone.id=Asia/Shanghai #修改时区
azkaban.webserver.url=http://192.168.139.175:8081 #配置azkaban web服务器的地址
(3) In this /usr/azkaban-solo-server/plugins/jobtypes, add the following information in commonprivate.properties.
memCheck.enabled=false
4. Turn on/off
Azkaban’s code has a start position reference, so when it starts, there isLocation requirements, Must be started under Azkaban's home. In addition, the startup and shutdown of Azkaban are paired. If it fails during startup, it must be shut down.
bin/start-solo.sh #启动进程
bin/shutdown-solo.sh #终止进程
The startup process using jps appears as shown below, that is, the startup is successful
5. Use the browser to access the ui page
My host IP here is: 192.168.139.175, so the access address here is: http://192.168.139.175:8081 The
default account and password are azkaban. After logging in, the following interface appears
Two. two server mode mode
1. Environmental preparation
CentOS7 system (close firewall), JDK1.8 or above, install mysql
wget -i -c http://dev.mysql.com/get/mysql57-community-release-el7-10.noarch.rpm
yum -y install mysql57-community-release-el7-10.noarch.rpm
yum -y install mysql-community-server
Start mysql
systemctl start mysqld.service
View mysql status
systemctl status mysqld.service
#或者
ps -ef |grep mysql
Modify the mysql password:
grep "password" /var/log/mysqld.log #查看临时密码
A temporary password is generated for root@localhost: ium+hhgLH7Xv
mysql -uroot -pium+hhgLH7Xv
set global validate_password_policy=0; #如果不进行此设置，密码过于简单设置会失败
set global validate_password_length=1; #如果不进行此设置，密码过于简单设置会失败
ALTER USER 'root'@'localhost' IDENTIFIED BY '123456'; #修改的密码为123456
Restart mysql
systemctl restart mysqld.service
mysql -uroot -p123456
Open mysql remote access permissions
set global validate_password_policy=0;
set global validate_password_length=1;
GRANT ALL PRIVILEGES ON *.* TO root@"%" IDENTIFIED BY "123456";
flush privileges;
2. Installation and deployment
2.1 Load mysql related information
mysql> create database azkaban
-> ;
Query OK, 1 row affected (0.00 sec)
mysql> use azkaban;
Database changed
mysql> source /usr/azkaban/azkaban-db/create-all-sql-3.81.0-1-g304593d.sql
mysql> show tables
-> ;
+-----------------------------+
| Tables_in_azkaban |
+-----------------------------+
| QRTZ_BLOB_TRIGGERS |
| QRTZ_CALENDARS |
| QRTZ_CRON_TRIGGERS |
| QRTZ_FIRED_TRIGGERS |
| QRTZ_JOB_DETAILS |
| QRTZ_LOCKS |
| QRTZ_PAUSED_TRIGGER_GRPS |
| QRTZ_SCHEDULER_STATE |
| QRTZ_SIMPLE_TRIGGERS |
| QRTZ_SIMPROP_TRIGGERS |
| QRTZ_TRIGGERS |
| active_executing_flows |
| active_sla |
| execution_dependencies |
| execution_flows |
| execution_jobs |
| execution_logs |
| executor_events |
| executors |
| project_events |
| project_files |
| project_flow_files |
| project_flows |
| project_permissions |
| project_properties |
| project_versions |
| projects |
| properties |
| ramp |
| ramp_dependency |
| ramp_exceptional_flow_items |
| ramp_exceptional_job_items |
| ramp_items |
| triggers |
+-----------------------------+
34 rows in set (0.00 sec)
Modify file upload size limit
[root@localhost etc]# vim my.cnf
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
user=mysql
Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0
max_allowed_packet=1024M #修改上传文件限制
[mysqld_safe]
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
Restart mysql
service mysqld restart
2.2 Install azkaban-exec-server
(1) Unzip the installation package to the specified location
tar -zxvf azkaban-exec-server-3.81.0-1-g304593d.tar.gz -C /usr/azkaban
(2) Modify the name of the decompressed package
mv azkaban-exec-server-3.81.0-1-g304593d azkaban-exec-server
(3) Modify the azkaban.properties configuration file
default.timezone.id=Asia/Shanghai
azkaban.webserver.url=http://192.168.139.176:8081
database.type=mysql
mysql.port=3306
mysql.host=192.168.139.176
mysql.database=azkaban
mysql.user=root
mysql.password=123456
mysql.numconnections=100
(4) Modify the commonprivate.properties configuration file
memCheck.enabled=false
(5) Start the azkaban-exec-server server
[root@localhost azkaban-exec-server]# ./bin/start-exec.sh
[root@localhost azkaban-exec-server]# jps
16449 Jps
16436 AzkabanExecutorServer
(6) Activate the current azkaban-exec-server
[root@localhost azkaban-exec-server]# curl -G "localhost:$(<./executor.port)/executor?action=activate" && echo
{"status":"success"}
2.3 Install azkaban-web-server
(1) Unzip the installation package to the specified location
tar -zxvf azkaban-web-server-3.81.0-1-g304593d.tar.gz -C /usr/azkaban
(2) Modify the folder name after decompression
mv azkaban-web-server-3.81.0-1-g304593d/ azkaban-web-server
(3) Modify the azkaban.properties configuration file
default.timezone.id=Asia/Shanghai #修改时区
azkaban.webserver.url=http://192.168.139.176:8081 #配置azkabanweb服务器地址
database.type=mysql
mysql.port=3306
mysql.host=192.168.139.176
mysql.database=azkaban
mysql.user=root
mysql.password=123456
mysql.numconnections=100
azkaban.executorselector.filters=StaticRemainingFlowSize,CpuStatus
(4) Start azkaban-web-server
[root@localhost azkaban-web-server]# ./bin/start-web.sh
[root@localhost azkaban-web-server]# jps
16436 AzkabanExecutorServer
17063 Jps
17036 AzkabanWebServer
(5) Open the browser and enter the ui page of azkaban.
(6) The account and password are azkaban by default. After logging in, the following interface appears, which means the login is successful.
In fact, the entire installation process is not difficult. The difficult thing is to download the installation package. If you want to install the package, you can privately write to the blogger! ! ! !