[Yuan Chuang Conference Preview] 1024 Programmers’ Day (two days before), meet at the Open Source China office, let’s talk about AI! >>>

Apache SeaTunnel Web functionality is officially released!

With the continuous advancement of big data technology, Apache SeaTunnel has become the focus of many developers and enterprises. Today, we are pleased to announce that Apache SeaTunnel Web functionality has been officially released, bringing unprecedented ease of use and efficiency.

file Apache SeaTunnel Web is a new component under the SeaTunnel project, designed for users who want to manage and monitor their big data stream processing tasks through a graphical interface. No longer needing complex command line operations, developers and data engineers can now easily configure, submit and manage their tasks on a user-friendly interface.

Prepare the Apache SeaTunnel environment

Since Apache SeaTunnel Web uses the SeaTunnel Java Client to submit jobs, running SeaTunnel Web requires first preparing a SeaTunnel Zeta engine service.

Based on the requirements for using the SeaTunnel Zeta engine, the SeaTunnel client node that submits the job must have the same operating system and installation directory structure as the SeaTunnel server node that runs the job. Therefore, if you want to run SeaTunnel Web in IDEA, you must install and run a SeaTunnel Zeta engine server on the same machine as IDEA.

Don't worry, the steps below will tell you how to properly install SeaTunnel Zeta Engine Server in different situations.

Running SeaTunnel Web on the server

To run SeaTunnel Web on a server, you need to first have a SeaTunnel Zeta Engine server environment. If you haven't already, you can refer to the following steps to deploy it.

Deploy SeaTunnel Zeta Engine Server on the server node

You have two ways to obtain the SeaTunnel installation package. Build from source or download from the SeaTunnel website.

The version of SeaTunnel used here was used only to write this document to demonstrate the process used and does not necessarily represent the correct version. SeaTunnel Web and SeaTunnel engine have strict version dependencies. You can confirm the specific version mapping through xxx

Supported SeaTunnel versions

SeaTunnel 2.3.3 only

Build from source

Get the source code package from https://seatunnel.apache.org/download or https://github.com/apache/seatunnel.git
Use the maven command to build the installation package./mvnw -U -T 1C clean install -DskipTests -D"maven.test.skip"=true -D"maven.javadoc.skip"=true -D"checkstyle.skip"=true -D"license.skipAddThirdParty"
Then you can ${Your_code_dir}/seatunnel-dist/targetget the installation package in , for example:apache-seatunnel-2.3.3-SNAPSHOT-bin.tar.gz

Download the installation package

Another way to obtain the SeaTunnel Zeta engine server installation package is to download the installation package from https://seatunnel.apache.org/download and install the plug-in online.

Download and install the connector plug-in (during this process, some third-party dependency packages will also be automatically downloaded and installed, such as hadoop jar). You can get the steps from https://seatunnel.apache.org/docs/2.3.3/start-v2/locally/deployment .
After completing the previous step, you will receive an installation package that can be used to install the SeaTunnel Zeta Engine Server on your server. runtar -zcvf apache-seatunnel-2.3.3-SNAPSHOT-bin.tar.gz apache-seatunnel-2.3.3-SNAPSHOT

Deploy SeaTunnel Zeta Server

After completing 3.1.1 or 3.1.2, you can get an installation package apache-seatunnel-2.3.3-SNAPSHOT-bin.tar.gz, which you can then copy to your server node and deploy by referring to https://seatunnel.apache.org/docs/seatunnel-engine/deployment .

Deploy SeaTunnel Zeta client

If you use SeaTunnel Web, you need to deploy a SeaTunnel Zeta client in the SeaTunnel Web running node. If you are running SeaTunnel Zeta Server and SeaTunnel Web on the same node, you can skip this step.

Copy apache-seatunnel-2.3.3-SNAPSHOT-bin.tar.gzto the SeaTunnel web node and extract to the same path of the SeaTunnel Zeta server node.
Set SEATUNNEL_HOMEas an environment variable, just like the SeaTunnel Zeta server node.
Configuration hazelcast-client.yamlrefer to https://seatunnel.apache.org/docs/seatunnel-engine/deployment#6-config-seatunnel-engine-client
Run $SEATUNNEL_HOME/bin/seatunnel.sh --config $SEATUNNEL_HOME/config/v2.batch.config.template. If this job is completed, it means that the client deployment is successful.

Download and install SeaTunnel Web

Download seatunnel web from https://seatunnel.apache.org/download
Copy apache-seatunnel-web-bin-${project.version}.tar.gzto your server node and unzip it.

tar -zxvf apache-seatunnel-web-bin-${project.version}.tar.gz

Initialize database

Edit apache-seatunnel-web-bin-${project.version}/script/seatunnel_server_env.shthe file to complete the installed database address, port, username and password. Here is an example:

```
export HOSTNAME="localhost"
export PORT="3306"
export USERNAME="root"
export PASSWORD="123456"
```

sh apache-seatunnel-web-bin-${project.version}/script/init_sql.shIf there are no errors during the operation when running the initialization shell , the initialization is successful.

2.4 Configure the application and run the SeaTunnel web backend server

Edit apache-seatunnel-web-bin-${project.version}/conf/application.ymlFill in the database connection information in the file.
Copy $SEATUNNEL_HOME/config/hazelcast-client.yamltoapache-seatunnel-web-bin-${project.version}/conf/
Copy apache-seatunnel-2.3.3-SNAPSHOT/connectors/plugin-mapping.propertiesfiles to apache-seatunnel-web-bin-${project.version}/conf/directory.

2.5 Start SeaTunnel Web

cd apache-seatunnel-web-${project.version}
sh bin/seatunnel-backend-daemon.sh start

Access http://127.0.0.1:8801/ui/ in the browser . The default username and password are admin/admin.

This article is published by Beluga Open Source Technology !