DolphinScheduler Release 1.2.0
Apache DolphinScheduler get a unanimous vote by the end of August 2019 after successfully entered the Apache Incubator, after more than four months later, finally ushered in his first Apache version - 1.2.0, this issue includes the following important update
New features:
- Support PostgreSql, Mysql and other databases, add Postgre performance monitoring
- Flink and add Http task type support
- Adding support cross-project dependencies
- Add the export and import process definition
- CI added automatically compile inspection
- Improve code comments
- Add java doc Documentation for the Common Module
Enhanced:
-
The process definition batchDelete / external transaction instance moved
-
Dockerfile optimization
-
Change mysql-connector-java scope for the test, to avoid the mysql license issue
-
Administrators can create and delete timed
-
Delete alarm group you want to delete the relationship between the user and the alarm group
-
When delete resource delete check tenants
-
Check the status before deleting process instances
- Adding license and notice files
BUG FIX:
- Adding transaction support for the scan to Do
- Repair ZKWorkerClient not close PathChildrenCache
- Data type conversion error, e-mail error bug fixes
- Catch abnormal transaction method is not effective, can not be modified
- Repair spring Affairs instead of worker error
- Print job log logbook bug fixes
- Repair api server debug mode error
- Abnormal task, the task is running bug fixes
- Fix the error: Task queue length error
- Repair inappropriate error message
- Bug fix: the phone can be empty
- Repair e-mail password error
-
Fix too many connections when you upgrade or create
-
Error when using a queue to perform tasks restoration process. And delete inspection at 20 bug
For details, please participate in the development version Description
Special thanks to more than 50 community-based sub contributors version made outstanding contributions
Dolphin Scheduler for Big Data
Design features: a distributed and scalable visualization DAG workflow task scheduling system. We committed to resolve dependencies of complex data processing flow, the scheduling system in data processing procedures 开箱即用.
Its main objectives are as follows:
- by way of the DAG of the Task association in accordance with dependencies tasks together, real-time visual monitoring task of running the state
- to support rich task types: Shell, MR, Spark, SQL (mysql, postgresql, hive, sparksql), Python, Sub_Process, Procedure, etc.
- supported workflow regular schedule, dependent scheduling, manual scheduling, manual pause / stop / recovery, while supporting failure retry / alarm, the recovery fails, Kill tasks from the specified node and other operations
- support work flow priorities, failover and job task priorities and task timeout alarm / failure
- support custom parameters workflow global parameters and node
- to support online upload the resource file / download, manage, and support for online document creation, editing
- support task log online to view and scroll, online download logs, etc.
- to achieve the cluster HA, achieved Master Worker clusters and cluster to the center by Zookeeper
- support for Master/Worker cpu load, memory, cpu viewed online
- support the workflow run history tree / Gantt Figure showing support mission-state statistics, statistical process status
- support complement
- support multi Tenant
- international support
- there are many more waiting for partners to explore
Screenshot parts of the system
File
More documents please refer DolphinScheduler Chinese online documentation
Recent R & D program
DolphinScheduler的工作计划：研发计划 ，其中 In Develop卡片下是正在研发的功能，TODO卡片是待做事项(包括 feature ideas)
贡献代码
非常欢迎大家来参与贡献代码，提交代码流程请参考：
[How to contribute code]
How to Build
mvn clean install -Prelease
Artifact:
dolphinscheduler-dist/dolphinscheduler-backend/target/apache-dolphinscheduler-incubating-${latest.release.version}-dolphinscheduler-backend-bin.tar.gz: Binary package of DolphinScheduler-Backend
dolphinscheduler-dist/dolphinscheduler-front/target/apache-dolphinscheduler-incubating-${latest.release.version}-dolphinscheduler-front-bin.tar.gz: Binary package of DolphinScheduler-UI
dolphinscheduler-dist/dolphinscheduler-src/target/apache-dolphinscheduler-incubating-${latest.release.version}-src.zip: Source code package of DolphinScheduler
感谢
Dolphin Scheduler使用了很多优秀的开源项目，比如google的guava、guice、grpc，netty，ali的bonecp，quartz，以及apache的众多开源项目等等，
正是由于站在这些开源项目的肩膀上，才有Dolphin Scheduler的诞生的可能。对此我们对使用的所有开源软件表示非常的感谢！我们也希望自己不仅是开源的受益者，也能成为开源的
贡献者，于是我们决定贡献出来，并承诺长期维护。也希望对开源有同样热情和信念的伙伴加入进来，一起为开源献出一份力！
本次发版下载链接: http://dolphinscheduler.apache.org/en-us/docs/user_doc/download.html
官网: https://dolphinscheduler.apache.org/