Easy Scheduler Release 1.0.4
Easy Scheduler 1.0.4 release, this is the fifth in the series 1.x version.
The new updated version:
Repair :
- [EasyScheduler-198] process definition list is sorted according to the timing and state update
- [EasyScheduler-419] fix to create files online, hdfs file is not created, but returns a success
- [EasyScheduler-481] repair job can not question the timing off the assembly line does not exist
- [EasyScheduler-425] increase kill its child processes when kill tasks
- [EasyScheduler-422] update time and the size of the problem is not updated when the updated resource file repair
- [EasyScheduler-431] repair deleted tenants, if hdfs does not start, remove the problem tenants fail
- [EasyScheduler-485] the shell process exit, yarn judgment wait state Non-Final
Enhanced :
- [EasyScheduler-482] message header sql task added support for custom variables
- [EasyScheduler-483] mail sql task fails, the sql task failure
- [EasyScheduler-484] modified from sql variable substitution rules defined tasks, a plurality of support for the replacement of single and double quotes
- [EasyScheduler-485] When you create a resource file, verify that the increase in the resource file that already exists on hdfs
thank:
Last but most importantly, there is no contribution of the following partners of the birth of the new version is not (in alphabetical order):
bailgot, zhzhenqin, xianhu, baoqi, jimmy201602, samz406, petersear, millionfor, hyperknob, fanguanqun, yangqinlong, qq389401879, feloxx, coding-now, hymzcn, nysyxxg, chgxtony, lfyee, Crossoverrr, gj-zhang, sunnyingit, zhengqiangtan
And a micro-channel group in a large number of enthusiastic partner! In this very grateful!
Easy Scheduler
Easy Scheduler for Big Data
Easy Scheduler is a distributed workflow task scheduling system, mainly to solve complex data dependencies ETL development, but can not directly monitor the health status of tasks and other issues. Easy Scheduler to DAG streaming manner Task assembled, can run real-time monitoring tasks, while supporting retry, fail to recover, pause and Kill tasks and other operations from the specified node. EasyScheduler developed by the workflow scheduling aspects of many years of work from a number of small partners, is committed to become the mainstay of big data platform, making scheduling easier, but also "easy schedule" to see our mind from its Chinese name, If you are not satisfied with the current market schedule, very easy to use scheduling welcome, welcome to join in, put forward the demand, are also welcome to contribute code.
Design features: a distributed and scalable visualization DAG workflow task scheduling system. Addresses the data processing flow in complex dependencies, its main objectives are as follows:
- By way of the DAG will associate Task dependencies in accordance with the task of running the state can monitor real-time visualization tasks
- It supports various types of tasks: Shell, MR, Spark, SQL (mysql, postgresql, hive, sparksql), Python, Sub_Process, Procedure, etc.
- Workflow Support regular schedule, dependent scheduling, scheduling manual, manual pause / stop / recovery, while supporting failure retry / alarm, failure recovery, the operation Kill tasks from the specified node
- Support workflow priorities, failover priority tasks and tasks and task time-out alarm / failure
- Workflow support global parameters and custom parameters settings node
- Support resources online file upload / download, manage, and support for online document creation, editing,
- Support Task Log online to view and scroll, online download logs, etc.
- Implement cluster HA, achieved Master Worker clusters and cluster to the center by Zookeeper
- Support for the
Master/Workerview cpu load, memory, cpu online - Support the operation history tree workflow / Gantt chart shows, support mission state statistics, statistical process status
- Support complement
- Support for multi-tenancy
- International support
- There are more waiting for partners to explore
Comparison with similar scheduling system
Screenshot parts of the system
File
More documents please refer easyscheduler Chinese online documentation