Saturn
A distributed job scheduling platform
Introduction
Saturn (Task Scheduling System) is a distributed task scheduling platform open sourced by Vipshop. It replaces the traditional Linux Cron/Spring Batch Job method to achieve unified configuration, unified monitoring, high availability of tasks and concurrent processing of fragments.
Saturn is based on Dangdang's open source Elastic Job, combined with the needs of all parties and our practical insights.
This document is applicable to version 3.x.
Important features
- Support multi-language operations, independent of language (Java/Go/C++/PHP/Python/Ruby/shell)
- Support second-level scheduling
- Support job segmentation parallel execution
- Supports serial execution of dependent jobs
- Support high job availability and intelligent load balancing
- Support anomaly detection and automatic failover
- Support remote disaster recovery
- Support multiple cluster deployment
- Support cross-machine room area deployment
- Support elastic dynamic expansion
- Support priority and weight setting
- Support docker container, container friendly
- Support cron time expression
- Support multiple time periods to pause execution control
- Support timeout alarm and timeout forced kill control
- Support grayscale release
- Support abnormal, overtime and inability to highly available job monitoring alarms and simple troubleshooting
- Support TOP10 job statistics of each node in each domain with the highest failure rate, the most active and the heaviest load
- Withstand the daily scheduling test of more than 800 nodes produced by Vipshop
development team
- Dylan Xue [email protected]
- Chembo Huang [email protected]
- Xiaopeng He [email protected]
- Juanying Yang [email protected]
- Jeff Zhu [email protected]
- Timmy Hu [email protected]
- Jamin Li [email protected]
- Gilbert Guo [email protected]
- Ivy Li [email protected]
- Lan Jian [email protected]