scrapy: Powerful crawler frame
scrapyd: command start, stop, operating reptiles
scrapydweb: page visualization scheduling reptiles
scrapydAPI: Integrated Scheduling in the crawler api, available on the github scrapyd-api project, and a rear frame with the use of