Reptile management platform Crawlab v0.4.8 released

Foreword

This update includes several parts:

  1. Support interface is installed (pre-installed) of languages ​​other than Python
  2. Better mounting interface, installation can be seen that a plurality of nodes
  3. RPC optimization, based on a delay queue RPC Redis
  4. Configuring more features

Update Log

Function / Optimization

  • Support for more programming languages Installation: Now users can pre-install or more programming languages, including Java, .Net Core, PHP.
  • UI optimized installation: users can better view and manage installed node list page.
  • More Git Support: Allows users to view Git Commits records and Checkout corresponding to Commit.
  • Hostname used as the support node registration type: user can hostname as a unique node identification number.
  • RPC support: join node management support for RPC communication better.
  • Whether the master node switch: the user can decide whether to run in the primary node, if it is not, then all tasks will run on the working node.
  • Tutorial disabled by default
  • Join related documents sidebar
  • Load page optimization

Bug fixes

  • Repeat node # 391

  • Repeat upload reptile # 603

  • Third-party modules installed node failure results in some nodes can not install third-party use  # 609

  • Offline node will create a task # 622

Product Planning

  • The results show
    • Support for other databases
  • Yes placement Reptilia
    • Splash crawler can be configured to support
    • Configurable crawler support CrawlSpider
    • Crawler can be configured to support regular expressions field
    • You may be configured to support crawler crawler into custom
  • task
    • Task retry mechanism
  • Regular tasks
    • Show calendar
  • Overall situation
    • Supported version of the update log shows
  • server
    • Mirror support terminal operation Docker
  • SDK
    • More command support
    • Plug-in system

reference

Guess you like

Origin www.oschina.net/news/114005/crawlab-0-4-8-released