[spiderflow crawler platform v0.5.0] Highly flexible and configurable + graphical way to define crawler process + crawler can be completed without writing code

Introduction

Support Xpath/JsonPath/css selector/regular extraction/mix and match extraction

Support JSON/XML/binary format

Support multiple data sources, SQL select/selectInt/selectOne/insert/update/delete

Support crawling JS dynamic rendering (or ajax) pages

Support agent

Support automatic saving to database/file

Commonly used string, date, file, encryption and decryption functions

Support plug-in extension (custom executor, custom method)

Task monitoring, task log

Support HTTP interface

Support cookie automatic management

Support custom functions ## Download link

Download link

http://www.bytepan.com/08S46eqJEgp

image

Insert picture description here

Guess you like

Origin blog.csdn.net/qq_37043663/article/details/112878527