Introduction
AntColony (Github) is a magnetic core findit search engines. DHT network used to collect infohash active resources, download and parse the torrent file resources stored in the database and so on. AntColony is a collection of several functions, you can also run some of these features alone, so from the "ant colony" The name is very appropriate (yes, I just love the animal world). The main points about a few:
- worker: reptiles, collect resources infohash, you can start the worker multiple processes at the same time, improve efficiency
- male: According to collected the seed file to download infohash
- female: the seed file database entry
- queen: a simple entrance, start pm2 run worker, male and female
Currently starting five worker using port 3000-3004, the two male and one female.
Use Mongodb store data, which have nothing to say; use pm2 maintenance and monitoring node process, but also not too much to say, focus on that Redis. Redis data in the staging something like this:
- bucket: a large bucket K
- infohash: infohashs is already collected (worker's collected, male will be used to download the torrent)
- remoteNodes: new understanding of worker nodes, in turn "visit" is currently only save the latest 10w one (on the one hand my VPS small memory, on the other hand I did not need too many records)
- sysInfo: record some statistics, such as how many times a request is made, how many infohashs cumulative collection, has issued 1.5 billion Request, this frequency is controllable, worker too crazy, then, VPS could not carry.
Installation and operation method
See the detailed use deployment documentation
other content view http://keenwon.com/1436.html