Python爬虫多进程包multiprocessing中,pool组件的使用

当爬虫脚本都完成后,原始参数通过以下传输


from multiprocessing import Pool
def main(xxxxx):
    ````````````


if __name__ == '__main__':
    pool = Pool()
    pool.map(main, [i*10 for i in range(10)])#假设此时要传入的原始参数为i
    pool.close()
    pool.join()

猜你喜欢

转载自blog.csdn.net/xiongzaiabc/article/details/80863283