Playwright爬取网站内容时启用多进程报错!
我想多进程抓取网页中的内容,正常开启多进程多线程好像没啥问题,就是配合playwright报错了
from multiprocessing import Process
def run():
# ......
p = Process(target=draw_data, args=(youzy_part_view, s['code'], s['cnName'], province_name, ))
p.start()
if __name__ == '__main__':
with sync_playwright() as playwright:
run()
thread.lock 好像是这个的问题 可以看看