摘要:0.参考 https://doc.scrapy.org/en/latest/topics/downloader-middleware.html#module-scrapy.downloadermiddlewares.redirect https://doc.scrapy.org/en/latest/ 阅读全文
posted @ 2018-07-18 18:47 my8100 阅读(4113) 评论(0) 推荐(1) 编辑
摘要:0.参考 https://doc.scrapy.org/en/latest/topics/item-pipeline.html?highlight=mongo#write-items-to-mongodb 20180721新增:异步版本 https://twistedmatrix.com/docum 阅读全文
posted @ 2018-07-18 12:55 my8100 阅读(1911) 评论(0) 推荐(0) 编辑