2020年8月11日
(31)爬虫--scrapy动态ua，IP
摘要： http_ua.py import scrapy class HttpUaSpider(scrapy.Spider): name = 'http_ua' allowed_domains = ['http://httpbin.org/get'] start_urls = ['http://httpbi 阅读全文
posted @ 2020-08-11 14:09 kuanleung 阅读(9) 评论(0) 推荐(0)
(30)爬虫--CrawlSpider自动获取爬取链接
摘要： scrapy genspider -t crawl zwr zedu.com import scrapy from scrapy.linkextractors import LinkExtractor from scrapy.spiders import CrawlSpider, Rule clas 阅读全文
posted @ 2020-08-11 11:22 kuanleung 阅读(5) 评论(0) 推荐(0)