CrawlSpider

将用两个规则替换预定义的规则变量，一个用于水平，一个用于垂直爬

rules = (
Rule(LinkExtractor(restrict_xpaths='//*[contains(@class,"next")]')), Rule(LinkExtractor(restrict_xpaths='//*[@itemprop="url"]'),
callback='parse_item')
)