1,爬取链家北京成交交易

操作结束

2020-08-02 21:18:28 [scrapy.core.engine] INFO: Closing spider (finished)
2020-08-02 21:18:28 [scrapy.extensions.feedexport] INFO: Stored csv feed (79062 items) in: xxx.csv
2020-08-02 21:18:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 17,
 'downloader/exception_type_count/twisted.internet.error.TCPTimedOutError': 13,
 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 3,
 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 1,
 'downloader/request_bytes': 1987568,
 'downloader/request_count': 3815,
 'downloader/request_method_count/GET': 3815,
 'downloader/response_bytes': 85994336,
 'downloader/response_count': 3798,
 'downloader/response_status_count/200': 3773,
 'downloader/response_status_count/301': 25,
 'dupefilter/filtered': 31,
 'elapsed_time_seconds': 13933.951338,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2020, 8, 2, 13, 18, 28, 475542),
 'item_scraped_count': 79062,
 'log_count/DEBUG': 82878,
 'log_count/ERROR': 478,
 'log_count/INFO': 243,
 'memusage/max': 99110912,
 'memusage/startup': 54415360,
 'request_depth_max': 3,
 'response_received_count': 3773,
 'retry/count': 17,
 'retry/reason_count/twisted.internet.error.TCPTimedOutError': 13,
 'retry/reason_count/twisted.internet.error.TimeoutError': 3,
 'retry/reason_count/twisted.web._newclient.ResponseNeverReceived': 1,
 'scheduler/dequeued': 3815,
 'scheduler/dequeued/memory': 3815,
 'scheduler/enqueued': 3815,
 'scheduler/enqueued/memory': 3815,
 'spider_exceptions/IndexError': 216,
 'spider_exceptions/TypeError': 262,
 'start_time': datetime.datetime(2020, 8, 2, 9, 26, 14, 524204)}
2020-08-02 21:18:28 [scrapy.core.engine] INFO: Spider closed (finished)