随笔分类 -  爬虫及Scrapy

摘要:1 # -*- coding:utf-8 -*- 2 import requests 3 import json 4 import re 5 import os 6 import gevent 7 import time 8 import random 9 from multiprocessing.dummy import Pool as ThreadPool 10 from ... 阅读全文
posted @ 2017-04-19 13:40 Erick-LONG 阅读(2505) 评论(1) 推荐(0)
摘要:1 from bs4 import BeautifulSoup 2 import requests 3 from random import choice 4 import csv 5 6 headers1 = {'User-Agent':'spider'} 7 headers2 = {'User-Agent':'spider'} 8 hehe = [headers1,head... 阅读全文
posted @ 2017-02-10 11:31 Erick-LONG 阅读(3140) 评论(0) 推荐(0)
摘要:1 from bs4 import BeautifulSoup 2 import requests,urllib.request,urllib.parse 3 import json 4 import time 5 import os 6 headers = {'User-Agent':'Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac ... 阅读全文
posted @ 2017-02-10 11:22 Erick-LONG 阅读(598) 评论(0) 推荐(0)
只有注册用户登录后才能阅读该文。
posted @ 2017-02-10 11:16 Erick-LONG 阅读(159) 评论(0) 推荐(0)