上一页 1 ··· 23 24 25 26 27 28 29 30 31 ··· 67 下一页
摘要: 1_info.py 2_pie_chart.py 3_hist.py 4_ratio.py 阅读全文
posted @ 2019-05-04 17:54 hank-li 阅读(120) 评论(0) 推荐(0)
摘要: ershoufang.py zufang_spider.py items.py middlewares.py pipelines.py settings.py 阅读全文
posted @ 2019-05-04 17:48 hank-li 阅读(147) 评论(0) 推荐(0)
摘要: ``` import redis import telnetlib import urllib.request from bs4 import BeautifulSoup r = redis.Redis(host='127.0.0.1', port=6379) for d in range(1, 3 阅读全文
posted @ 2019-05-04 16:57 hank-li 阅读(331) 评论(0) 推荐(0)
摘要: taobao.py items.py middlewares.py pipelines.py settings.py 阅读全文
posted @ 2019-05-04 13:30 hank-li 阅读(193) 评论(0) 推荐(0)
摘要: ``` # python执行lua脚本 import requests from urllib.parse import quote lua = ''' function main(splash) return 'hello' end ''' url = 'http://localhost:8050/execute?lua_source=' + quote(lua) response... 阅读全文
posted @ 2019-05-04 11:13 hank-li 阅读(97) 评论(0) 推荐(0)
摘要: ``` # 抓取《我不是药神》的豆瓣评论 import csv import time import requests from lxml import etree fw = open('douban_comments.csv', 'w') writer = csv.writer(fw) writer.writerow(['comment_time','comment_content']) ... 阅读全文
posted @ 2019-05-04 10:57 hank-li 阅读(106) 评论(0) 推荐(0)
摘要: ``` # 抓取今日头条,对比渲染和没有渲染的效果 import requests from lxml import etree # url = 'http://localhost:8050/render.html?url=https://www.toutiao.com&timeout=30&wait=0.5' url = 'https://www.toutiao.com' response... 阅读全文
posted @ 2019-05-04 10:36 hank-li 阅读(117) 评论(0) 推荐(0)
摘要: ``` import requests import json import re from selenium import webdriver from selenium.webdriver.common.by import By from selenium.webdriver.support.ui import WebDriverWait from selenium.webdriver.sup... 阅读全文
posted @ 2019-05-04 10:32 hank-li 阅读(159) 评论(0) 推荐(0)
摘要: ``` # 抓取简书博客总阅读量 # https://www.jianshu.com/u/130f76596b02 import requests import json import re from lxml import etree header = { 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,... 阅读全文
posted @ 2019-05-04 10:05 hank-li 阅读(190) 评论(0) 推荐(0)
摘要: ``` # 通过搜索接口抓取etherscan上的合约地址 # https://etherscan.io/ import requests import re header = { 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8', 'User-Agent... 阅读全文
posted @ 2019-05-03 23:47 hank-li 阅读(136) 评论(0) 推荐(0)
上一页 1 ··· 23 24 25 26 27 28 29 30 31 ··· 67 下一页