随笔分类 -  爬虫实战模块

上一页 1 2 3
(10)爬虫requests---ssl
摘要：import requests header = { 'User-Agent':'Mozilla/5.0(Windows;U;WindowsNT6.1;en-us)AppleWebKit/534.50(KHTML,likeGecko)Version/5.1Safari/534.50' } url = 阅读全文
posted @ 2020-07-09 12:30 kuanleung 阅读(8) 评论(0) 推荐(0)
（9）爬虫requests----代理IP
摘要：import requests header = { 'User-Agent':'Mozilla/5.0(Windows;U;WindowsNT6.1;en-us)AppleWebKit/534.50(KHTML,likeGecko)Version/5.1Safari/534.50' } url = 阅读全文
posted @ 2020-07-09 12:29 kuanleung 阅读(4) 评论(0) 推荐(0)
(8)爬虫requests----post使用
摘要：import requests header = { 'User-Agent':'Mozilla/5.0(Windows;U;WindowsNT6.1;en-us)AppleWebKit/534.50(KHTML,likeGecko)Version/5.1Safari/534.50' } login 阅读全文
posted @ 2020-07-09 12:16 kuanleung 阅读(11) 评论(0) 推荐(0)
（7）爬虫requests库
摘要：import requests header = { 'User-Agent':'Mozilla/5.0(Windows;U;WindowsNT6.1;en-us)AppleWebKit/534.50(KHTML,likeGecko)Version/5.1Safari/534.50' } url = 阅读全文
posted @ 2020-07-09 11:50 kuanleung 阅读(7) 评论(0) 推荐(0)
(6)爬虫Cookic使用
摘要：from urllib.request import urlopen from urllib.request import Request url = "https://user.youku.com/page/usc/index/?spm=a2hcb.12675304.uerCenter.5!6~5 阅读全文
posted @ 2020-07-07 19:40 kuanleung 阅读(51) 评论(0) 推荐(0)
(5)爬虫ip代理设置
摘要：from urllib.request import urlopen from urllib.request import Request,build_opener,HTTPHandler,ProxyHandler from urllib.parse import urlencode import 阅读全文
posted @ 2020-07-07 19:20 kuanleung 阅读(8) 评论(0) 推荐(0)
（4）爬虫 ssl证书，https
摘要：''' ssl证书，https ''' from urllib.request import urlopen from urllib.request import Request from urllib.parse import urlencode import ssl url = 'https:/ 阅读全文
posted @ 2020-07-07 17:33 kuanleung 阅读(45) 评论(0) 推荐(0)
（3）爬虫ajax请求
摘要：from urllib.request import urlopen from urllib.request import Request from urllib.parse import urlencode b_url='https://movie.douba.com/j/chart/top_li 阅读全文
posted @ 2020-07-07 17:00 kuanleung 阅读(12) 评论(0) 推荐(0)
（2）爬虫post请求
摘要：‘’‘ from urllib.request import urlopen from urllib.request import Request from urllib.parse import urlencode url='https://cnpassport.youku.com/newlogi 阅读全文
posted @ 2020-07-07 15:28 kuanleung 阅读(13) 评论(0) 推荐(0)
（1）爬虫笔记备份
摘要：''' 第一天 import requests from urllib.request import urlopen url = 'http://quote.eastmoney.com/us/BIDU.html?from=BaiduAladdin' response = urlopen(url) i 阅读全文
posted @ 2020-07-06 12:02 kuanleung 阅读(7) 评论(0) 推荐(0)

上一页 1 2 3