爬虫学习——urllib2三种方法的实例

不说废话直接插代码

 1 # coding:utf-8
 2 import urllib2
 3 import cookielib
 4 
 5 url= "http://www.baidu.com"
 6 print "第一种方法："
 7 response1 = urllib2.urlopen(url)
 8 print response1.getcode()
 9 print len(response1.read())
10 
11 print "第二种方法："
12 request=urllib2.Request(url)
13 request.add_header('user-agent','Mozilla/5.0')
14 response2 = urllib2.urlopen(request)
15 print response2.getcode()
16 print len(response2.read())
17 
18 print "第三种方法："
19 cj = cookielib.CookieJar()
20 opener = urllib2.build_opener(urllib2.HTTPCookieProcessor(cj))
21 urllib2.install_opener(opener)
22 response3=urllib2.urlopen(url)
23 print response3.getcode()
24

运行后如下图所示

 

posted @ 2017-07-07 17:08  ryuuku  阅读(312)  评论(0)  编辑  收藏  举报