泉州热门景点排名及点评数量

 

 

获取泉州热门景点排名及点评数量

       1.打开马蜂窝泉州景点网页

http://www.mafengwo.cn/search/q.php?q=%E6%B3%89%E5%B7%9E&t=&seid=&mxid=&mid=&mname=&kt=1

 

       2.右键打开网页源代码

 

       3.编写代码

设置请求头，添加cookies，解决网站的反爬

headers={'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.116 Safari/537.36',
        'Referer': 'http://www.mafengwo.cn/search/q.php?q=%E6%B3%89%E5%B7%9E&t=&seid=&mxid=&mid=&mname=&kt=1',
        'Cookie': 'mfw_uuid=5e5e21cd-8da9-15c9-b47c-3948a8491bba; UM_distinctid=1709fb40f30530-0a40c7816fa6e5-313f68-100200-1709fb40f322be; uva=s%3A78%3A%22a%3A3%3A%7Bs%3A2%3A%22lt%22%3Bi%3A1583227343%3Bs%3A10%3A%22last_refer%22%3Bs%3A6%3A%22direct%22%3Bs%3A5%3A%22rhost%22%3Bs%3A0%3A%22%22%3B%7D%22%3B;__mfwurd=a%3A3%3A%7Bs%3A6%3A%22f_time%22%3Bi%3A1583227343%3Bs%3A9%3A%22f_rdomain%22%3Bs%3A0%3A%22%22%3Bs%3A6%3A%22f_host%22%3Bs%3A1%3A%22m%22%3B%7D;__mfwuuid=5e5e21cd8da915c9b47c3948a8491bba;__jsluid_h=d1b95565cbfd799c011d4b00bfa416c8;_r=baidu;_rp=a%3A2%3A%7Bs%3A1%3A%22p%22%3Bs%3A18%3A%22www.baidu.com%2Flink%2%3Bs%3A1%3A%22t%22%3Bi%3A1583228126%3B%7D;PHPSESSID=vb6d7h8sslaugnbjrkth75bi11; oad_n=a%3A3%3A%7Bs%3A3%3A%22oid%22%3Bi%3A1029%3Bs%3A2%3A%22dm%22%3Bs%3A15%3A%22www.mafengwo.cn%22%3Bs%3A2%3A%22ft%22%3Bs%3A19%3A%222020020+20%3A04%3A33%22%3B%7D;__mfwc=direct;Hm_lvt_8288b2ed37e5bc9b4c9f7008798d2de0=1583227342,1583228127,1584705879;__omc_chl=;__omc_r=;bottom_ad_status=0;CNZZDATA30065558=cnzz_eid%3D551576681583225515https%253A%252F%252Fwww.mafengwo.cn%252F%26ntime%3D1584702242; __mfwb=60750bb51bd8.1.direct;__mfwa=1583227342020.28864.3.1584705877483.1584714877901;__mfwlv=1584714877;__mfwvn=3;__mfwlt=1584714877;Hm_lpvt_8288b2ed37e5bc9b4c9f7008798d2de0=1584714878'
         }
def get_data():
    txt=requests.get('http://www.mafengwo.cn/search/q.php?q=%E6%B3%89%E5%B7%9E&t=&seid=&mxid=&mid=&mname=&kt=1',headers=headers).text
    html=etree.HTML(txt)
    name=html.xpath('//div[@class="content top_pois-list"]//p[@class="title"]/text()')
    votenum=html.xpath('//div[@class="content top_pois-list"]//p[@class="subtitle"]//font[@color="#474747"]/text()')
    f = open('fp.text', 'a+', encoding='utf-8')
    f.write('排名   景区名称   蜂评数  '+‘\n’)
    for i in range(8):
        f.write(str(i+1)+'  '+name[i]+'   '+votenum[i]+‘\n’)
        print(i+1,name[i],votenum[i])

if __name__ == '__main__':
    get_data()

 

 

 

4    输出结果

  

 

 

 

5    网页图