爬虫基础-requests模块基础

requests模块:
    - 安装
        pip install requests
    - 定义url
        url = 'https://www.sougou.com/'
    - UA伪装
        headers = {
        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36',
        'cookie' : 'cookievalue'
    }
    - get带参数请求
        param = {
        'query': kw
        }
        response = requests.get(url=url, params=param, headers=headers)        

    - post带参数请求
        data = {
        'query': kw,
        }
        response = requests.post(url=post_url, data=data, headers=headers)
    - 指定网页编码
        response.encoding = 'utf-8'
    - 获取相应数据text(字符串) conten(二进制)-图片 json() (对象)
        page_text = response.text