爬取VIP视频

步骤一、在网页上打开一个视频，然后复制地址栏的地址
步骤二、在网页上输入http://jx.618g.com/?url=步骤一得出的地址
步骤三、待有视频出来就按F12，在Network中的name找到ts结尾的请求，然后把视频拉到最后，记录ts请求的尾数，点击任意ts请求，找到request_url

步骤四、修改以下程序的base_url、end_index和process_num进行下载

"""利用多线程，爬取视频"""
import requests
from multiprocessing import Pool


def download(base_url, index):
    headers = {
        'user-agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36'}
    url = base_url % index
    res = requests.get(url=url,
                       headers=headers)
    filename = url.rsplit('/', maxsplit=1)[1]
    with open(filename, 'wb') as f:
        f.write(res.content)
    print('----------------------------------------------------')


if __name__ == '__main__':
    base_url = 'https://iqiyi.cdn9-okzy.com/20200206/5942_55236082/1000k/hls/fd903296832000%03d.ts'
    # 记录影片的最后ts文件数字
    end_index = 682
    # 进程个数
    process_num = 5
    pool = Pool(process_num)
    for i in range(end_index + 1):
        pool.apply_async(download, (base_url, i,))
    pool.close()
    pool.join()
    print('下载完毕')

步骤五、cmd--->cd 下载目录--->copy /b *.ts new.mp4