python3.0开发的批量网站存活查看【源码笔记】

    因为个人在企业上班,企业网站比较多,如何快速查看网站是否正常,所以写了这个网站存活检测器。

  附上代码:

   

import requests
import sys
import threading
import queue

list_name = sys.argv[1]
num = int(sys.argv[2])

quit = queue.Queue()
threading_num = num

url_list = open(list_name,'r')
lines = url_list.readlines()
url_list.close()
for line in lines:
    line = line.rstrip()
    quit.put(line)


def crawler():
    while not quit.empty():
        url = quit.get()
        try:
            requests.packages.urllib3.disable_warnings()
            content = requests.get(url, verify=False, allow_redirects=True, timeout=10)
            if content.status_code == 200:
                print (url)
        except requests.RequestException as e:
            pass

if __name__ == '__main__':
    for i in range(threading_num):
        t = threading.Thread(target=crawler)
        t.start()

  

posted @ 2018-07-12 11:08  圆柱模板  阅读(158)  评论(0)    收藏  举报