使用Python抓取网页图片

      今天写了一个Python小程序，用来抓取网页图片.

     

 1import win32com.client,time,win32inet,win32file,os
 2class ImgDownloader:
 3    def __init__(self,url,dir):
 4        self.__dir=dir
 5        self.__ie=win32com.client.Dispatch('InternetExplorer.Application')
 6        self.__ie.Navigate(url)
 7        self.__wait__()
 8
 9    def __wait__(self):
        while self.__ie.Busy:
            time.sleep(0.1)

    def start(self):
        self.__wait__()
        imgs=self.__ie.Document.getElementsByTagName('img')
      
        for i in range(imgs.length):
            try:
                cachInfo=win32inet.GetUrlCacheEntryInfo(imgs[i].src)
                if cachInfo:
                    path=cachInfo['LocalFileName']
                    pathinfo=path.split('\\')
                    pathinfo.reverse()
                    filename=('[%d]' % i) + pathinfo[0]
 
                    win32file.CopyFile(path,os.path.join(self.__dir,filename),True)
            except:
                pass
    def close(self):
        self.__ie.Quit()

if __name__=='__main__':
    d=ImgDownloader('http://image.baidu.com/i?ct=201326592&cl=2&lm=-1&tn=baiduimage&pv=&word=boy&z=0','c:\\temp\\')
    d.start()
    d.close()

 

原理：在Python使用com 接口运行IE浏览器，然后打开网页，获取网页所有图片的URL，最后利用win32api函数GetUrlCacheEntryInfo找出图片相应的本地缓存文件,复制到指定目录。