摘要:
1Crawl a website with scrapyscrapy is a crawler framework writtten in Python, Crawl a website with scrapy described how to use it.I follow the guide and wrote a crawler, quite simple and easy to write.I have written a crawler using BeatifulSoup, urllib2, pyquery, eventlet, MongoDB before, using Scra 阅读全文