Web Scraping using Python Scrapy_BS4 - Software

Install the following software before web scraping.

• Visual Studio Code
• Python and Pip 

pip install virtualenv

 

virtualenv myenv

 

 Activating a Virtual Environment

Myenv\scripts\activate     -Windwos
Source myenv/scripts/avtivate    -Mac

 

 

•  BeautifulSoup

Documents: https://www.crummy.com/software/BeautifulSoup/bs4/doc/

pip install bs4

 

 Check the installation status of beautiful soup.

 

•  Scapy

Documents:https://scapy.readthedocs.io/en/latest/

pip install scrapy