Web-Scraping-Python

1. Internshala :

Additional Python Libraries Required :

• BeautifulSoup
pip install beautifulsoup4

• Pandas
pip install pandas

• Requests
pip install requests

Usage :

1. pythondjangointernship.py :

This program is used to get details of all the Python/Django category internships from first page. It will store the details in pythondjangointernship.xlsx sheet. To Run the program :

• Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program.
• Use Command :
python pythondjangointernship.py

2. keyword_internship.py :

This program is used to get details of all the internship of specified Keyword. The keyword should be specified during the execution of program. The program will ask for keyword, after running it. It will store the details in keyword_internship.xlsx sheet. To Run the program :

• Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program.
• Use Command :
python keyword_internship.py

2. Google image Downloader :

Additional Python Libraries Required :

• BeautifulSoup
pip install beautifulsoup4

• Requests
pip install requests

Usage :

Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program. Type the following command in your CMD or Terminal:

python image_downloader.py -n 50 -s "apples" -d "E:\images" Here, change the following as per your needs:

-n: Number of Images to be downloaded (Default = 10).

-s: Search Query (Default = red roses).

-d: Directory where to save the images(Default = Download - the directory present with code).

3. Flipkart

Pre-requisites :

1. Additional Python Libraries Required :

• Selenium
pip install selenium

• BeautifulSoup
pip install beautifulsoup4

• Pandas
pip install pandas

2. chromedriver (For Windows operating system you can download the chromedriver from this repository)

Usage :

• Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program.
• Use Command :
python laptop_details.py

• The laptops details will be stored in laptop_details.csv file.

4. Youtube :

Additional Python Libraries Required :

• BeautifulSoup
pip install beautifulsoup4

• Pandas
pip install pandas

• Requests
pip install requests

Usage :

• Open your Command Prompt or Terminal and change directory to the same folder where you have saved the program.
• Use Command :
python youtube_trending.py

• The videos details will be stored in youtube_trending.xlsx file.