Skip to content

A series of projects on web scraping for data analyses

License

Notifications You must be signed in to change notification settings

amaboh/scrapingbots

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrapingbots

A series of projects on web scraping for data analyses

The main aim of this projec to illustrates steps in scraping mutliple pages from the web into a CSV file for analyses

###File structure env file

  • Jupyter notebook - single page
  • Python script - Multipage to csv

Environment setup

  • python3 -m venv env
  • source env/bin/activate
  • pip install
    • requests
    • bs4
    • pandas N.B do not forget to disactivate the environment variable after actiavtion [deactivate]

Local setup

  1. git clone
  2. Install dependencie
    • beautiful soup
    • Pandas
    • requests
  3. run

About

A series of projects on web scraping for data analyses

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published