Python-AutoTraderWebScraper

Scrapes the second hand car marketplace; only for educational purposes.

TODO

• Scrape all pages.
• Use click to enable CLI usage.
• Allow to feed in search query from a json file.
• Multi-threading to scrape different pages.

Install

Developed using python3.9.7; will probably work with 3.8+

Using pipenv as package and env manager:

• pipenv shell Init your env.
• pipenv install Install the required packages (requests and beautifulsoup4)

Alternatively you can use python3 -m venv venv to create a virtual environment to install these packages in.

Run

• python main.py

Updates

• 2021 11 19: Updated the code to run on their new website.