Skip to content

nick-korres/job-description-scrapper

Repository files navigation

Overview

A list of utilities written in python to search filter and classify job postings from linkedin. The search results are saved , essentially cached , in a sqlite file and should be periodically invalidated.

search

A sample script that uses selenium to search for job postings and save them. So far , it seems that to get best results we should search using multiple similar terms , with overlapping results then use other tools to search on those curated results

filter

Apply regex text filters to the results cached using the previous tools

How to run

Assuming you have python installed , you need to do the following to run these scripts :

First time installation

  1. Create a virtual environment
python -m venv venv
  1. Install dependencies
pip install -r requirements.txt
  1. Setup db to create required tables run
py ./db/init_db.py

To use utils

Activate the virtual environment

.\venv\Scripts\activate

search.py

filter.py

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages