Skip to content

Husterknupp/party-insights-shenanigans

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Party Insights Shenanigangs

Find scraped Wikipedia content in output/ directory.

Dev Setup

  • install Node.js (find correct node version in .nvmrc file)
  • run yarn install

Run Main Script

This will execute the ETL pipeline:

  1. download Wikipedia pages with politician/cabinet info tables (Bund und Länder)
  2. get relevant infos from html tables (names, parties, ministerial position, etc.)
  3. write infos to json and markdown files
yarn install
yarn start

Run Tests

yarn install
yarn test

About

Scraping politician data from Wikipedia.

Resources

License

Stars

Watchers

Forks

Releases

No releases published