This repository consists of Scrapy scripts to gather Brutalist buildings' pictures from SOSBrutalism website.
- Run the jobs spider
- Run get_ids.py
- Run the get_jsons spider
- Run consolidate.py
The desired file is data.json which contains all the URLs as well as the descriptions and the licenses.