You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We mock HTTP requests in our scraper tests, but it would be good to occasionally run them against live source websites, too, to make sure we’re notified about breaking changes as soon as possible.
I think the easiest way would probably be to optionally disable/enable request mocking in tests. Then we could set up a scheduled GitHub Actions workflow that runs the tests against the live sources.
The text was updated successfully, but these errors were encountered:
tillprochaska
changed the title
Run scrapers against live source websites in regulari interval (nightly/weekly)
Run scrapers against live source websites in regular interval (nightly/weekly)
Nov 16, 2024
We mock HTTP requests in our scraper tests, but it would be good to occasionally run them against live source websites, too, to make sure we’re notified about breaking changes as soon as possible.
I think the easiest way would probably be to optionally disable/enable request mocking in tests. Then we could set up a scheduled GitHub Actions workflow that runs the tests against the live sources.
The text was updated successfully, but these errors were encountered: