Use GH Archive to pull 2024 stats #38
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
✅ Deploy Preview for nf-core-stats ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
mirpedrol
reviewed
Feb 4, 2025
| @@ -9,7 +9,9 @@ dependencies = [ | |||
| "dlt[cli,duckdb,motherduck]>=1.4.1", | |||
| "python-dotenv==1.0.0", | |||
| "requests>=2.31.0", | |||
There was a problem hiding this comment.
this version seems to not be available?
Comment on lines
+12
to
+13
| "slack-sdk>=3.33.0", | ||
| "pendulum>=2.1.2", |
There was a problem hiding this comment.
I am trying to resolve the environment with poetry and it has been running for an hour now 😢 ...
pipeline/gharchive_pipeline.py
Outdated
| current_hour = current.replace(hour=hour) | ||
| if current_hour > pendulum.now(): | ||
| break | ||
| yield from _process_gharchive_hour(current_hour) |
There was a problem hiding this comment.
When trying to run this I got this error
dlt.pipeline.exceptions.PipelineStepFailed: Pipeline execution failed at stage extract when processing package 1738663913.5012522 with exception:
<class 'dlt.extract.exceptions.ResourceExtractionError'>
In processing pipe raw_events: extraction of resource raw_events in generator events caused an exception: name '_process_gharchive_hour' is not defined
…d GitHub Pull Requests" and "Number Pipelines (released)" since october 2023.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.