Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Intuitive scheduling with dbt_assets #26621

Open
Auric-Manteo opened this issue Dec 20, 2024 · 0 comments
Open

Intuitive scheduling with dbt_assets #26621

Auric-Manteo opened this issue Dec 20, 2024 · 0 comments
Labels

Comments

@Auric-Manteo
Copy link

What's the use case?

We are moving our code from Dagster jobs to assets which is hardly straight forward with the current implementation.
We use several dbt operations like creating external sources, seeds, snapshots, dbt run and interleaved tests after every step instead of a simple dbt build and have dependencies on sources that need to be built beforehand.
https://docs.dagster.io/_apidocs/libraries/dagster-dbt#dagster_dbt.dbt_assets

Ideas of implementation

Add the parameters deps and automated_condition and make them work together with other dbt_assets and normal assets. The asset decorator already has these parameters, so I don't understand why this would be implemented differently: https://docs.dagster.io/_apidocs/assets#dagster.asset

Additional information

A more complex example about how to handle individual steps like snapshot, external sources and the dependencies between them would also be appreciated.

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants