Asset check and blocking auto-materialize #22427
Unanswered
ssillaots-boku
asked this question in
Q&A
Replies: 1 comment 2 replies
-
Is this something Dagster will plan to implement in the future (blocking downstream asset's auto-materialize when upstream's asset check fails)? |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I haven't found a similar topic yet but please point me to it if there's one.
Is there a way to make asset check failure block asset materialization for downstream asset if the downstream asset has auto-materialize?
Scenario:
Two assets:
upstream
anddownstream
. Upstream asset is a dbt asset which has a test. So the ideal flow would be like this:dbt run
dbt test
downstream_
doesn't runRight now 4th step doesn't work as expected and downstream asset starts materializing.
You might say that why don't I add the same dbt test to
downstream
asset. Then the asset check would run beforedownstream
asset rather than afterupstream
asset. It's totally fine to do that if you have 1 or maybe even 2 downstream assets. But the problem arises when you have a bunch (5+) of downstream assets that are dependent on the same upstream asset. You would then have to add the same test to all downstream assets instead of 1 test to the upstream asset. So a lot of duplication and tech debt for the future.Beta Was this translation helpful? Give feedback.
All reactions