Skip to content

Is it recommended to have a single scheduled job for all assets running on a given cadence? #17833

Answered by jamiedemaria
rob-apella asked this question in Q&A
Discussion options

You must be logged in to vote

If the new assets don't have any shared dependencies with the assets in the existing schedule, you may find some benefits in introducing new schedules (and jobs) for the new assets. Some reasons for this are:

  • if some group of assets need to be not run daily (for example if a bug is found and you want to wait to materialize the assets until it is fixed) having multiple schedules will allow you to just turn off the affected assets and allow the others to continue materializing.
  • Multiple smaller jobs with a single purpose can cause less confusion if you need to do a manual run of one of the jobs

However, this is mostly a matter of preference and if you think having a single job that's run …

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by jamiedemaria
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants