How to pass arguments to an Op without creating a dependency #21861
AfonsoTellesD4D
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Im trying to call an Op from a job, but the value inside a particular variable that can be there sometimes and not in others. I've tried with Optionals, default_values and is_required. But none of them seem to work, because I always have to send the variable and that creates a dependency.
This is a representation of my code:
In this job, Im calling op1() and if the output b is return it triggers the op2. What Im trying to do is start op3() even if op2 is skipped.
I've tried using config_schema in the decorator but SparkDF is a custom class and not serialized by default.
Any suggestions?
Beta Was this translation helpful? Give feedback.
All reactions