Validating Data with Dagster Type Factories #10333
JSteinbauer
started this conversation in
Ideas
Replies: 1 comment 2 replies
-
|
Hey @JSteinbauer - have you had a chance to look at https://docs.dagster.io/integrations/pandera? |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
I didn't know about this additional module - thx for the info! |
Beta Was this translation helpful? Give feedback.
-
|
We should link to it from that guide |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Since this seems to be a common use case: Why isn't there any class method to create a DagsterType from a DataFrameSchema?
The case of validating pandas dataframes is covered in detail in https://docs.dagster.io/guides/dagster/dagster_type_factories#setup. While reading through it, I was surprised by how tedious it is to create such a validation.
Best,
Jakob Steinbauer
Beta Was this translation helpful? Give feedback.
All reactions