Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[module-loaders] Use new loader code in checks loaders #26514

Conversation

dpeng817
Copy link
Contributor

@dpeng817 dpeng817 commented Dec 15, 2024

Make use of the new asset loading internal APIs under the hood on the checks loaders. This allows us to actually delete the old prefix_assets method, which was still in use here.

A lot of the added code lines here are explicit coercion to "asset checks definitions" from assetsdefinitions after they have had attributes replaced. I wonder if this is actually necessary and can't be removed in another PR which handles that case holistically.

But now at least everything is using the same stuff under the hood, and we're able to remove this tangled mess of helper methods.

Copy link
Contributor Author

dpeng817 commented Dec 15, 2024

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

This stack of pull requests is managed by Graphite. Learn more about stacking.

@dpeng817 dpeng817 changed the title Use new loader code in checks Use new loader code in checks loaders Dec 15, 2024
Copy link

github-actions bot commented Dec 15, 2024

Deploy preview for dagster-docs ready!

Preview available at https://dagster-docs-i902ewhyw-elementl.vercel.app
https://dpeng817-use-new-loader-in-checks.dagster.dagster-docs.io

Direct link to changed pages:

@dpeng817 dpeng817 force-pushed the dpeng817/handle_attribute_mapping branch from 46d0738 to b5ea375 Compare December 16, 2024 18:43
@dpeng817 dpeng817 force-pushed the dpeng817/use_new_loader_in_checks branch from d6b7692 to 1e84402 Compare December 16, 2024 18:43
@dpeng817 dpeng817 marked this pull request as ready for review December 16, 2024 18:52
@dpeng817 dpeng817 requested a review from OwenKephart December 16, 2024 18:52
Copy link
Contributor

@OwenKephart OwenKephart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

generally supportive, but some things seem suspicious -- curious about the current test coverage for adding a key prefix in the presence of AssetChecksDefinitions

@dpeng817 dpeng817 force-pushed the dpeng817/handle_attribute_mapping branch from b5ea375 to 54dab1e Compare December 18, 2024 02:52
@dpeng817 dpeng817 force-pushed the dpeng817/use_new_loader_in_checks branch from 1e84402 to aa8efe8 Compare December 18, 2024 02:52
@dpeng817 dpeng817 force-pushed the dpeng817/handle_attribute_mapping branch from 54dab1e to 1efb94c Compare December 18, 2024 03:34
@dpeng817 dpeng817 force-pushed the dpeng817/use_new_loader_in_checks branch from aa8efe8 to 0309dba Compare December 18, 2024 03:35
@dpeng817 dpeng817 changed the title Use new loader code in checks loaders [module-loaders] Use new loader code in checks loaders Dec 18, 2024
@dpeng817 dpeng817 force-pushed the dpeng817/handle_attribute_mapping branch from 1efb94c to 29c4c40 Compare December 18, 2024 18:36
@dpeng817 dpeng817 force-pushed the dpeng817/use_new_loader_in_checks branch from 0309dba to 5be4d04 Compare December 18, 2024 18:36
@dpeng817 dpeng817 force-pushed the dpeng817/handle_attribute_mapping branch from 29c4c40 to 84a8e05 Compare December 18, 2024 18:41
@dpeng817 dpeng817 force-pushed the dpeng817/use_new_loader_in_checks branch from 5be4d04 to 292e31e Compare December 18, 2024 18:41
Base automatically changed from dpeng817/handle_attribute_mapping to dpeng817/delete_extra_source_assets December 18, 2024 18:46
@dpeng817 dpeng817 merged commit 292e31e into dpeng817/delete_extra_source_assets Dec 18, 2024
1 of 2 checks passed
@dpeng817 dpeng817 deleted the dpeng817/use_new_loader_in_checks branch December 18, 2024 19:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants