Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[dagster-airlift] improve unit test speed #23324

Merged
merged 1 commit into from
Aug 3, 2024
Merged

Conversation

dpeng817
Copy link
Contributor

Moves shared implementation to a shared fixture directory, and switches how we determine when airflow is stood up. This speeds up tests to take a few seconds instead of >20 minutes.

Base automatically changed from dpeng817/airlift_examples_testing to master July 30, 2024 00:35
@dpeng817 dpeng817 requested a review from schrockn July 30, 2024 00:36
@dpeng817 dpeng817 changed the title [dagster-airlift] fix tests [dagster-airlift] improve test speed Jul 30, 2024
@dpeng817 dpeng817 changed the title [dagster-airlift] improve test speed [dagster-airlift] improve unit test speed Jul 30, 2024
Copy link
Member

@schrockn schrockn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As long as we are restructuring tests, I think we should have a top-level "integration_tests" folder and "unit_tests" folder right under "dagster_airlift_tests".

During active development I would like to be able to quickly run "unit_tests" without spinning up a bunch of custom infra and that instead relies on fakes or whatever.

Copy link
Member

@schrockn schrockn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's do move these tests around at the tip of the stack

@dpeng817 dpeng817 merged commit d792196 into master Aug 3, 2024
1 check passed
@dpeng817 dpeng817 deleted the dpeng817/fix_tests branch August 3, 2024 23:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants