Skip to content
This repository has been archived by the owner on May 8, 2024. It is now read-only.

#256 - Deploy Airflow to MCP venues with Terraform (no adaptation yet) #276

Merged
merged 14 commits into from
Feb 20, 2024
Merged

#256 - Deploy Airflow to MCP venues with Terraform (no adaptation yet) #276

merged 14 commits into from
Feb 20, 2024

Conversation

drewm-swe
Copy link
Contributor

Purpose

  • This PR adds support for deploying Airflow in a pre-existing EKS cluster in MCP.

Proposed Changes

  • [ADD] Terraform submodule for deploying Airflow into a pre-existing EKS cluster.
  • [CHANGE] Lint various files with pre-commit hooks

Issues

Testing

U-SPS Regression Test for MCP Dev

@drewm-swe
Copy link
Contributor Author

Please find instructions for deploying SPS Airflow here:
https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/admin-guide/sps-airflow-deployment-with-terraform

LucaCinquini
LucaCinquini approved these changes Feb 20, 2024
View reviewed changes
Copy link
Collaborator

@LucaCinquini LucaCinquini left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I followed the instructions and it all worked, including the smoke test and executing the 2 example DAGs from the Airflow UI.

@drewm-swe drewm-swe merged commit a89ef92 into main Feb 20, 2024
2 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@LucaCinquini LucaCinquini LucaCinquini approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@drewm-swe @LucaCinquini