CHANGELOG.md

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[Unity Release 24.4] - 2025-01-02

Tags

• SPS Version 2.4.0 (new)
• OGC API Version 2.0.0 (unchanged)
• OGC Python Client Version 2.0.1 (new)

Upgrade Guide

• The CWL DAG ("cwl_dag.py") has changed: instead of requesting a certain amount of CPU ("request_cpu") and memory ("request_memory)" separately, the client need to specify the desired EC2 instance ("request_instance_type"). The value needs to be one of those shown in the drop-down menu of the User Interface (for example, "r7i.xlarge", "c6i.8xlarge", etc.). The client can still specify the desired size of the attached disk ("request_storage").

• The SPS User Interface (Airflow) can be accessed via either of the following methods:

  • The top-level URL (for example, "https://www.dev.mdps.mcp.nasa.gov:4443/unity/dev/sps/home"), which will require a Cognito login and (temporarily) an additional Airflow login.
  • The mid-level proxy (for example, "http://unity-dev-httpd-alb-1659665968.us-west-2.elb.amazonaws.com:8080/unity/dev/sps/"), which requires an Airflow login, and is only accessible within the JPL VPC.

• A new prototype CWL Modular DAG ("cwl_dag_modular.py") is available, which will run the stage-in, process and stage-out tasks as separate CWL workflow, but all in the same EC2 node. To use this DAG, users will have to rewrite and modularize their existing CWL workflows which were written as a single document.

Repositories

• unity-sps: https://github.com/unity-sds/unity-sps/releases/tag/2.4.0
• unity-sps-ogc-processes-api: https://github.com/unity-sds/unity-sps-ogc-processes-api/releases/tag/2.0.0
• unity-sps-ogc-processes-api-client-python: https://github.com/unity-sds/unity-sps-ogc-processes-api-client-python/releases/tag/2.0.1

Epics

• EPIC: Airflow/WPS-T Integration
  • [[New Feature]: Publish ogc-api-python-client to PyPi]
• EPIC: SPS Infrastructure
  • [New Feature]: Upgrade SPS library versions
  • [New Feature]: Enforce SSL access on SPS S3 buckets
  • [New feature] Enforce SSL on SPS endpoints
  • [New Feature] Upgrade Apache Airflow to latest version 2.10.3
  • [New Feature] Add more CWL workflows to integration tests, use both the Airflow and OGC API
• EPIC: Documentation
  • [Documentation]: Document programmatic submission via OGC API
• EPIC: Airflow/Cognito Integration
  • [New Feature] Remove the SPS ALBs for Airflow and OGC API
  • [New Feature] Experiment with removing the Airflow authentication altogether
• EPIC: Demonstrated Scalability
  • [New feature]: Concurrent Execution of N SBG end-to-end workflows
  • [New Feature]: Scale up the EMIT workflow
• EPIC: Unity Marketplace
  • [New Feature]: Airflow Integration into Unity Marketplace
• EPIC: Application Package Standardization
  • [New Feature]: Stage-In Task
  • [New Feature]: Modular Process Task
  • [New Feature]: Modular Stage-Out Task
  • [Task]: Investigate logging and errors for CWL workflows

Docker Containers

• ghcr.io/unity-sds/unity-sps/sps-airflow:2.4.0
• ghcr.io/unity-sds/unity-sps/sps-docker-cwl:2.4.0
• ghcr.io/unity-sds/unity-sps-ogc-processes-api/unity-sps-ogc-processes-api:2.0.0

Documentation

• For Administrators:
  • SPS Deployment with Terraform
  • Interacting with an Existing SPS Deployment
  • SPS Airflow Custom Docker Image Build Instructions
  • SPS Post Deployment Operations
• For Deverlopers:
  • Tutorial: Deploy, Execute, and Undeploy a Process using the OGC API - Processes
• For Users:
  • Tutorial: Register and Execute a CWL Workflow

[Unity Release 24.3] - 2024-09-22

Tags

• SPS Version 2.2.0
• OGC API Version 2.0.0
• OGC Python Client Version 2.0.0

Repositories

• unity-sps: https://github.com/unity-sds/unity-sps/releases/tag/2.2.0
• unity-sps-ogc-processes-api: https://github.com/unity-sds/unity-sps-ogc-processes-api/releases/tag/2.0.0
• unity-sps-ogc-processes-api-client-python: https://github.com/unity-sds/unity-sps-ogc-processes-api-client-python/releases/tag/2.0.0

Epics

• EPIC: Security
  • [Bug]: Upgrade EKS 1.27 AMIs
• EPIC: Scaling
  • [New Feature]: Increase ephemeral disk space for Airflow workers
  • [New Feature]: Enable users to select the EC2 type to execute a workload
  • [New Feature]: Set the DAG run status to "failed" if the main worker task failed
  • [[New Feature]: Demonstrate use of ECR within an Airflow DAG (#186)
• EPIC: Airflow/WPS-T Integration
  • [New Feature]: Create test to deploy, execute and undeploy the CWL DAG
  • [New Feature]: Enable execution of OGC data processing requests with arbitrary parameter values
• EPIC: Production Venue Deployments
  • [New Feature]: Airflow HTTPD Proxy development and configuration
  • [New Feature]: Expose SPS health check endpoints
• EPIC: SPS Infrastructure
  • [New Feature]: Update documentation for SPS deployment
  • [New Feature]: Review the SPS GitBook documentation
  • [New Feature]: Store SPS Terraform state on S3
  • [New Feature]: Parametrize the SPS Integration Tests
  • [New Feature] Upgrade SPS to latest version of Airflow 2.10.0

Docker Containers

• ghcr.io/unity-sds/unity-sps/sps-airflow:2.2.0
• ghcr.io/unity-sds/unity-sps/sps-docker-cwl:2.2.0
• ghcr.io/unity-sds/unity-sps-ogc-processes-api/unity-sps-ogc-processes-api:2.0.0

Documentation

• For Administrators:
  • SPS Deployment with Terraform
  • Interacting with an Existing SPS Deployment
  • SPS Airflow Custom Docker Image Build Instructions
  • SPS Post Deployment Operations
• For Deverlopers:
  • Tutorial: Deploy, Execute, and Undeploy a Process using the OGC API - Processes
• For Users:
  • Tutorial: Register and Execute a CWL Workflow

[Unity Release 24.2] - 2024-07-01

Tags

• SPS Version 2.1.0
• OGC API Version 1.0.0
• OGC Python Client Version 1.0.0

Repositories

• unity-sps: https://github.com/unity-sds/unity-sps/releases/tag/2.1.0
• unity-sps-ogc-processes-api: https://github.com/unity-sds/unity-sps-ogc-processes-api/releases/tag/1.0.0
• unity-sps-ogc-processes-api-client-python: https://github.com/unity-sds/unity-sps-ogc-processes-api-client-python/releases/tag/1.0.0

Epics

• EPIC: Airflow/WPS-T Integration
  • [New Feature]: Implement the WPS-T methods execute() and status()
  • [New Feature]: Implement the WPS-T methods register() and unregister()
  • [New Feature]: Move the DAGs folder to a shared Persistent Volume
• EPIC: Airflow Scaling Improvements
  • [New Feature]: Implement autoscaling of Kubernetes worker nodes
  • [New Feature]: Nightly test for SBG end-to-end workflow
  • [Dependency]: PSE to provide analysis of resources needed by each SBG Task
  • [New Feature] Only use MCP Golden AMIs
  • [New Feature] Configure multiple pools of Kubernetes nodes
  • [New Feature] Retrieve venue-dependent parameters from SSM
  • [New Feature] Store deployment parameters as AIRFLOW variables
  • [New Feature] Enable Airflow "plugins" folder
  • [Task] Add TESTING.md file to SPS repo
• EPIC: SPS Infrastructure
  • [New Feature] Store SPS Terraform state on S3
• EPIC: SPS Security
  • [Bug]: Upgrade EKS 1.27 AMIs
  • [Bug]: Upgrade to EKS 1.29 AMIs

Docker Containers

• ghcr.io/unity-sds/unity-sps/sps-airflow:2.1.0
• ghcr.io/unity-sds/unity-sps/sps-docker-cwl:2.1.0
• ghcr.io/unity-sds/unity-sps-ogc-processes-api/unity-sps-ogc-processes-api:1.0.0

Documentation

• SPS Deployment with Terraform
• Interacting with an Existing SPS Deployment
• SPS Airflow Custom Docker Image Build Instructions
• Tutorial: Register, Execute, and Unregister a Process using the OGC API - Processes
• Tutorial: Register and Execute a CWL Workflow

---

[Unity Release 24.1] - 2024-04-09

Tag

Version 2.0.0

Repositories

• unity-sps: https://github.com/unity-sds/unity-sps/releases/tag/2.0.0
• unity-sps-ogc-processes-api: https://github.com/unity-sds/unity-sps-ogc-processes-api/releases/tag/2.0.0

Epics

• EPIC: Airflow Deployment
  • [New Feature]: Deploy EKS to MCP venues with Terraform
  • [New Feature]: Deploy Airflow to MCP venues with Terraform (no adaptation yet)
  • [New Feature]: Create a CWL Operator or simply a CWL DAG to execute a CWL workflow
  • [New Feature]: Using shared disk space for inter-task communication
  • [New Feature]: Implement autoscaling of Kubernetes pods on a given set of worker nodes
  • [Task] Migrate the new SPS with Airflow code to unity-sps repository
  • [New Feature] Allow choosing EC2 types when deploying an EKS cluster
  • [New Feature]: Allow propagation of permissions to Docker containers
  • [New feature] Add Terraform parameters to customize the amount of disk available to each Pod
• EPIC: SBG Venue Deployment
  • [New Feature]: Execution of available SBG worflows
  • [New Feature]: https://github.com/unity-sds/unity-sps/issues/39
  • [New Feature]: Execution of additional SBG workflows
  • [New Feature]: Deployment of latest SPS w/Airflow onto sbg venue
  • [New feature] Decompose SBG End-To-End CWL Workflow
• EPIC: SPS Infrastructure
  • [Task]: Cleanup of AWS resources
  • [Task]: Reconfigure SDS Automated Tests
  • [Task]: Update the SPS documentation for administrators

Docker Containers

• ghcr.io/unity-sds/unity-sps/sps-airflow:2.0.0
• ghcr.io/unity-sds/unity-sps/sps-docker-cwl:2.0.0
• ghcr.io/unity-sds/unity-sps-ogc-processes-api/unity-sps-ogc-processes-api:2.0.0

Documentation

• SPS EKS Cluster Provisioning with Terraform
• SPS Airflow Deployment with Terraform
• SPS Airflow Custom Docker Image Build Instructions

---

[Unity Release 23.3] - 2023-09-29

Repositories

• unity-sps-prototype: https://github.com/unity-sds/unity-sps-prototype/releases/tag/1.2.0
• unity-sps-api: https://github.com/unity-sds/unity-sps-api/releases/tag/1.2.0
• unity-sps-register_job: https://github.com/unity-sds/unity-sps-register_job/releases/tag/1.2.0
• unity-sps-workflows: https://github.com/unity-sds/unity-sps-workflows/releases/tag/1.2.0
• ades_wpst: https://github.com/unity-sds/ades_wpst/releases/tag/1.2.0
• unity-sps : https://github.com/unity-sds/unity-sps/releases/tag/1.2.0

Epics

• EPIC: workflow metadata
  • [unity-sps-prototype #210] [New Feature]: Store arbitrary labels in the Jobs Database
    • unity-sds/unity-sps-prototype#210
  • [unity-sps-prototype #211] [New Feature]: Query the Jobs Metadata by arbitrary labels
    • unity-sds/unity-sps-prototype#211
  • [unity-sps-prototype #217] [Risk]: Evaluate scalability of WPS-T API for querying the Jobs Database
    • unity-sds/unity-sps-prototype#217
• EPIC: chirp-workflow-execution
  • [unity-sps-workflows #8] [Dependency]: Stub implementation for CHIRP workflow
    • unity-sds/unity-sps-workflows#8
  • [unity-sps-workflows #10] [Dependency]: Docker container for execution of CHIRP rebinning PGE
    • unity-sds/unity-sps-workflows#10
  • [unity-sps-workflows #11] [Dependency]: Full implementation of CHIRP workflow
    • unity-sds/unity-sps-workflows#11
  • [unity-sps-workflows #12] [Dependency]: Docker container for CMR search
    • unity-sds/unity-sps-workflows#12
  • [unity-sps-workflows #13] [Dependency]: Docker container for Cataloging
    • unity-sds/unity-sps-workflows#13
  • [unity-sps-workflows #14] [Risk]: Processing large data volumes with CWL and Docker
    • unity-sds/unity-sps-workflows#14
  • [unity-sps-prototype #192 ] [New Feature]: Add an optional PVC to an SPS deployment
    • unity-sds/unity-sps-prototype#192
  • [unity-sps-prototype #195] [Dependency]: Docker container for stage-in step
    • unity-sds/unity-sps-prototype#195
  • [unity-sps-prototype #227] [New Feature]: Use stage EFS as data temporary location for CHIRP execution
    • unity-sds/unity-sps-prototype#227
• EPIC: no magic
  • [unity-sps-prototype #132] As a user, i want to be explicit about inputs into my process execution (no magic)!
    • unity-sds/unity-sps-prototype#132
  • [unity-sps-prototype #157] [New Feature]: Pass environment variables to a Docker container execution
    • unity-sds/unity-sps-prototype#157
• EPIC: sps-improvements-23.3
  • [unity-sps-prototype #221] [Dependency]: Tagging U-SPS resources
    • unity-sds/unity-sps-prototype#221
  • [unity-sps-prototype #222] [Dependency]: Add SPS API URL to the SSM store
    • unity-sds/unity-sps-prototype#222
  • [unity-sps-prototype #230] [Bug]: One SPS deployment can accidentally execute another SPS deployments deployed process containers
    • unity-sds/unity-sps-prototype#230
• EPIC: workflow-label-inputs
  • [unity-sps-prototype #160] [New Feature]: Pass arbitrary labels when requesting a job execution
    • unity-sds/unity-sps-prototype#160
  • [unity-sps-prototype #181] [Risk]: Define how labels should be specified during workflow submission
    • unity-sds/unity-sps-prototype#181

Docker Containers

• ghcr.io/unity-sds/unity-sps-prototype/hysds-core:unity-v1.2.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-ui-remote:unity-v1.2.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-mozart:unity-v1.2.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-grq2:unity-v1.2.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-verdi:unity-v1.2.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-factotum:unity-v1.2.0
• ghcr.io/unity-sds/unity-sps-prototype/ades-wpst-api:unity-v1.2.0
• ghcr.io/unity-sds/unity-sps-prototype/sps-api:unity-v1.2.0
• ghcr.io/unity-sds/unity-sps-prototype/sps-hysds-pge-base:unity-v1.2.0
• docker.elastic.co/elasticsearch/elasticsearch:7.9.3
• docker.elastic.co/logstash/logstash:7.10.2
• rabbitmq:3.11.13-management
• redis:7.0.10
• docker:23.0.3-dind
• busybox:1.36.0

Documentation

• Tutorial on using the WPS-T API to register an application package and to execute a job
  • https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/developers-guide/tutorial-execution-of-the-l1b-cwl-workflow-via-the-wps-t-api
• SPS API with examples
  • https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/users-guide/unity-sps-api
• Tutorial on pre-warming a U-SPS cluster
  • https://unity-sds.gitbook.io/docs/~/changes/TMwRbPjXYqq9MCfmRi31/developer-docs/science-processing/docs/developers-guide/manual-verification-testing-the-sps-prewarm-api
• Description of the Jobs Database: architecture and usage
  • https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/developers-guide/the-jobs-database#how-jobs-are-updated-in-the-database

Deployments

---

[Unity Release 23.2] - 2023-07-14

Repositories

• unity-sps : https://github.com/unity-sds/unity-sps/releases/tag/1.1.0
• unity-sps-prototype: https://github.com/unity-sds/unity-sps-prototype/releases/tag/1.1.0
• unity-sps-api: https://github.com/unity-sds/unity-sps-api/releases/tag/1.1.0
• unity-sps-register_job: https://github.com/unity-sds/unity-sps-register_job/releases/tag/1.1.0
• unity-sps-workflows: https://github.com/unity-sds/unity-sps-workflows/releases/tag/1.1.0
• ades_wpst: https://github.com/unity-sds/ades_wpst/releases/tag/1.1.0

Epics

• EPIC #7: jobs-database
  • [unity-sps-prototype #185] [Epic]: Implement Jobs Database
    • unity-sds/unity-sps-prototype#185
  • [unity-sps-prototype #186] [New Feature]: Send SNS message for job creation task
    • unity-sds/unity-sps-prototype#186
  • [unity-sps-prototype #187] [New Feature]: Send SNS message for job completion task
    • unity-sds/unity-sps-prototype#187
  • [unity-sps-prototype #188] [New Feature]: Consume SNS message for job creation task and job completion tasks
    • unity-sds/unity-sps-prototype#188
  • [unity-sps-prototype #189] [New Feature]: Deploy jobs database
    • unity-sds/unity-sps-prototype#189
  • [unity-sps-prototype #193) [New Feature]: Create SNS topic, SQS queue and Lambda function for Jobs Database as part of U-SPS deployment
    • unity-sds/unity-sps-prototype#193
  • [unity-sps-prototype $194] [Bug]: Prevent duplicate documents in jobs database
    • unity-sds/unity-sps-prototype#194
• EPIC #10: chirp-workflow-execution
  • [unity-sps-workflows #8] [Dependency]: Stub implementation for CHIRP workflow
    • unity-sds/unity-sps-workflows#8
  • [unity-sps-workflows #12] [Dependency]: Docker container for CMR search
    • unity-sds/unity-sps-workflows#12
  • [unity-sps-workflows #14] [Risk]: Processing large data volumes with CWL and Docker
    • unity-sds/unity-sps-workflows#14
  • [unity-sps-prototype #192] [New Feature]: Add an optional PVC to an SPS deployment
    • unity-sds/unity-sps-prototype#192
• EPIC #1: min/max scaling
  • [unity-sps-prototype #141] As a project Manager, i want to set maximum and minimum limits on scaling for processing at venue creation time (static)
    • unity-sds/unity-sps-prototype#141
• EPIC #4: no magic
  • [unity-sps-prototype #132] As a user, i want to be explicit about inputs into my process execution (no magic)!
    • unity-sds/unity-sps-prototype#132

Docker Containers

• ghcr.io/unity-sds/unity-sps-prototype/hysds-core:unity-v1.1.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-ui-remote:unity-v1.1.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-mozart:unity-v1.1.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-grq2:unity-v1.1.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-verdi:unity-v1.1.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-factotum:unity-v1.1.0
• ghcr.io/unity-sds/unity-sps-prototype/ades-wpst-api:unity-v1.1.0
• ghcr.io/unity-sds/unity-sps-prototype/sps-api-fork:unity-v1.1.0
• ghcr.io/unity-sds/unity-sps-prototype/sps-hysds-pge-base:unity-v1.1.0
• docker.elastic.co/logstash/logstash:7.10.2
• rabbitmq:3.11.13-management
• redis:7.0.10
• docker:23.0.3-dind
• busybox:1.36.0

Documentation

• Tutorial on using the WPS-T API to register an application package and to execute a job
  • https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/developers-guide/tutorial-execution-of-the-l1b-cwl-workflow-via-the-wps-t-api
• SPS API with examples
  • https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/users-guide/unity-sps-api
• Tutorial on pre-warming a U-SPS cluster
  • https://unity-sds.gitbook.io/docs/~/changes/TMwRbPjXYqq9MCfmRi31/developer-docs/science-processing/docs/developers-guide/manual-verification-testing-the-sps-prewarm-api

Deployments

• MCP Test:
  • Processing Endpoint (WPS-T API): http://a720fb4de892844bf884f037c17bb583-1070798053.us-west-2.elb.amazonaws.com:5001
  • Scaling Endpoint (SPS API): http://a7096fc6842e84da688b45586d194498-2116025617.us-west-2.elb.amazonaws.com:5002
• MCP Dev:
  • Processing Endpoint (WPS-T API): http://aa17aedf4454a4cc596a67a1efb73411-1350404365.us-west-2.elb.amazonaws.com:5001
  • Scaling Endpoint (SPS API): http://a440158f49fab4278bdcf2bcb145082b-625745.us-west-2.elb.amazonaws.com:5002

---

[Unity Release 23.1] - 2023-04-11

Repositories

• unity-sps : https://github.com/unity-sds/unity-sps/releases/tag/1.0.0
• unity-sps-prototype: https://github.com/unity-sds/unity-sps-prototype/releases/tag/1.0.0
• unity-sps-api: https://github.com/unity-sds/unity-sps-api/releases/tag/1.0.0
• unity-sps-register_job:
  • MCP-Dev: https://github.com/unity-sds/unity-sps-register_job/releases/tag/1.0.0-MCP_Dev
  • MCP-Test: https://github.com/unity-sds/unity-sps-register_job/releases/tag/1.0.0-MCP_Test
• unity-sps-workflows: https://github.com/unity-sds/unity-sps-workflows/releases/tag/1.0.0
• ades_wpst: https://github.com/unity-sds/ades_wpst/releases/tag/1.0.0

Epics

• EPIC #130: ancillary data
  • [unity-sps-prototype #148] Mount EFS partitions on U-SPS cluster
    • unity-sds/unity-sps-prototype#148
• EPIC #146: automatic testing
  • [unity-sps-prototype #153] Smoke test to deploy a simple process and execute a job request
    • unity-sds/unity-sps-prototype#153
• EPIC #132: no magic
  • [unity-sps #154]: Pass explicit input parameters to a WPS-T job request
    • unity-sds/unity-sps-prototype#154
  • [unity-sps-prototype #159]: Return the input parameters as part of the WPS-T DescribeProcess method
    • unity-sds/unity-sps-prototype#159
  • [unity-sps-prototype #167]: The WPS-T method to register a process may time out while building the PGE Docker image
    • unity-sds/unity-sps-prototype#167
• EPIC #142: processing-instance-types
  • [unity-sps-prototype #142]: As a project manager, i want to set default compute types for processing nodes at deploy time, so that i can predict costs for the system (Static)
    • unity-sds/unity-sps-prototype#154
• EPIC #162: u-sps-api
  • [unity-sps-prototype #163]: New SPS API with stub pre-warm method
    • unity-sds/unity-sps-prototype#163
  • [unity-sps-prototype #167]: Refactor the HySDS workers as a Kubernetes DaemonSet
    • unity-sds/unity-sps-prototype#170
  • [unity-sps-prototype #167]: Scale the number of worker nodes in the Kubernetes cluster
    • unity-sds/unity-sps-prototype#171

Docker Containers

• ghcr.io/unity-sds/unity-sps-prototype/hysds-core:unity-v1.0.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-ui-remote:unity-v1.0.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-mozart:unity-v1.0.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-grq2:unity-v1.0.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-verdi:unity-v1.0.0
• ghcr.io/unity-sds/unity-sps-prototype/hysds-factotum:unity-v1.0.0
• ghcr.io/unity-sds/unity-sps-prototype/ades-wpst-api:unity-v1.0.0
• ghcr.io/unity-sds/unity-sps-prototype/sps-api-fork:unity-v1.0.0
• ghcr.io/unity-sds/unity-sps-prototype/sps-hysds-pge-base:unity-v1.0.0
• docker.elastic.co/logstash/logstash:7.10.2
• rabbitmq:3.11.13-management
• redis:7.0.10
• docker:23.0.3-dind
• busybox:1.36.0

Documentation

• Tutorial on using the WPS-T API to register an application package and to execute a job
  • https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/developers-guide/tutorial-execution-of-the-l1b-cwl-workflow-via-the-wps-t-api
• SPS API with examples
  • https://app.gitbook.com/o/xZRqGQeQXJ0RP4VMj7Lq/s/UMIRhLdbRQTvMWop8Il9/developer-docs/science-processing/docs/users-guide/unity-sps-api
• Tutorial on pre-warming a U-SPS cluster
  • https://unity-sds.gitbook.io/docs/~/changes/TMwRbPjXYqq9MCfmRi31/developer-docs/science-processing/docs/developers-guide/manual-verification-testing-the-sps-prewarm-api

Deployments

• MCP Test:
  • Processing Endpoint (WPS-T API): http://a720fb4de892844bf884f037c17bb583-1070798053.us-west-2.elb.amazonaws.com:5001
  • Scaling Endpoint (SPS API): http://a7096fc6842e84da688b45586d194498-2116025617.us-west-2.elb.amazonaws.com:5002
• MCP Dev:
  • Processing Endpoint (WPS-T API): http://aa17aedf4454a4cc596a67a1efb73411-1350404365.us-west-2.elb.amazonaws.com:5001
  • Scaling Endpoint (SPS API): http://a440158f49fab4278bdcf2bcb145082b-625745.us-west-2.elb.amazonaws.com:5002

---