Skip to content

Commit

Permalink
Cleaning up the entry script
Browse files Browse the repository at this point in the history
  • Loading branch information
LucaCinquini committed Feb 27, 2024
1 parent 7bc57d1 commit 8a11437
Show file tree
Hide file tree
Showing 2 changed files with 15 additions and 6 deletions.
16 changes: 15 additions & 1 deletion airflow/dags/docker_cwl_pod.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,21 @@ spec:

containers:
- name: cwl-docker
image: ghcr.io/unity-sds/unity-sps/sps-docker-cwl:develop-rnd-1
image: ghcr.io/unity-sds/unity-sps/sps-docker-cwl:develop-rnd-3
command: ["/usr/share/cwl/docker_cwl_entrypoint.sh"]
args: ["https://raw.githubusercontent.com/unity-sds/sbg-workflows/1.0/preprocess/sbg-preprocess-workflow.cwl", '{
"input_processing_labels": [
"lable1",
"label2"
],
"input_cmr_collection_name": "C2408009906-LPCLOUD",
"input_cmr_search_start_time": "2024-01-03T13:19:36.000Z",
"input_cmr_search_stop_time": "2024-01-03T13:19:36.000Z",
"input_unity_dapa_client": "40c2s0ulbhp9i0fmaph3su9jch",
"input_unity_dapa_api": "https://d3vc8w9zcq658.cloudfront.net",
"input_crid": "001",
"output_collection_id": "urn:nasa:unity:unity:dev:SBG-L1B_PRE___1",
"output_data_bucket": "sps-dev-ds-storage"
}']
securityContext:
privileged: true
5 changes: 0 additions & 5 deletions airflow/docker/cwl/docker_cwl_entrypoint.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,13 +27,8 @@ do
sleep 1
done

printenv | grep AWS

ls -l /var/run/secrets/eks.amazonaws.com/serviceaccount/token

# Execute CWL workflow
. /usr/share/cwl/venv/bin/activate
aws s3 ls
cwl-runner --outdir "$output_dir" --no-match-user --no-read-only "$cwl_workflow" /tmp/job_args.json
deactivate

Expand Down

0 comments on commit 8a11437

Please sign in to comment.