Skip to content

[Bug]: docker_cwl_entrypoint.sh can't handle large number of inputs #326

@mike-gangl

Description

@mike-gangl

Checked for duplicates

Have you checked for duplicate issue tickets?

Yes - I've already checked

Describe the bug

The ASIPS team attempted to provide a stac_catalog of 240 input files. This wasn't referenced as a URL or a file to download, but as a string sent to the airflow API directly. The error encountered was:

[2025-02-14, 20:12:22 UTC] {pod_manager.py:489} INFO - [base] exec /usr/share/cwl/docker_cwl_entrypoint.sh: argument list too long

It seems the STAC catalog "string" is simply too long.

Reproducible steps

Gathering more infromation on this right now, https://jpl-eosdis.slack.com/archives/C075D7F9EUD/p1739565358265049 contains the conversation.

Note: a work around "kind of" exists for this as we can query the UDS catalog for the data files to pass in successfully. But if the data are not in U-DS, or we can't craft a query to select the specific files required, then this fix will be required.

What is your environment?

Environment was ASIPS-INT environment.

Metadata

Metadata

Assignees

Labels

U-SPSbugSomething isn't working

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions