Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for S3 bucket #523

Open
effeminati opened this issue Jul 8, 2024 · 2 comments
Open

Support for S3 bucket #523

effeminati opened this issue Jul 8, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@effeminati
Copy link

I would like to process data directly on the cloud without the need to download data to the local filesystem. I tried, but I was not able to open remote files with Sarpy.

Do you foresee extending the interface to do this?

Sarpy is a valuable library capable of opening and standardizing data from many different SAR sensors. Making it able to work on the cloud would make a significant difference.

@pressler-vsc
Copy link
Collaborator

Yes! As you point out, only a very limited subset of interfaces (e.g.) are architected in a way that is compatible with something like smart-open.

There is currently an effort underway to modernize SarPy, and standardizing I/O in a way that enables working with large remote files is a key goal.

@naething
Copy link
Collaborator

For the file types that are currently supported you can see an example of how to do so here:

https://sarpy.readthedocs.io/en/latest/examples/first_example.html#opening-remote-file

@pressler-vsc pressler-vsc added the enhancement New feature or request label Aug 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants