Replies: 1 comment 13 replies
-
Because your This may not be possible to achieve, as you have found. Instead, make your |
Beta Was this translation helpful? Give feedback.
13 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
I'm new to python and fsspec, so hopefully there is an obvious answer to my question. Thanks for the help!
Issue
I need to fetch a file from an s3 bucket using https and a pre-signed URL. The URL produced is quite long, commonly over 1500 characters (mostly query params). If I use the code below, I get an OS exception:
File name too long
.I walked through the code and can see that the
rpath
is typically appended to thelpath
for storage inasyn.py
:Question
Am I misusing the lib or protocol? Is there a way to configure fsspec to scrub query params (or use some arbitrary string) for the appended destination string?
Setup
MacOS Ventura M1 Pro
fsspec-2023.12.2
Python 3.9, 3.10 (tried both)
Beta Was this translation helpful? Give feedback.
All reactions