You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to synchronize the content of an S3 to a local directory.
If there is an error on source (like a network timeout to reach the S3, or the bucket doesn't exist), the existing files in the directory can be all deleted.
I suspect there is a race condition between listing source and dest, and the first generating an error will fail the sync process.
I think about that because if the dest folder contain only few files, then the files are deleted.
But if the dest folder contains lots of files (like /tmp dir), no files are deleted, because src s3 lisiting fail before dest local dir listing finish.
The text was updated successfully, but these errors were encountered:
Hello,
I'm trying to synchronize the content of an S3 to a local directory.
If there is an error on source (like a network timeout to reach the S3, or the bucket doesn't exist), the existing files in the directory can be all deleted.
I suspect there is a race condition between listing source and dest, and the first generating an error will fail the sync process.
I think about that because if the dest folder contain only few files, then the files are deleted.
But if the dest folder contains lots of files (like /tmp dir), no files are deleted, because src s3 lisiting fail before dest local dir listing finish.
The text was updated successfully, but these errors were encountered: