Skip to content

Persistent EOF errors when trying to sync directory #3

Description

@isabanin

Hey,

We are using s3sync extensively to sync thousands of Subversion and Git repositories to S3. Most of the time it works just great, but recently I had this very strange case when s3sync would fail to sync one specific Subversion repository. I ran s3sync with debugging enabled and noticed this:

s3TreeRecurse xxx xxx /db/revprops/102/
Trying command list_bucket xxx prefix xxx/xxx/db/revprops/102/ max-keys 200 delimiter / with 100 retries left
EOF error: end of file reached
No result available
99 retries left, sleeping for 30 seconds

It would go through all 100 retires, throw the same EOF error every time and then exit. Every time I run it it fails on a different directory inside "db/revprops". This directory contains around 12,000 files.

Any ideas?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions