Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backups ending after 100 users #39

Open
bryce-conmet opened this issue May 11, 2021 · 4 comments
Open

Backups ending after 100 users #39

bryce-conmet opened this issue May 11, 2021 · 4 comments

Comments

@bryce-conmet
Copy link

My backups have recently began to have issues. It seems that after ~100 users backed up, it just stops. I do have a couple errors but I have ContinueOnError=true, so it is not stopping on those.

It is saying
-------Start backup for user [100 of 100]: Username--------------
Created

*** Org backup done -> [98] users total backed up in 18 mins 56 seconds ***. There were two errors, which account for the two.

Is there a limit on the number of users that can be backed up in this solution?

Thank you.

@djvbcg
Copy link

djvbcg commented May 12, 2021

Same here. Stops at exactly 100 users. We have 189 (licensed & unlicensed). I tried now 3 times today, always stops at the same user (nr 100).
The jar is still the same. Did the OAuth implementation bring this limit?

@djvbcg
Copy link

djvbcg commented May 17, 2021

Same here. Stops at exactly 100 users. We have 189 (licensed & unlicensed). I tried now 3 times today, always stops at the same user (nr 100).
The jar is still the same. Did the OAuth implementation bring this limit?

This morning the backup went passed the 100 users and created the local copy for all users.
After the folder was created for the last user (non-licensed, so empty folder), it is not clear what it is doing now. Checking the nr of files in all the folders learned that it is still active and downloading files, maybe attachments.

@bryce-conmet
Copy link
Author

What the heck....mine at least part of the way through...past 100 this time, but then started getting a bunch of unknownhostexception errors. I think I might have to actually pay for a backup solution. This one has been too flaky.

@djvbcg
Copy link

djvbcg commented May 18, 2021

I only had one error.
Settings in the smartsheet-backup.properties file were:
accessToken=
outputDir=backup
continueOnError=true
#zipOutputDir=true
downloadThreads=8
allDownloadsDoneTimeout=120

Next time I will try downloadThreads=6, just to try the effect.

The error was:
[2021-05-17 09:40:14] *** ERROR 1 *** [SmartsheetGetAttachmentDetailsException: Failed to get attachment with name [a_filename] and id [some_id] belonging to sheet [a_sheetname] due to IOException: GET https://api.smartsheet.com/2.0/sheets/..../attachments/.... returned: 429 - Too Many Requests {
"errorCode" : 4003,
"message" : "Rate limit exceeded.",
"refId" : "4xa42056orr1"
}

So the Rate limit exceeded points me to trying downloadThreads=6

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants