Error message: curlCode: 18, Transferred a partial file with address : 51.*.*.*

infscape-appliance
1

Since last night, I have errors like this. After a few errors, urbackup stops. I did a reboot and it started again but after a while it stopped again.

What can I do?

Thanks in advance

CASE : #256.

last error:
S3 download of object a37/38/422_73a7521400 failed.
Last errors:
2022-04-14 08:47:51: WARNING: AWS-Client: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.
2022-04-14 08:47:51: WARNING: AWS-Client: Request failed, now waiting 12800 ms before attempting again.
2022-04-14 08:48:08: ERROR: AWS-Client: Curl returned error code 18 - Transferred a partial file
2022-04-14 08:48:08: ERROR: AWS-Client: HTTP response code: -1
Exception name:
Error message: curlCode: 18, Transferred a partial file with address : ...
9 response headers:
accept-ranges : bytes
content-length : 240505
content-type : binary/octet-stream
date : Thu, 14 Apr 2022 06:48:04 GMT
etag : “c83e7a6ce3aeb6f9a805e3d3eb5da9a2”
last-modified : Wed, 13 Apr 2022 15:18:26 GMT
x-amz-id-2 : tx462a2805dd8b4a5d9c251-006257c3a4
x-amz-request-id : tx462a2805dd8b4a5d9c251-006257c3a4
x-amz-version-id : 1649863106602482
2022-04-14 08:48:08: WARNING: AWS-Client: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.

2

The error always occurs with the same backup in progress and on the same file.

3
14/04/22 10:27 DEBUG GT: Loaded file Mouvements.FIC
14/04/22 10:27 DEBUG Loading file Mouvements.MMO (metadata only) id=7748
14/04/22 10:27 DEBUG PT: Hashing file Mouvements.FIC id=7747
14/04/22 10:27 DEBUG Loading file patch for Mouvements.NDX id=7749
14/04/22 10:27 DEBUG HT: Copying file: /media/backup/backups/JMAC/220414-1026/ATssac/data/Mouvements.FIC (id=7747)
14/04/22 10:27 DEBUG HT: Patching file /media/backup/backups/JMAC/220414-1026/ATssac/data/Mouvements.FIC with source /media/backup/backups/JMAC/220413-0618/ATssac/data/Mouvements.FIC patch size 186.326 KB reflink=true
14/04/22 10:27 DEBUG HT: Copying file to /media/backup/backups/JMAC/220414-1026/.hashes/ATssac/data/Mouvements.FIC

for info: the name of the backup and the name of the file are modified in the file path

4

there is no one to help me, the application is down !!!

5

Not having much help…
I did a cache reset, urbackup rebooted, it listed the S3 objects and since then I have this error:

Error information:

Importing from backend failed

Last log:

2022-04-15 10:41:53: WARNING: AWS-Client: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.
2022-04-15 10:41:53: WARNING: AWS-Client: Request failed, now waiting 0 ms before attempting again.
2022-04-15 10:49:01: ERROR: Online md5sum (5049773df71977a9b59fbb10976459bb – orig etag ‘“5049773df71977a9b59fbb10976459bb”’) is not equal to locally stored md5sum (049773df71977a9b59fbb10976459b) after retrieving 091/79/441_73104c1400
2022-04-15 10:49:01: ERROR: Error retrieving last modified file
2022-04-15 10:49:01: ERROR: Importing from backend failed

Case : #257

What can I do to unblock this situation ?

Thanks

6

Seems there are more scaleway compatibility problems.

Maybe you can also try to manually download object a37/38/422_73a7521400 to verify it is corrupted.

7

I’ll send you package where the etag check can be disabled shortly.

8

thank you very much for your answer

I have executed ‘’.
reboot
enumeration ok (no loop)
urbackup is still stuck on ‘Getting storage size…’

Capture d’écran du 2022-04-16 09-59-01
Capture d’écran du 2022-04-16 09-59-011835×504 86 KB

clouddrive does not mount the S3

log :
2022-04-16 09:32:02: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:32:04: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:32:04: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:32:08: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:32:08: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:32:17: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:32:17: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:32:33: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:32:33: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:33:05: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:33:05: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:34:09: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:34:09: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:36:18: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:36:18: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:40:34: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:40:34: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…
2022-04-16 09:49:07: ERROR: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3
2022-04-16 09:49:07: ERROR: EVENT s3_backend Subj: Calculated md5sum differs from expected msg: Calculated md5sum of downloaded object differs from expected md5sum for object 2fe/53/441_636c6f756466696c655f73697a65. Calculated=bfc6440809bb7b83aa01487e4bb2fc3a Expected=fc6440809bb7b83aa01487e4bb2fc3 prio: 2 extra:
2022-04-16 09:49:07: WARNING: Error getting online file 636c6f756466696c655f73697a65. Retrying…

to complete log : case #258

9

Now that it is working again, once you have confirmed it is a problem with the object (that still occurs), maybe ask Scaleway if they can recover/repair the object.

If that isn’t possible there are ways to ignore the missing object, but it might damage critical metadata.

10

I asked if they could fix this file a37/38/422_73a7521400.

I am waiting for their answer

11

the answer is no problem, they get a 200 on a getobject. they look in the logs.

I’ll switch to your drives, too much problem with the S3 of scaleway