UrBackup Server 2.0.8/Client 2.0.7 beta

@uroni

The next issue will occur during “make install” (again on CentOS 7). The syntax for adduser is incompatible, instead of:

adduser urbackup --system --quiet --group …

it should be:

adduser urbackup --system --user-group

CentOS/RHEL version of adduser doesn’t understand flags “–quiet” and “–group”. “–quiet” can be removed, but “–group” should be changed to “–user-group”.

Is this a full backup, or a incremental backup based on a backup done via the last version?

incremental backup

Could you run a full file backup and see if the problem still occurs afterwards during incrementals?

This helped, no errors in log only warnings

No, now I get this errors again:

ERROR: Client calculated hash of "/media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/C/Users/sr/AppData/Local/Google/Chrome/User Data/Default/Application Cache/Cache/data_2" differs from server calculated hash. This may be caused by a bug or by random bit flips on the client or server hard disk. Failing backup.
ERROR: Client calculated hash of "/media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/C/Users/sr/AppData/Local/Google/Chrome/User Data/Default/Application Cache/Cache/data_3" differs from server calculated hash. This may be caused by a bug or by random bit flips on the client or server hard disk. Failing backup.
ERROR: Client calculated hash of "/media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/C/Users/sr/AppData/Local/Google/Chrome/User Data/Default/GPUCache/data_3" differs from server calculated hash. This may be caused by a bug or by random bit flips on the client or server hard disk. Failing backup.
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150516_103940.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150621_195544_nopm_.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150716_224241.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150721_214255.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150802_150139.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150903_210716.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150909_195345.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20151017_201540.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20151031_103310.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160331-2315/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/Screenshot_20151114-104617.png
ERROR: Fatal error during backup. Backup not completed
ERROR: FATAL: Backup failed because of disk problems

This is a new server install (not upgrade) of a UrBackup server >= 2.0.5 (tree hashing) and the client uses “block differences - hashed” transfer mode?

New 2.0.6

Then Upgrade since
Im using default settings. Will check what it is tomorrow

Im using internet mode, so block difference right?
Advanced settings:


Client Settings:

Could you check if the issue is fixed with this version: https://limitingfactor.urbackup.org/Server/2.0.9%20beta/

Working on a full backup, and will try incremental later.

Hello,
First I installed the .dpkg upgrade on my server, then I ran full file backup:

Then I ran incremental backup:
ERROR: Client calculated hash of “/media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/C/Users/sr/AppData/Local/Google/Chrome/User Data/Default/GPUCache/data_3” differs from server calculated hash. This may be caused by a bug or by random bit flips on the client or server hard disk. Failing backup.
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150214_223402.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150418_213243.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150517_101850.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150604_101853.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150604_102142.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150612_193941.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150624_101114.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150630_224533.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150707_124412.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150716_203702.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150716_211145.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150716_223304.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20150928_215458.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/IMG_20151008_121232.jpg
WARNING: Error adding sparse file entry. Could not read hash from /media/backup/urbackup//BornData - Søren Yoga 13/160401-1926/.hashes/C/Windows.old/Users/Søren/OneDrive/Billeder/Filmrulle/VID_20150828_203753.mp4
ERROR: Fatal error during backup. Backup not completed
ERROR: FATAL: Backup failed because of disk problems

Thanks for testing! Reproduced and fixed this problem now. Updated in place; should work now: https://limitingfactor.urbackup.org/Server/2.0.9%20beta/

I will test it as soon as possible.

Thank you, this solved the problem.
I will continue testing for other errors.

LDAP tested with Centos 7 and OpenLDAP using UrBackup Server 2.0.8 version. Seems to function fine!

Thanks!

Ok, doing some tests.

Successfully backed up two servers, while the third (not using any snapshot method - i know, it’s ok for this) segfaults with:

2016-04-04 06:44:43: Backing up “root” without snapshot.
2016-04-04 06:45:59: ERROR: Tree hash calc error at file /var/lib/mysql/ibdata1
Assertion failed: fsize1 != fsize2 || ret == other_ret (urbackupclient/client.cpp: getShaBinary: 3948)
Aborted

and crashes.

More: on Ubuntu 14.04 LTS (client), the lvm snapshot script doesn’t seem to be working:
“2016-04-04 12:53:03: ERROR: lsblk: unrecognized option ‘–paths’”

If it is changing during the backup (mysql running?) that would be expected outcome. It is currently hashing twice using different methods and comparing the result. If no problems crop up, I’ll remove that with the next version.

There is a work-around for --paths not working in the remove script but not in the create script. Will be fixed.