UrBackup Server 2.1.14 beta/Client 2.1.11 beta

Major changes with server 2.1.x beta

  • Groups for client settings
  • Ability to reconnect during indexing if connection is broken
  • Define which volumes need to be snapshotted together (snapshot groups)
  • Image backup mounting, browsing and archival on Windows, Linux and FreeBSD (does not work in FreeBSD jails and with VHD/VHDZ on FreeBSD)

Major changes with client 2.1.x beta

  • Ability to reconnect during indexing if connection is broken
  • Improved image backup performance
  • Windows Backup API support (tested backup and restore with Microsoft SQL, tested backup with Microsoft Exchange and Hyper V)
  • File backups and restores use the change block data from the change block tracking driver now (you can install the beta client over a CBT client and this will work)
  • Define which volumes need to be snapshotted together (snapshot groups)

Changes with server 2.1.14 beta

  • Use correct name for quick_check result (fixes false database corruption warning)
  • Fix issue with file patching sparse extent alignment
  • Updated SQLite to 3.16.2
  • Update LMDB to 0.9.19
  • Fix dead lock on Linux with pthreads
  • Fix bug with sparse extent resetting during chunked file transfer reconnect
  • Use scoped cursors during recovery
  • Require user to specify which image volumes to archive when configuring image backup archiving
  • Also use sparse block size to align sparse extents when patching
  • Fix verification of backupcom.xml and backup script files
  • Do not start backup if it cannot be added to the database (e.g. because out of space)
  • Use long polling to reduce request time to max 10s during image mounting

Changes with client 2.1.11 beta

  • Fix Windows component backup
  • Keep async index status around after async index is finished to prevent error after indexing is finished
  • Fix async mempipe timeout when there are not backup directories
  • Updated SQLite to 3.16.2
  • Fix transfer of metered info during CAPA transfer
  • Break from loop if sparse lseek does not move forward
  • Check for send errors at image backup end
  • Fix null pointer access after image backup read error
  • More efficient saved journal data application using database cursor
  • Fix journal replay after index
  • Windows backup API restore: Implement flag to ignore overwrite failures

Upgrade process

As always: Replace the executables (via the installers) and the database of the server/client will be updated on first running it.

Place the files from the update directory into C:\Program Files\UrBackupServer\urbackup or /var/urbackup to auto-update clients. Disable Download client from update server in the server settings to prevent the server from downloading the current version.

On Linux e.g. with this update script: https://github.com/ptempier/get_urbackupclient/blob/master/updateclient.sh

Downgrade process (server)

Stop the UrBackup server, restore C:\Program Files\UrBackupServer\urbackup or /var/urbackup from a backup before upgrade and then install the previous version over the beta release.

Downloads

Oups, seems you forgot client sig files :wink:

Thanks for the hint. Added them now.

Test report:
Tested the following:
1.) conduct a file backup
2) add some files in a folder (added files to Desktop)
3) do a restore;
Results: added files are still in the folder (theoretically these added files should be removed?)

This is only a minor issue, but just wanted to clarify.

Another issue:
Created a text file–> typed in some words–>Save the file
Then conducted a incremental file back; -->
Changed the text file name; -->
Conducted a restore.
Observation:

  1. a text file with the original file name was “restored”, try to open it and it shows “Access Denied”
  2. the renamed text file stays in the folder

Could reproduce the first problem. Could you try to create a client debug log for the second case (access denied) and send me that?

I will do this. I need a little bit time to re-install and create the same environment to reproduce the issue and send you the debug log.

Here is the debug file (on Windows 7 64bit machine):
2017-01-18 18:59:44: ERROR: Recvfrom error in CUDPThread::UdpStep
2017-01-18 18:59:44: ERROR: Last error: 0
2017-01-18 19:00:34: ERROR: Recvfrom error in CUDPThread::UdpStep
2017-01-18 19:00:34: ERROR: Last error: 0
2017-01-18 19:01:24: ERROR: Recvfrom error in CUDPThread::UdpStep
2017-01-18 19:01:24: ERROR: Last error: 0
2017-01-18 19:01:25: WARNING: Info not found at ‘c:’ - reindexing
2017-01-18 19:02:14: ERROR: Recvfrom error in CUDPThread::UdpStep
2017-01-18 19:02:14: ERROR: Last error: 0
2017-01-18 19:03:04: ERROR: Recvfrom error in CUDPThread::UdpStep
2017-01-18 19:03:04: ERROR: Last error: 0
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\All Users”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\AppData\Local\Application Data”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\AppData\Local\History”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\AppData\Local\Temporary Internet Files”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Application Data”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Cookies”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Documents\My Music”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Documents\My Pictures”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Documents\My Videos”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Local Settings”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\My Documents”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\NetHood”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\PrintHood”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Recent”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\SendTo”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Start Menu”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default\Templates”
2017-01-18 19:03:12: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Default User”
2017-01-18 19:03:13: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\AppData\Local\Application Data”
2017-01-18 19:03:13: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\AppData\Local\History”
2017-01-18 19:03:14: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\AppData\Local\Temporary Internet Files”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Application Data”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Cookies”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Documents\My Music”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Documents\My Pictures”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Documents\My Videos”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Local Settings”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\My Documents”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\NetHood”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\PrintHood”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Recent”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\SendTo”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Start Menu”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\MY\Templates”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Public\Documents\My Music”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Public\Documents\My Pictures”
2017-01-18 19:03:15: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\Users\Public\Documents\My Videos”
2017-01-18 19:03:18: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\ProgramData\Application Data”
2017-01-18 19:03:18: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\ProgramData\Desktop”
2017-01-18 19:03:18: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\ProgramData\Documents”
2017-01-18 19:03:18: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\ProgramData\Favorites”
2017-01-18 19:03:24: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\ProgramData\Start Menu”
2017-01-18 19:03:24: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy5\ProgramData\Templates”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\All Users”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\AppData\Local\Application Data”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\AppData\Local\History”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\AppData\Local\Temporary Internet Files”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Application Data”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Cookies”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Documents\My Music”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Documents\My Pictures”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Documents\My Videos”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Local Settings”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\My Documents”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\NetHood”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\PrintHood”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Recent”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\SendTo”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Start Menu”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default\Templates”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Default User”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\AppData\Local\Application Data”
2017-01-18 19:03:43: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\AppData\Local\History”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\AppData\Local\Temporary Internet Files”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Application Data”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Cookies”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Documents\My Music”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Documents\My Pictures”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Documents\My Videos”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Local Settings”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\My Documents”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\NetHood”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\PrintHood”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Recent”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\SendTo”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Start Menu”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\MY\Templates”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Public\Documents\My Music”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Public\Documents\My Pictures”
2017-01-18 19:03:45: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\Users\Public\Documents\My Videos”
2017-01-18 19:03:49: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\ProgramData\Application Data”
2017-01-18 19:03:49: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\ProgramData\Desktop”
2017-01-18 19:03:49: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\ProgramData\Documents”
2017-01-18 19:03:49: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\ProgramData\Favorites”
2017-01-18 19:03:54: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\ProgramData\Start Menu”
2017-01-18 19:03:54: ERROR: Error getting SID of ACE entry of file “\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy6\ProgramData\Templates”

Could you put it into debug log mode please, such that it not only logs errors/warnings. Details on how to configure a client to do that are here: Having problems with UrBackup? Please read before posting

uroni,
I have enabled debug mode and emailed you the debug.log file.
please let me know if you need any further information.
thanks!

uroni,
following your instructions I have sent you the log file of the server side.
Please let me know if there is anything else needed.

Unfortunately there is some missing logging, I think. My working theory is that there is some missing/misplaced meta-data halfway through. I’ll add some logging, so maybe we get more information with the next version. Thanks!

OK. Please let me know when it is ready and I will test it again
I will send you the logs.
Thanks!

can’t compile Linux server version:
mount_helper/main.cpp:209:25: error: ‘LOOP_CTL_GET_FREE’ was not declared in this scope

can you fix this error

Hot resizing a vm’s disk from 100 to 120 Gb (not the system one …),
Rescan from Windows mmc Disk Management to see the new disk size,
Growing volume T: from 100Gb to 120Gb.

UrBackup CBT Status shows :

Getting status of T: failed. Error code: 317
Change block tracking disabled
Volumes with active change block tracking and no crash consistency (v2.5): 
E:, F:, G:, C:

Volumes without change block tracking: 
D:

Last driver log messages:
Write outside of bitmap offset 128845872640 size 512 bitmap size 28672
Change tracking disabledChange tracking disabled in IOCTL_URBCT_STATUS

Think i need to reboot the client to raise this error ?

Regards,

FYI, got this message after reboot :

Regards,

Resizing client hard drive result in server’s crash while trimming :

Server log :

2017-01-24 11:01:48: WARNING: Reading from parent hash file failed (may be caused by a volume with increased size)
2017-01-24 11:01:48: Trim beyond drivesize (drivesize: 128846396928 trim to 128846397440). Trimming less...
2017-01-24 11:01:49: Starting trimming image file (if possible)
2017-01-24 11:05:34: Trimmed 1.24512 GB

Look like it happens somewhere after trimming. Do you have full logs or backtraces?

I think you are using the debian package. In this case setting it up to collect core dumps and sending me them would help as well.

Edit: I think this might be the easiest method: http://stackoverflow.com/a/18400/506718