Ability to reconnect during indexing if connection is broken
Define which volumes need to be snapshotted together (snapshot groups)
Major changes with client 2.1.x beta
Ability to reconnect during indexing if connection is broken
Improved image backup performance
Windows Backup API support (tested backup and restore with Microsoft SQL, tested backup with Microsoft Exchange and Hyper V)
File backups and restores use the change block data from the change block tracking driver now (you can install the beta client over a CBT client and this will work)
Define which volumes need to be snapshotted together (snapshot groups)
Changes with server 2.1.1 beta
Fix statistics table missing first column on copy/export
Show Windows components configuration on web interface in advanced
Show “Enable internet mode” group setting
Start off with global settings as default when creating new group
Start scheduled backups only if in backup window
Release session before client download to prevent web interface lock-up for the user
Use X-Forwarded-For as remote address if present
Add internet server and server URL validation
Log about backup being scheduled/manually started
Do not use group settings as global settings
CoW-raw Image backups with zfs snapshots
Increase async index timeout to 10min
Skip empty client on status screen
Fix symbolic link to file deletion on Windows
Changes with client 2.1.1 beta
Do not finish CBT if it is not available
Do not count interrupted sleep to prevent early image timeouts
Fix btrfs snapshots and use btrfs snapshots for btrfs file systems even if LVM/dattobd are configured
Exclude datto and overlay files everywhere not just in root
Added Linux uninstall script ( uninstall_urbackupclient ) – untested
Show where Linux client it is going to be installed
Disable Windows asking for Windows Backup after UrBackup client installation via registry key
Upgrade process
As always: Replace the executables (via the installers) and the database of the server/client will be updated on first running it.
Place the files from the update directory into C:\Program Files\UrBackupServer\urbackup or /var/urbackup to auto-update clients. Disable Download client from update server in the server settings to prevent the server from downloading the current version.
Stop the UrBackup server, restore C:\Program Files\UrBackupServer\urbackup or /var/urbackup from a backup before upgrade and then install the previous version over the beta release.
It needs to be able to create ZFS snapshots, so a FreeNAS jail is probably out (run it directly in FreeNAS).
Put the dataset name into /etc/urbackup/dataset (echo "tank/images" > /etc/urbackup/dataset) – should best be separate from the normal UrBackup storage dataset.
Run urbackup_snapshot_helper test to try if it works. Then you must unfortunately run UrBackup as root – at least on Linux. Otherwise mounting the ZFS snapshots does not work.
FreeBSD may be less effective because it does not implement file hole punching, so ZFSOnLinux is currently best used with this.
My testing so far has been going well but I seem to be unable to get OS X clients to update silently (the Windows clients silently upgraded perfectly). I wonder if this is for a reason similar to the one I see when I try to download and install the OS X client from the server. I end up with a file like…
UrBackup Client (cas-bob-01).sh
If I try to execute that from the command line it fails. I end up renaming it by removing the parenthesis and spaces. I’ve also had to chmod a+x.
This is under OS X 10.12 (Sierra)
Let me know if there are any logs / etc I can provide.
Clients with more than one volume are not backed up correctly with server 2.1.1 / client 2.1.1.
What i’ve done :
Fresh server 2.1.1 install on Debian 8 with BTRFS storage,
Configuring server with my options,
Fresh install of 2.0.35-cbt client on a new client Windows 2012 R2 with 2 volumes (C: and S:),
Configuring the client on the server,
Upgrading 2.0.35-cbt client to 2.1.1.
Doing an image backup of the client with this configuration backup only the S: volume.
I try to set “Volumes to snapshot in groups during image backups” and "Volumes to backup " both with values C,S but it doesn’t help, it backups in this case only the C: volume
Server side log :
2016-10-01 15:05:12: Starting unscheduled full image backup...
2016-10-01 15:05:12: Backing up SYSVOL...
2016-10-01 15:05:12: Starting unscheduled full image backup...
2016-10-01 15:05:24: Transferred 286.909 MB - Average speed: 205.707 MBit/s
2016-10-01 15:05:24: Script does not exist urbackup/post_full_imagebackup
2016-10-01 15:05:24: Updating statistics...
2016-10-01 15:05:24: Updating image stats...
2016-10-01 15:05:24: Updating file statistics...
2016-10-01 15:05:24: Done updating statistics.
2016-10-01 15:05:25: Backing up SYSVOL done.
2016-10-01 15:05:25: Backing up EFI System Partition...
2016-10-01 15:05:25: Starting unscheduled full image backup...
2016-10-01 15:05:25: Request of EFI System Partition failed. Reason: Not found
2016-10-01 15:05:25: Transferred 140 bytes - Average speed: 74.664 KBit/s
2016-10-01 15:05:25: Script does not exist urbackup/post_full_imagebackup
2016-10-01 15:05:25: msg=WAKEUP
2016-10-01 15:05:26: Backing up EFI System Partition done.
2016-10-01 15:05:26: Basing image backup on last incremental or full image backup
2016-10-01 15:05:26: Creating writable snapshot of previous image backup...
2016-10-01 15:05:26: msg=WAKEUP
2016-10-01 15:06:07: Change block tracking active. Max 277 MB have changed.
2016-10-01 15:06:07: Image backup is being backed up in a snapshot group together with volumes s:\
2016-10-01 15:06:18: Starting trimming image file (if possible)
2016-10-01 15:06:18: Trimmed 512 KB
2016-10-01 15:06:23: Transferred 194.027 MB - Average speed: 28.7189 MBit/s
2016-10-01 15:06:23: Script does not exist urbackup/post_full_imagebackup
2016-10-01 15:06:23: Time taken for backing up client SVGITEST3: 1m 11s
2016-10-01 15:06:23: Backup succeeded
Client side log :
2016-10-01 15:04:52: ClientService cmd: PONG
2016-10-01 15:05:12: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#MBR driveletter=SYSVOL
2016-10-01 15:05:12: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2PING RUNNING pc_done=0&status_id=29&speed_bpms=0&total_
bytes=-1&done_bytes=0#token=158YTMONjujIdlXC3OtS
2016-10-01 15:05:12: rc=0 hasError=true state=0
2016-10-01 15:05:12: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#FULL IMAGE letter=SYSVOL&token=158YTMONjujIdlXC3OtS&chec
ksum=1&bitmap=1&status_id=29&running_jobs=1
2016-10-01 15:05:12: Filesystem type is ntfs (\\?\Volume{f88dcaca-c6ad-11e5-80c2-806e6f6e6963})
2016-10-01 15:05:12: TotalNumberOfClusters=89599 numberOfClusters=89599 n_clusters=11200 StartingLcn=0 BitmapSize=89599
r_bytes=11216
2016-10-01 15:05:12: FSINFO: blocksize=4096 size=367001088 has_error=false used_space=300220416
2016-10-01 15:05:13: ClientService cmd: STATUS#pw=iFs5AT69g8lYRlOviVmp6YvvdoUFlV
2016-10-01 15:05:20: rc=0 hasError=true state=4
2016-10-01 15:05:20: Sending full image done
2016-10-01 15:05:22: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2PING RUNNING pc_done=100&status_id=29&speed_bpms=0&tota
l_bytes=300220416&done_bytes=255287296#token=158YTMONjujIdlXC3OtS
2016-10-01 15:05:25: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#MBR driveletter=ESP
2016-10-01 15:05:25: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2PING RUNNING pc_done=0&status_id=30&speed_bpms=0&total_
bytes=-1&done_bytes=0#token=158YTMONjujIdlXC3OtS
2016-10-01 15:05:25: rc=0 hasError=true state=0
2016-10-01 15:05:25: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#FULL IMAGE letter=ESP&token=158YTMONjujIdlXC3OtS&checksu
m=1&bitmap=1&status_id=30&running_jobs=1
2016-10-01 15:05:25: ERROR: Not found
2016-10-01 15:05:25: rc=0 hasError=true state=0
2016-10-01 15:05:26: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#MBR driveletter=C
2016-10-01 15:05:26: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2PING RUNNING pc_done=0&status_id=28&speed_bpms=0&total_
bytes=-1&done_bytes=0#token=158YTMONjujIdlXC3OtS
2016-10-01 15:05:26: rc=0 hasError=true state=0
2016-10-01 15:05:26: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#INCR IMAGE letter=C:&hashsize=3909664&token=158YTMONjujI
dlXC3OtS&checksum=1&bitmap=1&status_id=28&running_jobs=1&cbitmapsize=1954860
2016-10-01 15:05:26: Script "C:\Program Files\UrBackup\preimagebackup.bat" does not exist
2016-10-01 15:05:26: Creating shadowcopy of "C:"...
2016-10-01 15:05:27: Number of Writers: 12
2016-10-01 15:05:27: Writer Task Scheduler Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer VSS Metadata Store Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer Performance Counters Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer System Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer WIDWriter has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer SqlServerWriter has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer Shadow Copy Optimization Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer ASR Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer Registry Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer COM+ REGDB Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer IIS Config Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: Writer WMI Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:27: ClientService cmd: STATUS#pw=iFs5AT69g8lYRlOviVmp6YvvdoUFlV
2016-10-01 15:05:28: Number of Writers: 12
2016-10-01 15:05:28: Writer Task Scheduler Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer VSS Metadata Store Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer Performance Counters Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer System Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer WIDWriter has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer SqlServerWriter has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer Shadow Copy Optimization Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer ASR Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer Registry Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer COM+ REGDB Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer IIS Config Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:28: Writer WMI Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:05:32: rc=0 hasError=true state=0
2016-10-01 15:05:35: rc=0 hasError=true state=0
2016-10-01 15:05:36: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2PING RUNNING pc_done=0&status_id=28&speed_bpms=0&total_
bytes=-1&done_bytes=0#token=158YTMONjujIdlXC3OtS
2016-10-01 15:05:46: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2PING RUNNING pc_done=0&status_id=28&speed_bpms=0&total_
bytes=-1&done_bytes=0#token=158YTMONjujIdlXC3OtS
2016-10-01 15:05:52: ClientService cmd: PONG
2016-10-01 15:05:56: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2PING RUNNING pc_done=0&status_id=28&speed_bpms=0&total_
bytes=-1&done_bytes=0#token=158YTMONjujIdlXC3OtS
2016-10-01 15:06:06: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2PING RUNNING pc_done=0&status_id=28&speed_bpms=0&total_
bytes=-1&done_bytes=0#token=158YTMONjujIdlXC3OtS
2016-10-01 15:06:06: Number of Writers: 12
2016-10-01 15:06:06: Writer Task Scheduler Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:06:06: Writer VSS Metadata Store Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:06:06: Writer Performance Counters Writer has failure state VSS_WS_STABLE with error S_OK.
2016-10-01 15:06:06: Writer System Writer has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with error S_OK.
2016-10-01 15:06:06: Writer WIDWriter has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with error S_OK.
2016-10-01 15:06:06: Writer SqlServerWriter has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with error S_OK.
2016-10-01 15:06:06: Writer Shadow Copy Optimization Writer has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with e
rror S_OK.
2016-10-01 15:06:06: Writer ASR Writer has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with error S_OK.
2016-10-01 15:06:06: Writer Registry Writer has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with error S_OK.
2016-10-01 15:06:06: Writer COM+ REGDB Writer has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with error S_OK.
2016-10-01 15:06:06: Writer IIS Config Writer has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with error S_OK.
2016-10-01 15:06:06: Writer WMI Writer has failure state VSS_WS_WAITING_FOR_BACKUP_COMPLETE with error S_OK.
2016-10-01 15:06:06: Shadowcopy path: \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11
2016-10-01 15:06:06: Shadowcopy path: \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy12
2016-10-01 15:06:06: done.
2016-10-01 15:06:06: Change block tracking reports 14.5 MB have changed on shadow copy \\?\GLOBALROOT\Device\HarddiskVo
lumeShadowCopy11
2016-10-01 15:06:06: Zeroing image hash data of volume C:...
2016-10-01 15:06:07: Change block tracking active on volume C:
2016-10-01 15:06:07: Zeroing file hash data of volume C:...
2016-10-01 15:06:07: Filesystem type is ntfs (\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11)
2016-10-01 15:06:07: TotalNumberOfClusters=15638527 numberOfClusters=15638527 n_clusters=1954816 StartingLcn=0 BitmapSi
ze=15638527 r_bytes=1954832
2016-10-01 15:06:07: Trying to exclude contents of file \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11\HIBERFIL.SYS f
rom backup...
2016-10-01 15:06:07: Error opening file handle to \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11\HIBERFIL.SYS
2016-10-01 15:06:07: Trying to exclude contents of file \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11\pagefile.sys f
rom backup...
2016-10-01 15:06:07: Trying to exclude contents of file \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11\swapfile.sys f
rom backup...
2016-10-01 15:06:07: Error opening file handle to \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11\swapfile.sys
2016-10-01 15:06:07: Trying to exclude contents of file \\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11\System Volume
Information\{3808876b-c176-4e48-b7ae-04046e6cc752} from backup...
2016-10-01 15:06:07: FSINFO: blocksize=4096 size=64055410176 has_error=false used_space=58561830912
2016-10-01 15:06:08: Block did change: 1536 mixed=true
(...)
2016-10-01 15:06:18: Block did change: 11689984 mixed=false
2016-10-01 15:06:18: Sending image done
2016-10-01 15:06:18: rc=0 hasError=true state=4
2016-10-01 15:06:18: Deleting shadowcopy for path "\\?\GLOBALROOT\Device\HarddiskVolumeShadowCopy11\" -2
2016-10-01 15:06:18: ClientService cmd: STATUS#pw=iFs5AT69g8lYRlOviVmp6YvvdoUFlV
2016-10-01 15:06:19: Deleting Shadowcopy for dir "C:\"
2016-10-01 15:06:19: Deleting Shadowcopy for dir "s:\"
2016-10-01 15:06:20: ClientService cmd: STATUS#pw=iFs5AT69g8lYRlOviVmp6YvvdoUFlV
2016-10-01 15:06:24: ClientService cmd: #Ig0KMWKGy8ZqzeqwxWeEn#2LOGDATA 1475327183 0-1475327112-Starting unscheduled full image backup...
0-1475327126-Basing image backup on last incremental or full image backup
0-1475327126-Creating writable snapshot of previous image backup...
0-1475327167-Change block tracking active. Max 277 MB have changed.
0-1475327167-Image backup is being backed up in a snapshot group together with volumes s:\
0-1475327183-Transferred 194.027 MB - Average speed: 28.7189 MBit/s
0-1475327183-Time taken for backing up client SVGITEST3: 1m 11s
0-1475327183-Backup succeeded
2016-10-01 15:06:24: rc=0 hasError=true state=0
Thanks for testing and posting the logs. I think I found the reason why it does not work with C, SYSVOL etc. Will probably be fixed with the next version.
Group snapshoting is working now for both volumes C: and S: with client / server beta 2.1.2, thanks for fixing !
However, it leaves a VSS snapshot on the windows client for volume S: and CBT isn’t used for volume C:
S: volume backup takes few seconds (incremental with CBT and no data changes on the client => fast)
But C: doesn’t seem to use CBT
Client is up to date and CBT active for both volumes :