Server 2.2.5 beta/Client 2.2.3 beta

Testing
, ,
1

The parallel client-side file hashing is behind a feature flag in the internet settings tab on the server and needs to be enabled first.

Changes with server 2.2.5 beta

  • Updated translation
  • File backup with ZFS snapshots
  • Fix capa error return causing hung clients in rare cases
  • Fix client tokens/client authkey download
  • Ignore permissions if restoring from web interface without tokens
  • Add hint about network share access denied problem
  • Add option to send ok mails after fail mails
  • Narrow down trim range as far as possible after image backup in cow-raw mode
  • Don’t start file backups with the same group
  • Handle date case where localized day in date is shifted by one
  • Make inode_db envsize depend on free space during migration
  • Do not start metadata application before download is finished (fixes metadata application problems)
  • Delete symlink on file/image backup delete on ZFS
  • Do not run cleanup if backupfolder is not available
  • Fix rare race condition in file metadata download start
  • Disable deletion of last file backup from web interface (for now)

Major changes with server 2.2.x beta

  • Client-side file hashing parallel with file backup
  • Image backup restore via Internet client
  • Simultaneous file meta data application with file backups
  • Scriptable (lua) alerts and reports
  • File backup with ZFS snapshots

Changes with client 2.2.3 beta

  • Read 4K at a time for AF 4Kn disks in image backup
  • Skip data in metadata stream on Windows if file is sparse
  • Ignore unexpected error code in CBT return
  • Fix clientctl/GUI problem with long messages
  • Fix metadata reading from network shares on Windows
  • Set file owner before setting file permissions
  • Correctly handle file type changes during restore
  • Always use simple tokenize function (fixes issues with ‘"’ in settings)
  • Set block/char device major:minor correctly during restore

Major changes with client 2.2.x beta

  • Client-side file hashing parallel with file backup

Changes with Restore CD 2.1.x beta

  • Image backup restore via Internet client

Upgrade process

As always: Replace the executables (via the installers) and the database of the server/client will be updated on first running it.

Place the files from the update directory into C:\Program Files\UrBackupServer\urbackup or /var/urbackup to auto-update clients. Disable Download client from update server in the server settings to prevent the server from downloading the current version.

On Linux e.g. with this update script: https://github.com/ptempier/get_urbackupclient/blob/master/updateclient.sh

Downgrade process (server)

Stop the UrBackup server, restore C:\Program Files\UrBackupServer\urbackup or /var/urbackup from a backup before upgrade and then install the previous version over the beta release.

Downloads

3

Thanks for the update.
Compiled without issue on FreeNAS-11.0-U4
Will go live this evening and report back.

The server process exited today, first time in a while, so now running the 2.2.5 beta.
I will report back with any issues.

4

Hi,

did the update yesterday from Server 2.1.19 added the client update files and version doc’s.

  1. Clients connect and try to update to 2.0.4 but none of them completed (30 clients over internet)
  2. incremental backups ran fine but on successful completion web portal doesn’t show file backup status as green or successful.

Windows 2012 server and all windows clients

5

I think its got to do with the
ERROR: Signature verification failed

when trying to download the client from the web.

if i delete the Sig files and restart the urbackup service it doesn’t recreate these files and then the option of downloading the client from the portal is not available.

6

I’m having the exact same issue as marveltec
As I can see seems like the download directory here http://beta.urbackup.org/Client/2.2.3%20beta/update/ does not contain the .sig and sig2 files.

Maybe if they where added and I could download them it would correct the issue?

7

Hi, Also another thing i picked up in the web portal if i select to show IP Addresses its not displaying correct ip addresses

8

Sorry, the signature files were missing. They are generated and uploaded now.

9

Thnx Uroni with the Sig files auto updates and download of client from web portal is working again. any reason why the web portal keeps showing incorrect IP address for clients as well as incorrect file backup status?

10

Hi

Using beta client and stable server at the office. the restore gets stuck on my test script https://github.com/ptempier/check_backups :
2017-11-20 16:55:50: Restoring file “/tmp/filetests/test33”…
2017-11-20 16:55:50: Restoring file “/tmp/filetests/test35_éèçàùù=±ç-()61aze¨£€#,x az~”…
2017-11-20 16:55:50: Restoring file “/tmp/filetests/test36_?”…
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘*’ at pos 0. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ’
’ at pos 1. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘:’ at pos 2. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘&’ at pos 3. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘s’ at pos 4. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘h’ at pos 5. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘a’ at pos 6. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘r’ at pos 7. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘e’ at pos 8. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘’ at pos 9. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘p’ at pos 10. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘a’ at pos 11. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘t’ at pos 12. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘h’ at pos 13. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘=’ at pos 14. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: Restoring file "/tmp/filetests/test37’^&@{}[]$!%"…
2017-11-20 16:55:50: Restoring file “/tmp/filetests/test38_aaaa”…
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ’ ’ at pos 0. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘b’ at pos 1. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘b’ at pos 2. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘b’ at pos 3. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ’
’ at pos 4. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ’ ’ at pos 5. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘c’ at pos 6. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘c’ at pos 7. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘c’ at pos 8. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘c’ at pos 9. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘c’ at pos 10. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘&’ at pos 11. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘s’ at pos 12. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘h’ at pos 13. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘a’ at pos 14. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘r’ at pos 15. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘e’ at pos 16. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘_’ at pos 17. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘p’ at pos 18. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘a’ at pos 19. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘t’ at pos 20. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘h’ at pos 21. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: ERROR: Error parsing file BackupServerGet::getNextEntry - 1. Unexpected char ‘=’ at pos 22. Expected ‘f’, ‘d’ or ‘u’.
2017-11-20 16:55:50: Restoring file “/tmp/filetests/test39_éèçàùù=±ç-()61aze¨£€#,x az~”…

11

Could you post some details (e.g. what it shows as IP address and what would be the correct one…) as well as have a look at the log file if there are any errors?

12

auto update of clients… for macOS, they seem to update to 2.2.3 beta fine without issues (from 2.2.2 beta) … but when windows clients attempt to update, they lose connection and have to be removed and reinstalled. I’d like a way to update them on my own (without urbackup server, preferably installing over the top of the current AND keeping settings), but just running the installer when its already installed doesn’t work. The only method that seems to work for me is removing and reinstalling with the python script.

13

Similar experience here, automatically updating Windows client from 2.1.16 to 2.2.3 beta for Internet connected systems lost the Internet settings and thus connection. Most fields on Internet tab in Client settings were blank, including Internet server name/IP and server password. Fortunately I had already transitioned to group settings on the server so was able to download a pre-configured client, uninstall the empty one, and install the new, properly configured client.

As far as I can tell, the local systems updated successfully without manual intervention.

14

Could you have a look at "C:\Program Files\UrBackup\urbackup\data\settings.cfg" after it looses connectivity?

15

I’d like to test it, but “autoupdate clients” is a server setting, so it’d have to be turned on for all clients, which I don’t want to do and have to fix a bunch, which is another reason I’d rather just update them from alternative methods anyways, that way you can use a test group and manually push it when you feel like it, to just the clients you want.

16

@orogor
Thanks for the test script! Newlines in file names are evil, but that should also be fixed now.

Now what’s not working for me is hard links (expected and documented limitation) and test 40 (first test_bincopy).

17

for me it fails because /bin also contains hardlinks.

18

Hi Uroni,

ok so my setup is internet only clients to a windows server 2012 urbackup server and all their IP addresses are showing up as the gateway (of the servers local network) ip address in the web portal. also even though Incremental file backups are finishing without error since i upgraded from server 2.1.19 the status in the web portal shows as “No recent backup” even if a backup has just completed without error.

19

Are there any errors/warnings in the server log file?

20

Hi Uroni,

I do get these errors in the log on server startup

2017-12-04 16:20:09: ERROR: Loading luaplugin.dll failed
2017-12-04 16:20:09: WARNING: Lua plugin missing. Alerts won’t work.
2017-12-04 16:20:21: WARNING: File clientlist_b_9247.ub is missing/cannot be accessed
2017-12-04 16:20:21: WARNING: File clientlist_b_9251.ub is missing/cannot be accessed

but not too much after this apart from the normal errors/warnings from time to time during file backups