Backups time out FILE_METADATA phase

Backups time out FILE_METADATA phase

Operating System info

Server

UrBackup 2.5.32, running on an unraid (linux) system as a docker container (again all within the unraid system)

Client(s)

5 x Windows 10 running 2.5.25
1 x Linux (Raspberry Pi)

Issue

Found on the Windows client backups

Example output from the “show log” button from the “Activities” tab for the current Full file backup action…

11/03/24 11:36  	DEBUG  	Loading "urbackup/FILE_METADATA|0yiMryzgpPUk65nH89PP|2420". Loaded 2 MB at 280 Bit/s
11/03/24 11:37  	DEBUG  	Loading "urbackup/FILE_METADATA|0yiMryzgpPUk65nH89PP|2420". Loaded 2.14983 MB at 20.928 KBit/s
11/03/24 11:39  	DEBUG  	Loading "urbackup/FILE_METADATA|0yiMryzgpPUk65nH89PP|2420". Loaded 2 MB at 280 Bit/s
11/03/24 11:40  	DEBUG  	Loading "urbackup/FILE_METADATA|0yiMryzgpPUk65nH89PP|2420". Loaded 2.15122 MB at 21.104 KBit/s

The Progress bar from the “Activities” tab is 100% 8.01 GB / 8 GB, and 0 files in queue.
I have tried different versions of adding exceptions to the list for backup but always seem to come to the same issue and this has been happening for the last month or two (if not longer without me taking notice of it).

Issues I have:

  • this phase of the backup is really slow, You can see the speed of the Loaded part working at Bit/s or sometimes KBit/s - is this normal?
  • Unclear what I need to do to kick-start this or improve the backup to make it work again.
  • Not sure what happened a month or two (or longer) ago that started to cause these problems - any ideas? Version change or something?
  • backup fails(?) see below…

In the end… I get an email with this kind of output…

(info): Waiting for metadata download stream to finish
(error): Error getting file metadata. Errorcode: TIMEOUT (2)
(error): Error starting file metadata download thread
(error): Backup had an early error. Deleting partial backup.

Can someone please help with possible solutions to this? I have the family’s PCs on this backup plan and fear that backups are no longer working.

Thanks.

Hello? any ideas please?

Try this article:
Slow FILE_METADATA loading. Backups Never ends approaching 100%

Tried (to the best of my skills at least) and not making any difference on my main PC.
“Someting” seems to work on my kids machines (smaller backups generally) but still same sort of behaviour from my machine.

Do you have Bitdefender antivirus? Check client debug.log. Maybe more info there.

Thanks for the suggestion.

Yes, I do have Bitdefender on these machines.

I have applied all the suggestions mentioned in the other posts and even gone to the length of adding “C:\program files\bitdefender*” to the exeptions list for the file backups.
I found that I had to apply this BOTH on the server as well as the client machines for it to recognise that it should exclude these items… even though the settings say “Using settigns configured here”.

A couple of PCs have just been trying to backup over the last day or so and woke up this morning to find the following on the status page:

With the following few lines in the “Show log” screen.
for DL machine:

20/03/24 04:29	DEBUG  	HT: Linked file: "/media/BACKUP/urbackup/DL/240319-1606/C/ctemp/dubai-2022-2023/2023.01.05/camphoto_959030623_1.jpg" (id=1598509)
20/03/24 04:29	DEBUG  	HT: Linked file: "/media/BACKUP/urbackup/DL/240319-1606/C/ctemp/dubai-2022-2023/2023.01.05/camvideo_99e1a804.mp4" (id=1598510)
20/03/24 04:29	DEBUG  	HT: Linked file: "/media/BACKUP/urbackup/DL/240319-1606/C/ctemp/vokalis/logo.eps" (id=1598532)
20/03/24 04:29	DEBUG  	HT: Linked file: "/media/BACKUP/urbackup/DL/240319-1606/C/ctemp/vokalis/logo.jpg" (id=1598533)
20/03/24 04:29	DEBUG  	HT: Linked file: "/media/BACKUP/urbackup/DL/240319-1606/C/ctemp/vokalis/logo.svg" (id=1598534)
20/03/24 04:29	DEBUG	HT: Linked file: "/media/BACKUP/urbackup/DL/240319-1606/C/ctemp/vokalis-2022/File1-[2022-12-24_14-42-47]-000.mov" (id=1598537)

~07h20 now so “nothing” has been happening for the last 3hours… but thinks that it will finish once the human race doesn’t exist any longer.

likewise, but different ont he NL machine:

|20/03/24 04:41|DEBUG|Loading urbackup/FILE_METADATA|[characters]|20. Loaded 248.732 KB at 33.912 KBit/s|
|20/03/24 04:43|DEBUG|Loading urbackup/FILE_METADATA|[characters]|20. Loaded 0 bytes at 0 Bit/s|
|20/03/24 04:44|DEBUG|Loading urbackup/FILE_METADATA|[characters]|20. Loaded 248.732 KB at 33.912 KBit/s|
|20/03/24 04:46|DEBUG|Loading urbackup/FILE_METADATA|[characters]|20. Loaded 0 bytes at 0 Bit/s|
|20/03/24 04:47|DEBUG|Loading urbackup/FILE_METADATA|[characters]|20. Loaded 248.732 KB at 33.912 KBit/s|
|20/03/24 04:49|ERROR|Error getting file metadata. Errorcode: TIMEOUT (2)|

and again nothing since about 4h50 this morning.

The log from the client:
vncviewer_67cIID3kUg

vncviewer_sS8I2Kbtmr

vncviewer_3ewHiYfBt7

Any ideas?

Looking for solution I have found (old) the same problem with acronis and Bitdefenter. Backup is created, but the task reaches 100% and stops. It never completes:
https://kb.acronis.com/content/13937?ckattempt=1
Maybe excluding ubackup dir will help.

Thanks for the suggestion(s).
I have tried and failed and decided to go back to square one by killing all of it and starting a totally new server as well as removing all the clients and starting slowly with one of the smallest machines and getting that to work before moving on and installing clients on the other machines.
It wasn’t like this when I first set this up in the past, but for some reason it seems to not be working well on any of my Windows Clients, not matter what I do.

I’ll try to update here if I learn something new which might be of use to a “me” in the future looking for a possible solution - as more than half of the posts i have read here either have no answer or the use-case is so off I don’t know how/where to start with fixing it on my setup.

What am I doing wrong? It just doesn’t work for me at all any more.

  • New install of a fresh Ubuntu VM for the server.
  • open the admin/web page (:55414) and start to tweak a few general settings
    • eg storage path cross-check it’s pointing to the correct path (see below, no issues with read/write permisisons to the nfs share i have with enough space for these backups)
    • reduce max simultaneous backus and active clients (to avoid any possible overload on the VM)
    • tiny changes to the File Backups tab
      • 48hrs incremental file, 8 days full file, 4 max inc, 2 min inc, 2 max full file, 1 min full file
      • based on other forum posts, added the following basic file exclusions: C:\Users:\OneDrive;C:\Program Files\UrBackup\UrBackupClientBackend.exe;C:\Program Files\Bitdefender
      • Default directories to backup: C:\Users;C:\Program Files\
    • changes to the Image tab
      • 7 days incremental image, 28 days full image, max 4 inc, min 1 inc, max 2 full, min 1 full
      • vol to backup: C
    • permissions tab: have the the following (to attempt to control the backups from the server side, not the client side:
      • Allow client-side changing of the directories to backup (unchecked)
      • Allow client-side starting x 4 (allowed/checked)
      • Allow client-side viewing/pausing (allowed/checked)
      • Allow client-side changing of settings (unchecked)
      • Allow clients to quit the tray icon, Allow clients to start file restores (allowed/checked)
      • Allow clients to configure components to backup (unchecked)
      • Allow clients to start component restores (allowed/checked)
    • Client tab - no changes
    • Archive tab - no changes
    • Alerts only added my email address
    • Local/passive clients - no changes
    • internet/Active clients tab - unchecked Clients try to connect via Internet/active client- as all the machines i plan to have this on initially are inside my house and hardwired, and on the same LAN.
    • Advanced tab - no changes
  • new install from the admin/web page (:55414) (add new client) button
    • Download preconfigured client installer for Windows
  • install the preconfigured client installer for Windows on one of my smallest cleanest/lightest Windows 10 PCs
  • let it do it’s thing
  • it started a full file back up, ran for a few hours (~48GB to backup) then fails/stops/does nothing with the following as the last few lines on the show log file.
|28/03/24 11:28  |DEBUG  |Loading urbackup/FILE_METADATA|u2ldB1Lp2RbQbxFHgcMu|3. Loaded 1.5 MB at 8 Bit/s|
|28/03/24 11:29  |DEBUG  |Loading urbackup/FILE_METADATA|u2ldB1Lp2RbQbxFHgcMu|3. Loaded 1.9572 MB at 63.792 KBit/s|
|28/03/24 11:31  |DEBUG  |Loading urbackup/FILE_METADATA|u2ldB1Lp2RbQbxFHgcMu|3. Loaded 1.5 MB at 8 Bit/s|
|28/03/24 11:32  |DEBUG  |Loading urbackup/FILE_METADATA|u2ldB1Lp2RbQbxFHgcMu|3. Loaded 1.9572 MB at 63.776 KBit/s|
|28/03/24 11:34  |ERROR  |Error getting file metadata. Errorcode: TIMEOUT (2)|

Anyone, please help.

Image backup seems to work though all working fine and writing to the nfs share that i setup in the settings tab.

What does this actually include though? can I/could I use the image backup to restore to a known “ok” system? or is it actually missing specific folders on the client machine - hence the file backups?