Slow FILE_METADATA loading. Backups Never ends approaching 100%

Hi all, I’m having a issue that I cannot solve.
I’ve seen all the other threads reporting similar problems, but I didn’t find any solution.
Most of the backups are not finishing…approaching to 100%.
The client log shows these kind of lines.
12/01/23 08:13 DEBUG Loading “urbackup/FILE_METADATA|CRtKP6fLO4YI7G023mhK|30491”. Loaded 4.91574 MB at 0 Bit/s
12/01/23 08:14 DEBUG Loading “urbackup/FILE_METADATA|CRtKP6fLO4YI7G023mhK|30491”. Loaded 4.91574 MB at 0 Bit/s
12/01/23 08:15 DEBUG Loading “urbackup/FILE_METADATA|CRtKP6fLO4YI7G023mhK|30491”. Loaded 4.91574 MB at 0 Bit/s
12/01/23 08:16 DEBUG Loading “urbackup/FILE_METADATA|CRtKP6fLO4YI7G023mhK|30491”. Loaded 4.91574 MB at 0 Bit/s
12/01/23 08:17 DEBUG Loading “urbackup/FILE_METADATA|CRtKP6fLO4YI7G023mhK|30491”. Loaded 4.91574 MB at 0 Bit/s

The server is linux version 2.5.32 and windows clients both Windows 8.1 vers 2.5.11 and Windows 7 SP1 vers 2.4.11.
The users are in a Windows Domain with Active Directory.
What I could check?
The main problem is that all the backups get stopped because the maximum number of simultaneous backups is always reached.

1 Like

Hello,
I can confirm this, since the server is updated to 2.5.32, client’s are slowing down at the end of the backup. (Server is Ubuntu 20.04LTS and Ubuntu 22.04LTS).
Please advice!
adam

2 Likes

Sad for you too. The worst thing is that this behavior is blocking the backup of the rest of the clients because the queue is full.
Please someone can help us?
A

I have the same problems. SERVER 2.5.32 (Ubuntu 22.04.3 LTS) … client 2.5.25

2 Likes

Now! Other PC … Server are starting to have the same problem. Help

1 Like

It seems to be a server related problem, more than clients.

The same problem as yesterday. Server Ubuntu 20.04LTS up to date, server ver: 2.5.32.
Client: Windows 10Pro, client ver: 2.5.25.

1 Like

@uroni Please could you give some advice?
Thanks

1 Like

A (sad) temporary solution is to reboot the machine at 100% during this last stage (FILE_METADATA). When the client comes up again, it recreate the metadata file and the bakup finishes. Now I’m seeing that, after this operation, these clients are finishing the backup without issues. Please, give it a try if possible, and confirm this behavior (not elegant, not easy but could worth a try).

1 Like

Ciao,
this appears to be a solution (see screenshot). Yes … not elegant solution but decisive. With almost 20 client doing backups every day, I think it’s difficult. Thanks for your help. Can anyone help us?

… It doesn’t always work. Only if you are at the end of the backup

1 Like

It seems that this bug is randomly by my clients, now all clients are ok.
The restart of the client at the end of the backup (when is stucking at METADATA part ) was helpful.
Clients are 2.5.24 and 2.5.25

1 Like

I my case problem was with Bitdefender antivirus log file. I excluded c:\users\all users\bitdefender and it works now.
I traced it from sever log:
ERROR: Error getting complete file “UmkgmoIl2pO31jI411pf|.symlink_ProgramData/Bitdefender/Endpoint Security/Logs/epagng/epagng.1.log”

The number of clients having this problem is increasing and only when there is backup of files. It’s a problem. If I don’t find a solution I have to find an alternative to solve the problem. Uroni do you know how to help us? I’ve seen this problem in the past as well.
Andrea … have you found a solution?

Thanks

1 Like

I can’t reproduce this arror anymore but I fixed one client pc with:

  1. no active jobs for the client
  2. Stop urbackupclientbackend service
  3. delete all files from C:\Program Files\UrBackup\urbackup\data
  4. keep access_keys.properties and delete other files from C:\Program Files\UrBackup\urbackup
  5. restart service and start backup.
    First time I had error about config missing. I had to restart service again. It pulled new config from the server.
1 Like

Hi there, no solution still. I’m investigating if next to the rebooting of the backupped client stuck at the metadata stage (100%) the issue is solved at the next automatic backup procedure. It seems to be like that…it’s like something is fixing. Thanks to @UG0 for the proposed procedure, I’m still waiting to apply that…
I would appreciate if @uroni or other Urbackup masters could give any hints.
Let’s see
A

1 Like

Same problem here, seems that if i restarted client computer before backup it works

|13/12/23 08:45 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 0 bytes at 104 Bit/s|
|—|—|—|
|13/12/23 08:46 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 404.343 KB at 55.136 KBit/s|
|13/12/23 08:48 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 0 bytes at 8 Bit/s|
|13/12/23 08:49 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 404.343 KB at 55.144 KBit/s|
|13/12/23 08:51 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 0 bytes at 8 Bit/s|
|13/12/23 08:52 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 404.343 KB at 55.12 KBit/s|
|13/12/23 08:54 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 0 bytes at 8 Bit/s|
|13/12/23 08:55 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 404.343 KB at 55.176 KBit/s|
|13/12/23 08:57 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 0 bytes at 8 Bit/s|
|13/12/23 08:58 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 404.343 KB at 55.16 KBit/s|
|13/12/23 09:00 |DEBUG |Loading urbackup/FILE_METADATA|DwdzQwDsqCIJvEKwmEa0|1766. Loaded 0 bytes at 8 Bit/s|

1 Like

Hi there, i noticed same problems on several installations, from what i see and understand it has to be with VSS writers stayed in waiting for completion, differents solutions provided don’t resolved the problem all the times. Waiting for a real resolution.

Same problem here. I opened another topic on it, as i could not find this one.
I did notice if i change my full file backup interval from 30 days to 14 days the problem does not happen as often.

Looks like this a more common new issue. Could everyone please add the information mentioned at Having problems with UrBackup? Please read before posting ? E.g. complete (debug level) logs (mostly client logs are interesting), information about operating systems and uncommon software (such as the Bitdefender antivirus).
If you can make memory dumps (in the task manager) of hanging UrBackupClientBackend.exe processes, those would be interesting as well. As well as complete procmon traces, but those might be too large and need to capture not just a hanging process, but what caused it to hang.

Hi, i just wanted to follow up on this issue. @uroni was right ,Bitdefender. I run 2 identical urbackup servers. One at home and one at the office. Bitdefender was the only difference. I switched the office away from Bitdefender Gravityzone and my file backup works perfectly now.