Backup Failing on Large File Set

The backup of a 1 Tb server over Internet fails at completion. The log is below:

Level Time Message
Info
12/02/16 11:14
Starting full file backup…
Info
12/02/16 16:05
Last virtual full index unfinished. Performing incremental (virtual full) indexing…
Warnings
12/02/16 16:05
Restarting shadow copy of E:\ because it was started by this server
Info
12/02/16 16:05
Scanning for changed hard links on volume of “E”…
Info
12/02/16 16:05
Indexing of “E” done. 65 filesystem lookups 231331 db lookups and 40 db updates
Info
12/02/16 16:05
cpsosrv03: Loading file list…
Info
12/02/16 16:06
cpsosrv03: Started loading files…
Errors
12/03/16 23:28
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C105ed98.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 00:28
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1065ce5.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 00:28
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1065ce6.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 00:28
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1065ce7.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 00:28
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1065ce8.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 00:28
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1065ce9.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 00:28
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1065cea.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 00:28
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1065cf3.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 04:31
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10727c8.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 08:58
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C107e8db.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 08:58
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C107e8dc.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 09:03
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C108aa92.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 09:03
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C108aa93.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 09:11
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1091353.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 09:11
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1091354.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 09:11
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1091741.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 09:11
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C1091742.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 09:40
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10a415c.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 10:18
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10b957d.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 10:18
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10b957e.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 10:24
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10bead7.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 20:24
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10d8140.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/04/16 21:17
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10db1c4.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/05/16 02:01
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10e1d08.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/05/16 02:01
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10e1d20.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/05/16 02:01
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10e1d21.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/05/16 02:01
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10e1d22.tmp” from pipe for reading file. File: temp_fn ec=5
Errors
12/05/16 08:04
Error opening file “Z:\temp\urbackup_tmp\urb5cab41580a95e9b800000001400D5C10ec1a1.tmp” from pipe for reading file. File: temp_fn ec=5
Info
12/05/16 17:55
Waiting for file transfers…
Info
12/05/16 18:33
Waiting for file hashing and copying threads…
Info
12/05/16 18:36
Saving file metadata…
Warnings
12/05/16 20:06
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\redirect\larry.wynne\0.9687705397227745.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:10
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\redirect\percy.anderson\Application Data\1717” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:10
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\redirect\percy.anderson\Application Data\171725.tmp” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:10
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\redirect\percy.anderson\Application Data\1919” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:10
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\redirect\percy.anderson\Application Data\191928.tmp” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:10
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\redirect\percy.anderson\Application Data\31807.vbs” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:10
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\redirect\percy.anderson\Application Data\32195.vbs” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:10
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\redirect\percy.anderson\Application Data\CDRom.dll” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:18
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\userfiles\james.field\My Documents\RECYCLER\S-1-5-21-2171125740-4028189339-2957081256-1387\D@1126.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:25
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users%gisela.valdez%.V2\Downloads\Minion LT Regular(1).exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:25
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users%gisela.valdez%.V2\Downloads\Minion LT Regular.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:28
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users%ryan.voorhies.loc%.V2\Downloads\expertpdf7_14244_ST(1).exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:28
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users%ryan.voorhies.loc%.V2\Downloads\expertpdf7_14244_ST.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:30
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users\Donna.Moran.loc.V2.old\AppData\Roaming\client.dll” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:30
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users\Donna.Moran.loc.V2.old\AppData\Roaming\client64.dll” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:30
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users\Donna.Moran.old\Application Data\client.dll” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:30
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users\Donna.Moran.old\Application Data\client64.dll” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:34
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users\ashley.watts.loc.V2\Downloads\Canceled Domestic Wire transferH6502406.zip” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:42
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users\jose.nino\Application Data\BRowse2save\settings.ini” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:42
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users\jose.nino\Application Data\EubbookBrowsE\settings.ini” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:43
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\users\megan.herndon.loc.V2\Downloads\7zip_bimo.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:57
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\usersfiles\anna.bell\My Documents\Downloads\clipartcollection_1339.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 20:58
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\usersfiles\brandi.madeley\My Documents\Downloads\setup.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 21:06
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\usersfiles\karen.gomez\My Documents\Downloads\VIO_Player_Setup.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 21:06
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\usersfiles\karen.gomez\My Documents\Downloads\microsoft powerpoint 2010 setup (1).exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 21:06
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\usersfiles\karen.gomez\My Documents\Downloads\microsoft powerpoint 2010 setup (2).exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 21:06
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\usersfiles\karen.gomez\My Documents\Downloads\microsoft powerpoint 2010 setup.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 21:19
Metadata file and “Z:\Cor-Pro\cpsosrv03\161202-1114\E\Profiles\usersfiles\ryan.lemay\My Documents\Downloads\myfreeweather_2.exe” do not exist. Skipping applying metdata for this file.
Warnings
12/05/16 21:32
Not all folder metadata could be applied. Metadata was inconsistent.
Info
12/05/16 21:32
Writing new file list…
Info
12/05/16 21:32
All metadata was present
Info
12/05/16 21:32
Transferred 627.041 GB - Average speed: 20.0942 MBit/s
Info
12/05/16 21:32
(Before compression: 709.252 GB ratio: 1.13111)
Info
12/05/16 21:32
401.791 GB of files were already present on the server and did not need to be transferred
Errors
12/05/16 21:33
FATAL: Backup failed because of disk problems (see previous messages)
Info
12/05/16 21:33
Time taken for backing up client cpsosrv03: 3 days 10h 18m 56s
Errors
12/05/16 21:33
Backup failed

Disable the on-access virus scanner on the server?

Turned off realtime anti-virus. Still does not work.
I have other backups to this server from the same network that complete.

Have you tried running any of the batch files – remove_unknown or cleanup?

Also, what server/client versions?

Resolved by changing location of the temporary file to the System Disk
C:\Program Files\UrBackupServer\urbackup\temp\urbackup_tmp\

The old location was on the file drive. Not sure why that made a difference, but my backup completed with no errors.

Backup Failing on Large File Set We have multistreaming enabled. Incrmental backup completes successfully for this cps tester file server. However whenever full backup runs, 2 drives always fail with code … Backup to external hard drive . If RAID is out of option, then your best choice is image backup. As for backing up data, you should have at least one backup saved at external storage device in case of internal hard drive corruption. Therefore, an external hard drive is recommended for backing up large files.

Under Windows, snapshots depend upon VSS. If VSS won’t run on a particular volume, or if there is not enough space reserved for VSS to cache changed files on that volume, you can get an error. I wonder if this describes your situation.