I think my file migration is stuck,
the client last backup log is at 6h50
and the file migration last line is at 6h51
so the client was trying to backup during the server migration
additionally , there are backups that fails to migrate
thats on server UrBackup 2.2.11
Ill restart the server
server log :
13/11/18 06:49
INFO
Copying backup id 7378 path 180827-2052 of clientclientname"…
13/11/18 06:50
INFO
Copying backup id 7232 path 180820-2028 of clientclientname"…
13/11/18 06:50
INFO
Copying backup id 6924 path 180806-1938 of clientclientname"…
13/11/18 06:50
ERROR
Copying backup id 6924 path 180806-1938 of clientclientname" failed.
13/11/18 06:50
INFO
Copying backup id 6770 path 180730-1914 of clientclientname"…
13/11/18 06:51
ERROR
Copying backup id 6770 path 180730-1914 of clientclientname" failed.
13/11/18 06:51
INFO
Copying backup id 6648 path 180724-1636 of clientclientname"…
I am removing the remove unknow after the migration.
Its s currently fixing all symlink which have been created during the migration.
Could that part also be done during the migration?
The annoying part being remove-unknow require the server to be offline
But during the first migration part the server could stay online and continue backup.
target filesystem is btrfs and original fs is amazon efs via nfs
efs was "/var/docker/data
btrfs is "/var/docker/datas.local
so the remove unknown was finished, i started soing backups
i had error about cross device hardlink not being possible, see that it tries to link from the old device to the new device
in some cases even for linking inside the new deive i get errors ,
nov. 16 09:59:45 ppp urbackupsrv[1788]: WARNING: HT: Error creating hardlink from “/var/docker/data/urbackup-server/datas//qqq/180927-1417/u/camping/sss/ckeditor/skins/moono/editor_gecko.css” to “/var/docker/data/urbackup-server/datas.local//rrr/181116-0959/u/anonymous/exchange/LGE/ckeditor/skins/moono/editor_gecko.css”
nov. 16 09:59:45 ppp urbackupsrv[1788]: WARNING: HT: Error creating hardlink from “/var/docker/data/urbackup-server/datas//qqq/180927-1417/u/camping/sss/ckeditor/skins/moono/editor_ie.css” to “/var/docker/data/urbackup-server/datas.local//rrr/181116-0959/u/anonymous/exchange/LGE/ckeditor/skins/moono/editor_ie.css”
nov. 16 09:59:45 ppp urbackupsrv[1788]: WARNING: HT: Error creating hardlink from “/var/docker/data/urbackup-server/datas//qqq/180927-1417/u/camping/sss/ckeditor/skins/moono/editor_ie7.css” to “/var/docker/data/urbackup-server/datas.local//rrr/181116-0959/u/anonymous/exchange/LGE/ckeditor/skins/moono/editor_ie7.css”
nov. 16 09:59:45 ppp urbackupsrv[1788]: WARNING: HT: Error creating hardlink from “/var/docker/data/urbackup-server/datas//qqq/180927-1417/u/camping/sss/ckeditor/skins/moono/editor_ie8.css” to “/var/docker/data/urbackup-server/datas.local//rrr/181116-0959/u/anonymous/exchange/LGE/ckeditor/skins/moono/editor_ie8.css”
nov. 16 09:59:45 ppp urbackupsrv[1788]: WARNING: HT: Error creating hardlink from “/var/docker/data/urbackup-server/datas//qqq/180927-1417/u/camping/sss/ckeditor/skins/moono/editor_iequirks.css” to “/var/docker/data/urbackup-server/datas.local//rrr/181116-0959/u/anonymous/exchange/LGE/ckeditor/skins/moono/editor_iequirks.css”
nov. 16 09:59:45 ppp urbackupsrv[1788]: WARNING: HT: Error creating hardlink from “/var/docker/data/urbackup-server/datas//qqq/180927-1417/u/camping/sss/ckeditor/skins/moono/icons.png” to “/var/docker/data/urbackup-server/datas.local//rrr/181116-0959/u/anonymous/exchange/LGE/ckeditor/skins/moono/icons.png”
nov. 16 09:59:45 ppp urbackupsrv[1788]: WARNING: HT: Error creating hardlink from “/var/docker/data/urbackup-server/datas//qqq/180927-1417/u/camping/sss/ckeditor/skins/moono/readme.md” to “/var/docker/data/urbackup-server/datas.local//rrr/181116-0959/u/anonymous/exchange/LGE/ckeditor/skins/moono/readme.md”
Then i did a new remove-unknown, i get :
2018-11-16 10:03:42: Correcting target of symlink “/var/docker/data/urbackup-server/datas.local//admin.jjjj/171129-1921/.hashes/libnnn_base1/2011070116512251908569” to “/var/docker/data/urbackup-server/datas.local//admin.jjjj/.directory_pool/82/82pCp3LMeG15073799257609474655”
2018-11-16 10:03:42: Adjusting pool directory target from “/var/docker/data/urbackup-server/datas//admin.jjjj/171129-1921/.hashes/libnnn_base1/2011081819532441576355” to “/var/docker/data/urbackup-server/datas.local//admin.jjjj/171129-1921/.hashes/libnnn_base1/2011081819532441576355”
2018-11-16 10:03:42: Correcting target of symlink “/var/docker/data/urbackup-server/datas.local//admin.jjjj/171129-1921/.hashes/libnnn_base1/2011081819532441576355” to “/var/docker/data/urbackup-server/datas.local//admin.jjjj/.directory_pool/w2/w2vcDsaVOv15073799267609475673”
2018-11-16 10:03:42: Adjusting pool directory target from “/var/docker/data/urbackup-server/datas//admin.jjjj/171129-1921/.hashes/libnnn_base1/201108192149341474463” to “/var/docker/data/urbackup-server/datas.local//admin.jjjj/171129-1921/.hashes/libnnn_base1/201108192149341474463”
After the second remove unknown i start the server , i get a bunch of theses messages
nov. 16 11:24:56 ssss urbackupsrv[2888]: WARNING: File entry with id 38544969 with filesize=919892 hash=xMH33Eyo4q8YM1j0ut89ew== not found for clientid 9 in file entry index while deleting, but should be there. The file entry index may be damaged.
nov. 16 11:24:56 ssss urbackupsrv[2888]: WARNING: File entry with id 38544970 with filesize=78975244 hash=T1gx/5X9bClCI8a1JPF6Aw== not found in entry index while deleting, but should be there. The file entry index may be damaged.
nov. 16 11:24:56 ssss urbackupsrv[2888]: WARNING: File entry with id 38544970 with filesize=78975244 hash=T1gx/5X9bClCI8a1JPF6Aw== not found for clientid 9 in file entry index while deleting, but should be there. The file entry index may be damaged.
nov. 16 11:24:56 ssss urbackupsrv[2888]: WARNING: File entry with id 38544971 with filesize=174993408 hash=SJh8lo9eQ4/TJtVHplSMVQ== not found in entry index while deleting, but should be there. The file entry index may be damaged.
nov. 16 11:24:56 ssss urbackupsrv[2888]: WARNING: File entry with id 38544971 with filesize=174993408 hash=SJh8lo9eQ4/TJtVHplSMVQ== not found for clientid 9 in file entry index while deleting, but should be there. The file entry index may be damaged.
nov. 16 11:24:56 ssss urbackupsrv[2888]: ERROR: LMDB: Failed to delete data (MDB_NOTFOUND: No matching key/data pair found)
The file index errors cause it to not re-download files at worst (duplicates not detected). You can delete the fileindex directory and restart to regenerate it.
W.r.t. the missing directory pool paths: Finding the cause for that would be hard without having a way to reproduce it. It having corrupted backups is of course quite bad.
Hi, is there a way to force migration ? I put the file migrate_storage_to in /var/urbackupsrv , it starts indexing but then I stopped urbackupsrv and after the restart it doesn’t migrate.