urbackupsrv --version
UrBackup Server v2.2.5.0
Global soft filesystem quota is 80% of a 600GB drive
Yes there were an app writing in parallel to urbackup, but urbackup still tries to receive and hash files.
Instead of canceling the backup and waiting for the situation to cleanup.
Unsure, but I guess in parallel was a long running manual backup that i started a few days before.
[Fri Jan 26 13:36:20 2018] fbackup hash[11065]: segfault at 7fb07c2b7000 ip 00000000005b4182 sp 00007fb07bffdef0 error 4 in urbackupsrv[400000+90f000]
2018-01-26 13:54:07: Starting passive WAL checkpoint of urbackup/backup_server.db…
2018-01-26 13:54:12: Passive WAL checkpoint of urbackup/backup_server.db completed busy=0 checkpointed=15984 log=15984
2018-01-26 13:54:19: Authed+capa for client ‘pascalou’ (encrypted-v2, compressed-v2, token auth) - 1 spare connections
2018-01-26 13:54:31: Done.
2018-01-26 13:54:31: Free space: 128 KB
2018-01-26 13:54:31: Client with id=10 has 1 full file backups max=1
2018-01-26 13:54:31: Client with id=10 has 3 incremental file backups max=3
2018-01-26 13:54:31: Client with id=9 has 1 full file backups max=1
2018-01-26 13:54:31: Client with id=9 has 3 incremental file backups max=3
2018-01-26 13:54:31: Free space: 128 KB
2018-01-26 13:54:31: Client with id=1 has 1 full file backups max=1
2018-01-26 13:54:31: Client with id=1 has 0 incremental file backups max=3
…
2018-01-26 13:54:31: Client with id=8 has 0 full file backups max=2
2018-01-26 13:54:31: Client with id=8 has 3 incremental file backups max=4
2018-01-26 13:54:31: Client with id=10 has 1 full file backups max=2
2018-01-26 13:54:31: Client with id=10 has 3 incremental file backups max=4
2018-01-26 13:54:31: Client with id=9 has 1 full file backups max=2
2018-01-26 13:54:31: Client with id=9 has 3 incremental file backups max=4
2018-01-26 13:54:31: Updating statistics…
2018-01-26 13:54:32: Updating image stats…
2018-01-26 13:54:32: Updating file statistics…
2018-01-26 13:54:51: File processing speed: 0.0738544 files/s
2018-01-26 13:54:51: Updating file statistics: 3%
2018-01-26 13:54:51: File processing speed: 90909.1 files/s
2018-01-26 13:54:51: Updating file statistics: 5%
…
2018-01-26 13:54:52: Updating file statistics: 94%
2018-01-26 13:54:52: File processing speed: 100000 files/s
2018-01-26 13:54:52: Updating file statistics: 96%
2018-01-26 13:54:52: File processing speed: 100000 files/s
2018-01-26 13:54:52: Updating file statistics: 99%
2018-01-26 13:54:53: Done updating statistics.
2018-01-26 13:54:53: Free space: 256 KB
2018-01-26 13:54:53: Space to free: 50 MB
2018-01-26 13:54:53: Free space: 256 KB
2018-01-26 13:54:53: Free space: 256 KB
2018-01-26 13:54:53: Client with id=1 has 1 full file backups max=1
2018-01-26 13:54:53: Client with id=1 has 0 incremental file backups max=3
…
2018-01-26 13:54:53: Client with id=10 has 1 full file backups max=2
2018-01-26 13:54:53: Client with id=10 has 3 incremental file backups max=4
2018-01-26 13:54:53: Client with id=9 has 1 full file backups max=2
2018-01-26 13:54:53: Client with id=9 has 3 incremental file backups max=4
2018-01-26 13:54:53: Updating statistics…
2018-01-26 13:54:53: Updating image stats…
2018-01-26 13:54:53: Updating file statistics…
2018-01-26 13:54:53: ERROR: Error writing to file “/data/urbackup2/pascalou/180126-0845/.symlink_/var/lib/dpkg/info/lib32cilkrts5.symbols” -2. No space left on device (code: 28)
2018-01-26 13:54:53: ERROR: Error copying file to destination -3
2018-01-26 13:54:54: Done updating statistics.
2018-01-26 13:54:54: Free space: 256 KB
2018-01-26 13:54:54: Space to free: 50 MB
2018-01-26 13:54:54: ERROR: FATAL: Could not free space. NOT ENOUGH FREE SPACE.
2018-01-26 13:54:54: Free space: 256 KB
2018-01-26 13:54:54: Free space: 256 KB
2018-01-26 13:54:54: Client with id=1 has 1 full file backups max=1
2018-01-26 13:54:54: Client with id=1 has 0 incremental file backups max=3
…
2018-01-26 13:54:54: Client with id=8 has 3 incremental file backups max=4
2018-01-26 13:54:54: Client with id=10 has 1 full file backups max=2
2018-01-26 13:54:54: Client with id=10 has 3 incremental file backups max=4
2018-01-26 13:54:54: Client with id=9 has 1 full file backups max=2
2018-01-26 13:54:54: Client with id=9 has 3 incremental file backups max=4
2018-01-26 13:54:54: Updating statistics…
2018-01-26 13:54:54: Updating image stats…
2018-01-26 13:54:54: Updating file statistics…
2018-01-26 13:54:54: WARNING: Sending mail failed. FTP: weird server reply(ec=8), Got unexpected smtp-server response: 554
2018-01-26 13:54:55: ERROR: Fatal error writing to file in writeFileRepeat. Write error in Chunked File transfer. Operation now in progress (code: 115)
2018-01-26 13:54:55: Done updating statistics.
2018-01-26 13:54:55: Free space: 256 KB
2018-01-26 13:54:55: ERROR: Error writing to file “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JDownloader Updater” -2. No space left on device (code: 28)
2018-01-26 13:54:55: ERROR: Error copying file to destination -3
2018-01-26 13:55:00: Connection timeout. Reconnecting…
2018-01-26 13:55:00: Connecting to target service…
2018-01-26 13:55:00: Established internet connection. Service=1
2018-01-26 13:55:00: Encryption overhead: 171 bytes
2018-01-26 13:55:00: Reconnected successfully.
2018-01-26 13:55:00: pending_chunks=0 next_chunk=0
2018-01-26 13:55:00: next_chunk=0
2018-01-26 13:55:00: Invalidating 0 chunks in patch file
2018-01-26 13:55:00: Receiving filesize… Filesize=4 Predicted=-1
2018-01-26 13:55:00: Old filesize=231
2018-01-26 13:55:00: Authed+capa for client ‘pascalou’ (encrypted-v2, compressed-v2, token auth) - 1 spare connections
2018-01-26 13:55:12: New fileindex entry for “/data/urbackup2/pascalou/180126-0845/.symlink_/var/lib/dpkg/info/lib32cilkrts5.symbols” id=87169860 hash=i7rtLC7Xl1nW94wsz/OcHQ==
2018-01-26 13:55:12: GT: Linked file “lib32cilkrts5.symbols”
2018-01-26 13:55:12: GT: File “lib32gcc-6-dev.md5sums” not found via hash. Loading file…
2018-01-26 13:55:12: GT: File “lib32gcc-7-dev.list” not found via hash. Loading file…
2018-01-26 13:55:12: GT: File “lib32gcc-7-dev.md5sums” not found via hash. Loading file…
2018-01-26 13:55:16: Error opening file… “/data/urbackup2/pascalou[home]/180126-1136/.hashes/home/orogor/jd2/JDownloader Updater” retrying… No space left on device (code: 28)
2018-01-26 13:55:16: HT: Hardlinking failed (unkown error) Source="/data/urbackup2/pascalou/180125-2313/.symlink_/var/lib/dpkg/info/lib32gcc1.symbols" Destination="/data/urbackup2/pascalou/180126-0845/.symlink_/var/lib/dpkg/info/lib32gcc1.symbols" – No space left on device (code: 28)
2018-01-26 13:55:16: HT: Copying from file “/data/urbackup2/pascalou/180125-2313/.symlink_/var/lib/dpkg/info/lib32gcc1.symbols”
2018-01-26 13:55:27: Old filesize=203
2018-01-26 13:55:27: Block without change. currpos=0
2018-01-26 13:55:27: Successful. Returning filesize 4
2018-01-26 13:55:27: GT: Loaded file “JD2.port”
2018-01-26 13:55:27: Loading file patch for “JDownloader 2 Update & Rescue.desktop”
2018-01-26 13:55:27: PT: Hashing file “JD2.port”
2018-01-26 13:55:27: Old filesize=231
2018-01-26 13:55:27: Receiving filesize… Filesize=231 Predicted=231
2018-01-26 13:55:27: HT: Copying file: “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JD2.port”
2018-01-26 13:55:27: WARNING: HT: No free space available deleting backups…
2018-01-26 13:55:27: Space to free: 50 MB
2018-01-26 13:55:27: Free space: 128 KB
2018-01-26 13:55:27: Free space: 128 KB
2018-01-26 13:55:27: Client with id=1 has 1 full file backups max=1
2018-01-26 13:55:27: Client with id=1 has 0 incremental file backups max=3
2018-01-26 13:55:27: Client with id=3 has 0 full file backups max=1
…
2018-01-26 13:55:28: Client with id=10 has 1 full file backups max=2
2018-01-26 13:55:28: Client with id=10 has 3 incremental file backups max=4
2018-01-26 13:55:28: Client with id=9 has 1 full file backups max=2
2018-01-26 13:55:28: Client with id=9 has 3 incremental file backups max=4
2018-01-26 13:55:28: Updating statistics…
2018-01-26 13:55:28: Updating image stats…
2018-01-26 13:55:28: Updating file statistics…
2018-01-26 13:55:28: Done updating statistics.
2018-01-26 13:55:28: Free space: 128 KB
2018-01-26 13:55:28: LMDB: PUT clientid=1 filesize=16264 hash=i7rtLC7Xl1nW94wsz/OcHQ== target=87169860
2018-01-26 13:55:29: ERROR: HT: FATAL: Error freeing space
2018-01-26 13:55:36: GT: Linked file “JDownloader Updater”
2018-01-26 13:55:39: Metadata file and “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JD2.port” do not exist. Skipping applying metdata for this file.
2018-01-26 13:55:56: Block without change. currpos=0
2018-01-26 13:55:58: Successful. Returning filesize 231
2018-01-26 13:55:58: GT: Loaded file “JDownloader 2 Update & Rescue.desktop”
2018-01-26 13:55:58: Loading file patch for “JDownloader 2.desktop”
2018-01-26 13:55:58: PT: Hashing file “JDownloader 2 Update & Rescue.desktop”
2018-01-26 13:55:58: Old filesize=203
2018-01-26 13:55:58: HT: Copying file: “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JDownloader 2 Update & Rescue.desktop”
2018-01-26 13:55:58: WARNING: HT: No free space available deleting backups…
2018-01-26 13:55:58: Space to free: 50.0002 MB
2018-01-26 13:55:58: Free space: 0 bytes
2018-01-26 13:55:58: Free space: 0 bytes
2018-01-26 13:55:58: Client with id=1 has 1 full file backups max=1
2018-01-26 13:55:58: Client with id=1 has 0 incremental file backups max=3
2018-01-26 13:55:58: Client with id=3 has 0 full file backups max=1
…
2018-01-26 13:55:58: Client with id=8 has 3 incremental file backups max=4
2018-01-26 13:55:58: Client with id=10 has 1 full file backups max=2
2018-01-26 13:55:58: Client with id=10 has 3 incremental file backups max=4
2018-01-26 13:55:58: Client with id=9 has 1 full file backups max=2
2018-01-26 13:55:58: Client with id=9 has 3 incremental file backups max=4
2018-01-26 13:55:58: Updating statistics…
2018-01-26 13:55:58: Updating image stats…
2018-01-26 13:55:58: Updating file statistics…
2018-01-26 13:55:58: Done updating statistics.
2018-01-26 13:55:58: Free space: 0 bytes
2018-01-26 13:55:58: ERROR: HT: FATAL: Error freeing space
2018-01-26 13:56:00: Authed+capa for client ‘pascalou’ (encrypted-v2, compressed-v2, token auth) - 1 spare connections
2018-01-26 13:56:09: Old filesize=222
2018-01-26 13:56:09: Receiving filesize… Filesize=203 Predicted=203
2018-01-26 13:56:16: ERROR: Error truncating hashdata file -2. No space left on device (code: 28)
2018-01-26 13:56:16: WARNING: More warnings of kind: Creating hardlink from “/data/urbackup2/pascalou[home]/180125-1031/home/orogor/jd2/JDownloader Updater.vmoptions.backup_1” to “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JDownloader Updater.vmoptions.backup_1” failed. Loading file… Skipping.
2018-01-26 13:56:16: WARNING: Creating hardlink from “/data/urbackup2/pascalou[home]/180125-1031/home/orogor/jd2/JDownloader Updater.vmoptions.backup_1” to “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JDownloader Updater.vmoptions.backup_1” failed. No space left on device (code: 28). Loading file…
2018-01-26 13:56:16: New fileindex entry for “/data/urbackup2/pascalou/180126-0845/.symlink_/var/lib/dpkg/info/lib32gcc1.symbols” id=87169862 hash=rZq+kJkQGsAPYeMjlDRfOg==
2018-01-26 13:56:16: GT: Linked file “lib32gcc1.symbols”
2018-01-26 13:56:22: WARNING: Creating hardlink from “/data/urbackup2/pascalou[home]/180125-1031/home/orogor/jd2/JDownloader.desktop” to “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JDownloader.desktop” failed. No space left on device (code: 28). Loading file…
2018-01-26 13:56:31: GT: Linked file “lib32gomp1.symbols”
2018-01-26 13:56:37: Write failed. errno=28
2018-01-26 13:56:37: WARNING: No free space in backup folder. Free space=0 bytes MinFreeSpace=50 MB
2018-01-26 13:56:37: HT: Hardlinking failed (unkown error) Source="/data/urbackup2/pascalou/180125-2313/.symlink_/var/lib/dpkg/info/lib32itm1.symbols" Destination="/data/urbackup2/pascalou/180126-0845/.symlink_/var/lib/dpkg/info/lib32itm1.symbols" – No space left on device (code: 28)
2018-01-26 13:56:37: HT: Copying from file “/data/urbackup2/pascalou/180125-2313/.symlink_/var/lib/dpkg/info/lib32itm1.symbols”
2018-01-26 13:56:37: Error opening file… “/data/urbackup2/pascalou/180126-0845/.symlink_/var/lib/dpkg/info/lib32itm1.symbols” retrying… No space left on device (code: 28)
2018-01-26 13:56:37: WARNING: Creating hardlink from “/data/urbackup2/pascalou[home]/180125-1031/home/orogor/jd2/JDownloader.pid” to “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JDownloader.pid” failed. No space left on device (code: 28). Loading file…
2018-01-26 13:56:37: Space to free: 50 MB
2018-01-26 13:56:37: Free space: 0 bytes
2018-01-26 13:56:37: Free space: 0 bytes
2018-01-26 13:56:37: Client with id=1 has 1 full file backups max=1
2018-01-26 13:56:37: Client with id=1 has 0 incremental file backups max=3
…
2018-01-26 13:56:37: Client with id=8 has 3 incremental file backups max=4
2018-01-26 13:56:37: Client with id=10 has 1 full file backups max=2
2018-01-26 13:56:37: Client with id=10 has 3 incremental file backups max=4
2018-01-26 13:56:37: Client with id=9 has 1 full file backups max=2
2018-01-26 13:56:37: Client with id=9 has 3 incremental file backups max=4
2018-01-26 13:56:37: Updating statistics…
2018-01-26 13:56:37: Updating image stats…
2018-01-26 13:56:37: Updating file statistics…
2018-01-26 13:56:37: Done updating statistics.
2018-01-26 13:56:37: Free space: 0 bytes
2018-01-26 13:56:37: LMDB: PUT clientid=1 filesize=4171 hash=rZq+kJkQGsAPYeMjlDRfOg== target=87169862
2018-01-26 13:56:37: ERROR: FATAL: Could not free space. NOT ENOUGH FREE SPACE.
2018-01-26 13:56:37: WARNING: Sending mail failed. FTP: weird server reply(ec=8), Got unexpected smtp-server response: 554
2018-01-26 13:56:37: ERROR: Fatal error writing to file in writeFileRepeat. Write error in Chunked File transfer. Operation now in progress (code: 115)
2018-01-26 13:56:37: Block without change. currpos=0
2018-01-26 13:56:38: Metadata file and “/data/urbackup2/pascalou[home]/180126-1136/home/orogor/jd2/JDownloader 2 Update & Rescue.desktop” do not exist. Skipping applying metdata for this file.
2018-01-26 13:56:39: Write failed. errno=28
2018-01-26 13:56:39: WARNING: HT: No free space available deleting backups…
2018-01-26 13:56:39: Space to free: 50 MB
2018-01-26 13:56:39: Free space: 0 bytes
2018-01-26 13:56:39: Free space: 0 bytes
2018-01-26 13:56:39: Client with id=1 has 1 full file backups max=1
2018-01-26 13:56:39: Client with id=1 has 0 incremental file backups max=3
…
2018-01-26 13:56:39: Client with id=10 has 1 full file backups max=2
2018-01-26 13:56:39: Client with id=10 has 3 incremental file backups max=4
2018-01-26 13:56:39: Client with id=9 has 1 full file backups max=2
2018-01-26 13:56:39: Client with id=9 has 3 incremental file backups max=4
2018-01-26 13:56:39: Updating statistics…
2018-01-26 13:56:39: Updating image stats…
2018-01-26 13:56:39: Updating file statistics…
2018-01-26 13:56:40: Done updating statistics.
2018-01-26 13:56:40: Free space: 0 bytes
2018-01-26 13:56:40: ERROR: Error writing to file “/data/urbackup2/pascalou/180126-0845/.symlink_/var/lib/dpkg/info/lib32itm1.symbols” -2. No space left on device (code: 28)
2018-01-26 13:56:40: ERROR: Error copying file to destination -3
2018-01-26 13:56:49: Write failed. errno=28
2018-01-26 13:56:49: WARNING: No free space in backup folder. Free space=0 bytes MinFreeSpace=50 MB
2018-01-26 13:56:49: Space to free: 50 MB
2018-01-26 13:56:49: Free space: 0 bytes
2018-01-26 13:56:49: Free space: 0 bytes
2018-01-26 13:56:49: Client with id=1 has 1 full file backups max=1
2018-01-26 13:56:49: Client with id=1 has 0 incremental file backups max=3
2018-01-26 13:56:49: Client with id=3 has 0 full file backups max=1
…
2018-01-26 13:56:49: Client with id=10 has 3 incremental file backups max=4
2018-01-26 13:56:49: Client with id=9 has 1 full file backups max=2
2018-01-26 13:56:49: Client with id=9 has 3 incremental file backups max=4
2018-01-26 13:56:49: Updating statistics…
2018-01-26 13:56:49: Updating image stats…
2018-01-26 13:56:49: Updating file statistics…
2018-01-26 13:56:49: Done updating statistics.
2018-01-26 13:56:49: Free space: 0 bytes
2018-01-26 13:56:49: ERROR: FATAL: Could not free space. NOT ENOUGH FREE SPACE.
2018-01-26 13:56:49: WARNING: Sending mail failed. FTP: weird server reply(ec=8), Got unexpected smtp-server response: 554
2018-01-26 13:56:49: ERROR: Fatal error writing to file in writeFileRepeat. Write error in Chunked File transfer. Operation now in progress (code: 115)
2018-01-26 13:56:49: Successful. Returning filesize 203
2018-01-26 13:56:49: GT: Loaded file “JDownloader 2.desktop”
2018-01-26 13:56:49: PT: Hashing file “JDownloader 2.desktop”
2018-01-26 13:56:49: Loading file patch for “JDownloader Update.desktop”
2018-01-26 13:56:49: Old filesize=222