long story short, i’ve deleted and recreated my data partition on my file server. The OS install was untouched and i restored the data from urbackup server via rsync to the client.
Data was originally was on a single BTRFS subvol, but i’ve now split data up for possible future use into individual subvolumes.
however when urbackup server attempts either perform a full backup or incremential, then it completes but with 0Bytes actually copied in the webUI.
below is the client debug logs - nothing obvious sticks out to my eye.
$ sudo urbackupclientbackend -v debug
2022-04-29 20:15:02: SQLite: recovered 1240 frames from WAL file /usr/local/var/urbackup/backup_client.db-wal code: 283
2022-04-29 20:15:02: urbackupserver: Server started up successfully!
2022-04-29 20:15:02: FileSrv: Binding UDP socket at port 35622...
2022-04-29 20:15:02: FileSrv: done.
2022-04-29 20:15:02: FileSrv: Binding ipv6 UDP socket at port 35622...
2022-04-29 20:15:02: FileSrv: done.
2022-04-29 20:15:02: FileSrv: Servername: -fileserver-
2022-04-29 20:15:02: FileSrv: Server started up successfully
2022-04-29 20:15:02: FileSrv: UDP Thread started
2022-04-29 20:15:02: Started UrBackupClient Backend...
2022-04-29 20:15:03: Internet mode not enabled
2022-04-29 20:15:03: Final path: /mnt/btrfs-ssd1
2022-04-29 20:15:03: Looking for old Sessions... 0 sessions
2022-04-29 20:15:06: urbackupserver: No available slots... starting new Worker
2022-04-29 20:15:06: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#1CHANNEL capa=0&token=eMSYS7NCU9HwnsySPvMO&restore_version=1&virtual_client=
2022-04-29 20:15:06: New channel: Number of Channels: 1
2022-04-29 20:15:11: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2PING RUNNING pc_done=&status_id=2&speed_bpms=0&total_bytes=-1&done_bytes=0&paused_fb=1#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:15:11: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#3START FULL BACKUP group=0&running_jobs=1&sha=528&with_permissions=1&with_scripts=1&with_orig_path=1&with_sequence=1&with_proper_symlinks=1&status_id=2&async=1#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:15:11: Removing VSS log data...
2022-04-29 20:15:11: Final path: /mnt/btrfs-ssd1
2022-04-29 20:15:11: Async index a771dbb5b0886af1ba326bd81a236494
2022-04-29 20:15:11: rc=0 hasError=true state=0
2022-04-29 20:15:11: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#WAIT FOR INDEX async_id=a771dbb5b0886af1ba326bd81a236494#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:15:11: Wait for async index a771dbb5b0886af1ba326bd81a236494
2022-04-29 20:15:11: Script list at "/usr/local/etc/urbackup/scripts/list" does not exist. Skipping.
2022-04-29 20:15:11: Deleting files... doing full index...
2022-04-29 20:15:11: Script "/usr/local/etc/urbackup/prefilebackup" does not exist
2022-04-29 20:15:11: Final path: /mnt/btrfs-ssd1
2022-04-29 20:15:11: Creating shadowcopy of "btrfs-ssd1" in indexDirs()
2022-04-29 20:15:11: Create a readonly snapshot of '/mnt/btrfs-ssd1' in '/mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d'
2022-04-29 20:15:11: Shadowcopy path: /mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d
2022-04-29 20:15:11: done.
2022-04-29 20:15:11: Indexing "btrfs-ssd1"...
2022-04-29 20:15:11: Indexing of "btrfs-ssd1" done. 7 filesystem lookups 0 db lookups and 0 db updates
2022-04-29 20:15:11: Script "/usr/local/etc/urbackup/postfileindex" does not exist
2022-04-29 20:15:11: Async index a771dbb5b0886af1ba326bd81a236494 finished with "done"
2022-04-29 20:15:11: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#GET VSSLOG
2022-04-29 20:15:11: VSS logdata - 256 bytes
2022-04-29 20:15:11: rc=0 hasError=true state=0
2022-04-29 20:15:11: rc=0 hasError=true state=0
2022-04-29 20:15:11: FileSrv: Received data...
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending file (normal) urbackup/filelist.ub metadata_id=0
2022-04-29 20:15:11: FileSrv: Mapped name: /usr/local/var/urbackup/data/filelist.ub
2022-04-29 20:15:11: FileSrv: Received data...
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: Received flush.
2022-04-29 20:15:11: FileSrv: Received data...
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending file (normal) urbackup/tokens_eMSYS7NCU9HwnsySPvMO.properties metadata_id=0
2022-04-29 20:15:11: FileSrv: Mapped name: /usr/local/var/urbackup/data/tokens_eMSYS7NCU9HwnsySPvMO.properties
2022-04-29 20:15:11: FileSrv: Received data...
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: Received flush.
2022-04-29 20:15:11: FileSrv: Received data...
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending script output (normal) urbackup/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43 metadata_id=0
2022-04-29 20:15:11: FileSrv: Mapped name: /usr/local/var/urbackup/data/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43
2022-04-29 20:15:11: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#START SC "btrfs-ssd1"#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:15:11: orig_target=/mnt/btrfs-ssd1 volpath=/mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d
2022-04-29 20:15:11: Shadowcopy already present.
2022-04-29 20:15:11: FileSrv: Received data...
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending meta data of eMSYS7NCU9HwnsySPvMO|btrfs-ssd1/.urbackup_snaps metadata_id=3
2022-04-29 20:15:11: FileSrv: Mapped name: /mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d/.urbackup_snaps
2022-04-29 20:15:11: rc=0 hasError=true state=0
2022-04-29 20:15:11: FileSrv: Received data...
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending meta data of eMSYS7NCU9HwnsySPvMO|btrfs-ssd1/containers-COW metadata_id=5
2022-04-29 20:15:11: FileSrv: Mapped name: /mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d/containers-COW
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending meta data of eMSYS7NCU9HwnsySPvMO|btrfs-ssd1/data metadata_id=7
2022-04-29 20:15:11: FileSrv: Mapped name: /mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d/data
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending meta data of eMSYS7NCU9HwnsySPvMO|btrfs-ssd1/emby metadata_id=9
2022-04-29 20:15:11: FileSrv: Mapped name: /mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d/emby
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending meta data of eMSYS7NCU9HwnsySPvMO|btrfs-ssd1/nfs metadata_id=11
2022-04-29 20:15:11: FileSrv: Mapped name: /mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d/nfs
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending meta data of eMSYS7NCU9HwnsySPvMO|btrfs-ssd1/zm metadata_id=13
2022-04-29 20:15:11: FileSrv: Mapped name: /mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d/zm
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: FileSrv: Sending meta data of eMSYS7NCU9HwnsySPvMO|btrfs-ssd1 metadata_id=14
2022-04-29 20:15:11: FileSrv: Mapped name: /mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d
2022-04-29 20:15:11: FileSrv: Received a Packet.
2022-04-29 20:15:11: Received flush.
2022-04-29 20:15:11: ERROR: Token id for user "bin" not found
2022-04-29 20:15:11: ERROR: Token id for user "daemon" not found
2022-04-29 20:15:11: ERROR: Token id for user "adm" not found
2022-04-29 20:15:11: ERROR: Token id for user "lp" not found
2022-04-29 20:15:11: ERROR: Token id for user "sync" not found
2022-04-29 20:15:11: ERROR: Token id for user "shutdown" not found
2022-04-29 20:15:12: ERROR: Token id for user "mail" not found
2022-04-29 20:15:12: ERROR: Token id for user "operator" not found
2022-04-29 20:15:12: ERROR: Token id for user "games" not found
2022-04-29 20:15:12: ERROR: Token id for user "ftp" not found
2022-04-29 20:15:12: ERROR: Token id for user "nobody" not found
2022-04-29 20:15:12: ERROR: Token id for user "systemd-resolve" not found
2022-04-29 20:15:12: ERROR: Token id for user "systemd-oom" not found
2022-04-29 20:15:12: ERROR: Token id for user "systemd-timesync" not found
2022-04-29 20:15:12: ERROR: Token id for user "dbus" not found
2022-04-29 20:15:12: ERROR: Token id for user "polkitd" not found
2022-04-29 20:15:12: ERROR: Token id for user "rpc" not found
2022-04-29 20:15:12: ERROR: Token id for user "cockpit-ws" not found
2022-04-29 20:15:12: ERROR: Token id for user "cockpit-wsinstance" not found
2022-04-29 20:15:12: ERROR: Token id for user "tss" not found
2022-04-29 20:15:12: ERROR: Token id for user "abrt" not found
2022-04-29 20:15:12: ERROR: Token id for user "setroubleshoot" not found
2022-04-29 20:15:12: ERROR: Token id for user "rpcuser" not found
2022-04-29 20:15:12: ERROR: Token id for user "sshd" not found
2022-04-29 20:15:12: ERROR: Token id for user "dnsmasq" not found
2022-04-29 20:15:12: ERROR: Token id for user "chrony" not found
2022-04-29 20:15:12: ERROR: Token id for user "tcpdump" not found
2022-04-29 20:15:12: ERROR: Token id for user "systemd-network" not found
2022-04-29 20:15:12: ERROR: Token id for user "pcp" not found
2022-04-29 20:15:12: ERROR: Token id for user "zabbix" not found
2022-04-29 20:15:12: ERROR: Token id for user "sonarr" not found
2022-04-29 20:15:12: ERROR: Token id for user "rtorrent" not found
2022-04-29 20:15:12: ERROR: Token id for group "bin" not found
2022-04-29 20:15:12: ERROR: Token id for group "daemon" not found
2022-04-29 20:15:12: ERROR: Token id for group "sys" not found
2022-04-29 20:15:12: ERROR: Token id for group "adm" not found
2022-04-29 20:15:12: ERROR: Token id for group "tty" not found
2022-04-29 20:15:12: ERROR: Token id for group "disk" not found
2022-04-29 20:15:12: ERROR: Token id for group "lp" not found
2022-04-29 20:15:12: ERROR: Token id for group "mem" not found
2022-04-29 20:15:12: ERROR: Token id for group "kmem" not found
2022-04-29 20:15:12: ERROR: Token id for group "wheel" not found
2022-04-29 20:15:12: ERROR: Token id for group "cdrom" not found
2022-04-29 20:15:12: ERROR: Token id for group "mail" not found
2022-04-29 20:15:12: ERROR: Token id for group "man" not found
2022-04-29 20:15:12: ERROR: Token id for group "dialout" not found
2022-04-29 20:15:12: ERROR: Token id for group "floppy" not found
2022-04-29 20:15:12: ERROR: Token id for group "games" not found
2022-04-29 20:15:12: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#STOP SC "btrfs-ssd1"#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:15:12: ERROR: Token id for group "video" not found
2022-04-29 20:15:12: ERROR: Token id for group "ftp" not found
2022-04-29 20:15:12: ERROR: Token id for group "lock" not found
2022-04-29 20:15:12: ERROR: Token id for group "audio" not found
2022-04-29 20:15:12: ERROR: Token id for group "nobody" not found
2022-04-29 20:15:12: ERROR: Token id for group "utmp" not found
2022-04-29 20:15:12: ERROR: Token id for group "utempter" not found
2022-04-29 20:15:12: ERROR: Token id for group "kvm" not found
2022-04-29 20:15:12: ERROR: Token id for group "render" not found
2022-04-29 20:15:12: ERROR: Token id for group "systemd-journal" not found
2022-04-29 20:15:12: ERROR: Token id for group "systemd-coredump" not found
2022-04-29 20:15:12: ERROR: Token id for group "systemd-resolve" not found
2022-04-29 20:15:12: ERROR: Token id for group "systemd-oom" not found
2022-04-29 20:15:12: ERROR: Token id for group "systemd-timesync" not found
2022-04-29 20:15:12: ERROR: Token id for group "dbus" not found
2022-04-29 20:15:12: ERROR: Token id for group "polkitd" not found
2022-04-29 20:15:12: ERROR: Token id for group "printadmin" not found
2022-04-29 20:15:12: ERROR: Token id for group "ssh_keys" not found
2022-04-29 20:15:12: ERROR: Token id for group "rpc" not found
2022-04-29 20:15:12: ERROR: Token id for group "cockpit-ws" not found
2022-04-29 20:15:12: ERROR: Token id for group "cockpit-wsinstance" not found
2022-04-29 20:15:12: ERROR: Token id for group "tss" not found
2022-04-29 20:15:12: ERROR: Token id for group "abrt" not found
2022-04-29 20:15:12: ERROR: Token id for group "setroubleshoot" not found
2022-04-29 20:15:12: ERROR: Token id for group "rpcuser" not found
2022-04-29 20:15:12: ERROR: Token id for group "sshd" not found
2022-04-29 20:15:12: ERROR: Token id for group "dnsmasq" not found
2022-04-29 20:15:12: ERROR: Token id for group "chrony" not found
2022-04-29 20:15:12: ERROR: Token id for group "slocate" not found
2022-04-29 20:15:12: ERROR: Token id for group "tcpdump" not found
2022-04-29 20:15:12: ERROR: Token id for group "sgx" not found
2022-04-29 20:15:12: ERROR: Token id for group "systemd-network" not found
2022-04-29 20:15:12: ERROR: Token id for group "screen" not found
2022-04-29 20:15:12: ERROR: Token id for group "pcp" not found
2022-04-29 20:15:12: ERROR: Token id for group "zabbix" not found
2022-04-29 20:15:12: ERROR: Token id for group "clevis" not found
2022-04-29 20:15:12: ERROR: Token id for group "sonarr" not found
2022-04-29 20:15:12: ERROR: Token id for group "rtorrent" not found
2022-04-29 20:15:12: Deleting shadowcopy for path "/mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d/" -2
2022-04-29 20:15:12: Delete subvolume (no-commit): '/mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d'
2022-04-29 20:15:12: Deleting Shadowcopy for dir "/mnt/btrfs-ssd1"
2022-04-29 20:15:12: FileSrv: Received data...
2022-04-29 20:15:12: FileSrv: Received a Packet.
2022-04-29 20:15:12: rc=0 hasError=true state=0
2022-04-29 20:15:12: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2DID BACKUP status_id=2&server_token=eMSYS7NCU9HwnsySPvMO&group=0
2022-04-29 20:15:12: Removing running process (1) id 1 server_id 2 token eMSYS7NCU9HwnsySPvMO action 2
2022-04-29 20:15:12: rc=0 hasError=true state=0
2022-04-29 20:15:12: FileSrv: Sending script urbackup/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43 not finished yet
2022-04-29 20:15:12: FileSrv: Received data...
2022-04-29 20:15:12: FileSrv: Received a Packet.
2022-04-29 20:15:12: Received flush.
2022-04-29 20:15:12: FileSrv: Recv Error in RecvMessage
2022-04-29 20:15:12: FileSrv: ClientThread deleted. 1024 KB Memory freed.
2022-04-29 20:15:12: FileSrv: Received data...
2022-04-29 20:15:12: FileSrv: Received a Packet.
2022-04-29 20:15:12: FileSrv: Sending script output (normal) urbackup/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43 metadata_id=0
2022-04-29 20:15:12: FileSrv: Mapped name: /usr/local/var/urbackup/data/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43
2022-04-29 20:15:12: FileSrv: Sent script urbackup/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43
2022-04-29 20:15:12: FileSrv: Received data...
2022-04-29 20:15:12: FileSrv: Received a Packet.
2022-04-29 20:15:12: Received flush.
2022-04-29 20:15:12: FileSrv: Received data...
2022-04-29 20:15:12: FileSrv: Received a Packet.
2022-04-29 20:15:12: FileSrv: Finishing script urbackup/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43
2022-04-29 20:15:12: FileSrv: Mapped name: /usr/local/var/urbackup/data/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43
2022-04-29 20:15:12: Removing pipe file urbackup/FILE_METADATA|eMSYS7NCU9HwnsySPvMO|43
2022-04-29 20:15:12: Pipe file has exit code 0
2022-04-29 20:15:21: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2PING RUNNING pc_done=100&status_id=2&speed_bpms=0&total_bytes=0&done_bytes=0&paused_fb=1#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:15:31: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2PING RUNNING pc_done=100&status_id=2&speed_bpms=0&total_bytes=0&done_bytes=0&paused_fb=1#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:15:41: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2PING RUNNING pc_done=100&status_id=2&speed_bpms=0&total_bytes=0&done_bytes=0&paused_fb=1#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:15:51: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2PING RUNNING pc_done=100&status_id=2&speed_bpms=0&total_bytes=0&done_bytes=0&paused_fb=1#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:16:01: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2PING RUNNING pc_done=100&status_id=2&speed_bpms=0&total_bytes=0&done_bytes=0&paused_fb=1#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:16:06: ClientService cmd: PONG
2022-04-29 20:16:11: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2PING RUNNING pc_done=100&status_id=2&speed_bpms=0&total_bytes=0&done_bytes=0&paused_fb=1#token=eMSYS7NCU9HwnsySPvMO
2022-04-29 20:16:12: FileSrv: 1 min Timeout deleting Buffers (1024 KB) and waiting 1h more...
2022-04-29 20:16:12: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#WRITE TOKENS
2022-04-29 20:16:12: rc=0 hasError=true state=0
2022-04-29 20:16:12: FileSrv: Received data...
2022-04-29 20:16:12: FileSrv: Received a Packet.
2022-04-29 20:16:12: FileSrv: Sending file (normal) urbackup/tokens_eMSYS7NCU9HwnsySPvMO.properties metadata_id=0
2022-04-29 20:16:12: FileSrv: Mapped name: /usr/local/var/urbackup/data/tokens_eMSYS7NCU9HwnsySPvMO.properties
2022-04-29 20:16:12: FileSrv: Received data...
2022-04-29 20:16:12: FileSrv: Received a Packet.
2022-04-29 20:16:12: Received flush.
2022-04-29 20:16:12: FileSrv: 1 min Timeout deleting Buffers (1024 KB) and waiting 1h more...
2022-04-29 20:16:13: FileSrv: Recv Error in RecvMessage
2022-04-29 20:16:21: rc=0 hasError=true state=0
2022-04-29 20:16:22: FileSrv: ClientThread deleted. 1024 KB Memory freed.
2022-04-29 20:16:22: FileSrv: Recv Error in RecvMessage
2022-04-29 20:16:22: ClientService cmd: #IY4B1bqa84rnqowBNvF4l#2LOGDATA 1651259781 0-1651259711-Starting unscheduled full file backup...
0-1651259711-Create a readonly snapshot of '/mnt/btrfs-ssd1' in '/mnt/btrfs-ssd1/.urbackup_snaps/7ce9d7fa4bf4829ad2022915875a3912e166d19561dd8b1d'
0-1651259711-Indexing of "btrfs-ssd1" done. 7 filesystem lookups 0 db lookups and 0 db updates
0-1651259711-fileserver: Loading file list...
0-1651259711-fileserver: Started loading files...
0-1651259711-Waiting for file transfers...
0-1651259712-Waiting for file hashing and copying threads...
0-1651259772-Writing new file list...
0-1651259772-All metadata was present
0-1651259773-Transferred 3.27051 KB - Average speed: 112.096 KBit/s
0-1651259781-Time taken for backing up client fileserver: 1m 10s
0-1651259781-Backup succeeded
2022-04-29 20:16:22: rc=0 hasError=true state=0
2022-04-29 20:16:32: FileSrv: ClientThread deleted. 1024 KB Memory freed.
^C2022-04-29 20:16:40: WARNING: Shutting down (Signal 2)
2022-04-29 20:16:40: Deleting lbs...
2022-04-29 20:16:40: Shutting down plugins...
2022-04-29 20:16:40: Deleting server...