I’m using virtual sub clients to backup with different settings to two servers. I want to migrate one of my two gentoo-boxes with btrfs to truenas with zfs including CoW features. I think there’s no way to just port the old backup and config over but a fresh start is ok for me (still have the backups on my other box).
I used the urbackup app as a starting point, changed it to a costum app to edit the yaml and switch to the latest-zfs image, tuned privileges and mounts so that urbackup_snapshot_helper worked and the GUI stopped giving errors about Permissions.
Now I get the same error as in this post https://forums.urbackup.org/t/zfs-cow-file-backups-and-virtual-sub-client-names-invalid-character-in-name/5080 about invalid character ‘[’ in name for a virtual sub client, which I need for the double backup solution.
Additionally, I still have other problems with my docker setup as it seems that urbackup uses the urbackup-user to create sub-datasets for Backups but I think, I need to add PUID and PGID with a non existent number to the environment section of my yaml.
But also, my clients lost connection and cannot find the server after the initial backup attempt.
So here is my yaml:
yaml
services:
urbackup-server:
cap_add:
- CHOWN
- DAC_OVERRIDE
- FOWNER
- SETGID
- SETUID
- SYS_ADMIN
cap_drop:
- ALL
deploy:
resources:
limits:
cpus: ‘4’
memory: 16384M
devices:
- /dev/zfs:/dev/zfs
environment:
NVIDIA_VISIBLE_DEVICES: void
PGID: 4221
PUID: 4221
TZ: Europe/Vienna
UMASK: ‘002’
UMASK_SET: ‘002’
group_add:
- 568
healthcheck:
interval: 10s
retries: 30
start_period: 10s
test: >-
/bin/bash -c ‘exec {hc_fd}<>/dev/tcp/127.0.0.1/55414 && echo -e “GET /
HTTP/1.1\r\nHost: 127.0.0.1\r\nConnection: close\r\n\r\n” >&$${hc_fd} &&
cat <&$${hc_fd} | grep “HTTP” | grep -q “200”’
timeout: 5s
image: uroni/urbackup-server:latest-zfs
platform: linux/amd64
ports:
- mode: ingress
protocol: udp
published: 35623
target: 35623
- mode: ingress
protocol: tcp
published: 55413
target: 55413
- mode: ingress
protocol: tcp
published: 55414
target: 55414
- mode: ingress
protocol: tcp
published: 55415
target: 55415
privileged: True
restart: unless-stopped
security_opt:
- no-new-privileges=false
stdin_open: False
tty: False
user: ‘0:0’
volumes:
- bind:
create_host_path: False
propagation: rprivate
read_only: False
source: /mnt/Backups/urBackup/backup
target: /backups
type: bind
- bind:
create_host_path: False
propagation: rprivate
read_only: False
source: /mnt/Backups/urBackup/backup
target: /mnt/Backups/urBackup/backup
type: bind
- bind:
create_host_path: False
propagation: rprivate
read_only: False
source: /mnt/Backups/urBackup/config
target: /var/urbackup
type: bind
- bind:
create_host_path: False
propagation: rprivate
read_only: False
source: /mnt/Backups/urBackup/etcUrbackup
target: /etc/urbackup
type: bind
volumes: {}
x-notes: >+UrBackup
Bug Reports and Feature Requests
If you find a bug in this app or have an idea for a new feature, please file
an issue atx-portals:
- host: 0.0.0.0
name: Web UI
path: /
port: 55414
scheme: http
And the Logs for when the backups failed:
Log
2025-05-02 17:11:16.171477+00:00usermod: no changes
2025-05-02 17:11:16.282776+00:002025-05-02 19:11:16: Starting HTTP-Server on port 55414
2025-05-02 17:11:16.282893+00:002025-05-02 19:11:16: HTTP: Server started up successfully!
2025-05-02 17:11:16.307153+00:002025-05-02 19:11:16: SQLite: recovered 4 frames from WAL file /var/urbackup/backup_server.db-wal code: 283
2025-05-02 17:11:16.308200+00:002025-05-02 19:11:16: SQLite: recovered 31 frames from WAL file /var/urbackup/backup_server_link_journal.db-wal code: 283
2025-05-02 17:11:16.309364+00:002025-05-02 19:11:16: SQLite: recovered 107 frames from WAL file /var/urbackup/backup_server_settings.db-wal code: 283
2025-05-02 17:11:16.310467+00:002025-05-02 19:11:16: SQLite: recovered 4 frames from WAL file /var/urbackup/backup_server.db-wal code: 283
2025-05-02 17:11:16.311331+00:002025-05-02 19:11:16: SQLite: recovered 107 frames from WAL file /var/urbackup/backup_server_settings.db-wal code: 283
2025-05-02 17:11:16.312352+00:002025-05-02 19:11:16: SQLite: recovered 31 frames from WAL file /var/urbackup/backup_server_link_journal.db-wal code: 283
2025-05-02 17:11:16.312812+00:002025-05-02 19:11:16: Started UrBackup…
2025-05-02 17:11:16.313553+00:002025-05-02 19:11:16: Removing temporary files…
2025-05-02 17:11:16.313691+00:002025-05-02 19:11:16: Recreating temporary folder…
2025-05-02 17:11:16.315264+00:00TEST FAILED: guestmount is missing (libguestfs-tools)
2025-05-02 17:11:16.317160+00:002025-05-02 19:11:16: Image mounting disabled: TEST FAILED: guestmount is missing (libguestfs-tools)
2025-05-02 17:11:16.318307+00:00Testing for btrfs…
2025-05-02 17:11:16.320130+00:00TEST FAILED: Creating test btrfs subvolume failed
2025-05-02 17:11:16.320144+00:00Testing for zfs…
2025-05-02 17:11:16.790837+00:00Destroyed subvol Backups/urBackup/backup/images/testA54hj5luZtlorr494 successfully.
2025-05-02 17:11:16.790923+00:00ZFS TEST OK
2025-05-02 17:11:16.814252+00:002025-05-02 19:11:16: InternetService: Server started up successfully!
2025-05-02 17:11:16.815365+00:002025-05-02 19:11:16: UrBackup Server start up complete.
2025-05-02 17:11:16.815416+00:002025-05-02 19:11:16: Looking for old Sessions… 0 sessions
2025-05-02 17:11:16.815457+00:002025-05-02 19:11:16: Server started up successfully!
2025-05-02 17:11:17.172947+00:00Destroyed subvol Backups/urBackup/backup/files/testA54hj5luZtlorr494 successfully.
2025-05-02 17:11:17.174349+00:002025-05-02 19:11:17: Backup destination does handle subvolumes and snapshots. Snapshots enabled for image and file backups.
2025-05-02 17:11:17.174418+00:002025-05-02 19:11:17: Emulating reflinks via copying
2025-05-02 17:11:17.175821+00:002025-05-02 19:11:17: Reflink ioctl failed. errno=11
2025-05-02 17:11:17.199177+00:002025-05-02 19:11:17: Broadcasting on ipv4 interface eth0 addr 172.16.1.2
2025-05-02 17:11:17.199279+00:002025-05-02 19:11:17: Broadcasting on ipv6 interface eth0 addr fdd0:0:0:1::2
2025-05-02 17:11:17.199324+00:002025-05-02 19:11:17: Broadcasting on ipv6 interface eth0 addr fe80::42:acff:fe10:102
2025-05-02 17:11:17.817833+00:002025-05-02 19:11:17: Downloading version file…
2025-05-02 17:11:17.866662+00:002025-05-02 19:11:17: Downloading version file…
2025-05-02 17:11:17.915496+00:002025-05-02 19:11:17: Downloading server version info…
2025-05-02 17:11:17.971830+00:002025-05-02 19:11:17: Downloading dataplan database…
2025-05-02 17:41:17.815946+00:002025-05-02 19:41:17: Looking for old Sessions… 3 sessions
2025-05-02 17:41:24.832442+00:002025-05-02 19:41:24: Looking for old Sessions… 3 sessions
2025-05-02 17:41:24.832543+00:002025-05-02 19:41:24: Session timeout: Session 3CM8LEuh1aTMksrvRRek8w2waH0VkT
2025-05-02 17:46:40.783834+00:002025-05-02 19:46:40: Looking for old Sessions… 2 sessions
2025-05-02 17:46:40.783982+00:002025-05-02 19:46:40: Session timeout: Session Z4ydCMtVBdZ0Pe5QK55bygK1VO1Qq1
2025-05-02 17:48:30.166800+00:002025-05-02 19:48:30: New Backupclient: TestClient
2025-05-02 17:53:30.370045+00:002025-05-02 19:53:30: Client exited: TestClient
2025-05-02 17:53:33.371264+00:002025-05-02 19:53:33: client_main Thread for client TestClient finished
2025-05-02 17:54:20.403891+00:002025-05-02 19:54:20: Client finished: TestClient
2025-05-02 17:55:51.963021+00:002025-05-02 19:55:51: Looking for old Sessions… 1 sessions
2025-05-02 18:16:51.720740+00:002025-05-02 20:16:51: New Backupclient: TestClient2
2025-05-02 18:16:52.510963+00:002025-05-02 20:16:52: ERROR: Error creating hash folder. No such file or directory (code: 2)
2025-05-02 18:16:52.510994+00:002025-05-02 20:16:52: ERROR: Cannot create directory /backups/TestClient2/250502-2016 for backup (server error). No such file or directory (code: 2)
2025-05-02 18:16:52.511003+00:002025-05-02 20:16:52: Time taken for backing up client TestClient2: 393ms
2025-05-02 18:16:52.511008+00:002025-05-02 20:16:52: ERROR: Backup failed
2025-05-02 18:16:52.511016+00:002025-05-02 20:16:52: Updating statistics…
2025-05-02 18:16:52.511463+00:002025-05-02 20:16:52: Updating image stats…
2025-05-02 18:16:52.511489+00:002025-05-02 20:16:52: Updating file statistics…
2025-05-02 18:16:52.512018+00:002025-05-02 20:16:52: Done updating statistics.
2025-05-02 18:16:53.512108+00:002025-05-02 20:16:53: WARNING: Exponential backoff: Waiting at least 40m before next file backup
2025-05-02 18:16:53.569639+00:002025-05-02 20:16:53: Starting scheduled incremental image backup of volume “C:”…
2025-05-02 18:16:53.569806+00:002025-05-02 20:16:53: Starting scheduled full image backup of volume “SYSVOL”…
2025-05-02 18:16:53.998454+00:002025-05-02 20:16:53: ERROR: Error creating file for writing MBR data. Permission denied (code: 13)
2025-05-02 18:16:53.998481+00:002025-05-02 20:16:53: Updating statistics…
2025-05-02 18:16:53.998858+00:002025-05-02 20:16:53: Updating image stats…
2025-05-02 18:16:53.998901+00:002025-05-02 20:16:53: Updating file statistics…
2025-05-02 18:16:53.999263+00:002025-05-02 20:16:53: Done updating statistics.
2025-05-02 18:16:54.570015+00:002025-05-02 20:16:54: ERROR: Backing up System Reserved (SYSVOL) partition failed. Image backup failed
2025-05-02 18:16:54.570036+00:002025-05-02 20:16:54: Time taken for backing up client TestClient2: 1s
2025-05-02 18:16:54.570043+00:002025-05-02 20:16:54: ERROR: Backup failed
2025-05-02 18:16:55.570820+00:002025-05-02 20:16:55: WARNING: Exponential backoff: Waiting at least 40m before next image backup
2025-05-02 18:17:41.779817+00:002025-05-02 20:17:41: New Backupclient: TestClient2[data]
2025-05-02 18:17:42.212968+00:002025-05-02 20:17:42: ERROR: Error creating empty file subvolume. “cannot create ‘Backups/urBackup/backup/files/TestClient2[data]/250502-2017’: invalid character ‘[’ in name
2025-05-02 18:17:42.212994+00:00”
2025-05-02 18:17:42.213024+00:002025-05-02 20:17:42: ERROR: Cannot create directory /backups/TestClient2[data]/250502-2017 for backup (server error). cannot create ‘Backups/urBackup/backup/files/TestClient2[data]/250502-2017’: invalid character ‘[’ in name
2025-05-02 18:17:42.213041+00:002025-05-02 20:17:42: Time taken for backing up client TestClient2[data]: 39ms
2025-05-02 18:17:42.213054+00:002025-05-02 20:17:42: ERROR: Backup failed
2025-05-02 18:17:42.213060+00:002025-05-02 20:17:42: Updating statistics…
2025-05-02 18:17:42.213338+00:002025-05-02 20:17:42: Updating image stats…
2025-05-02 18:17:42.213362+00:002025-05-02 20:17:42: Updating file statistics…
2025-05-02 18:17:42.213622+00:002025-05-02 20:17:42: Done updating statistics.
2025-05-02 18:17:43.213790+00:002025-05-02 20:17:43: WARNING: Exponential backoff: Waiting at least 40m before next file backup
2025-05-02 18:17:43.224962+00:002025-05-02 20:17:43: Starting scheduled incremental image backup of volume “C:”…
2025-05-02 18:17:43.225242+00:002025-05-02 20:17:43: Starting scheduled full image backup of volume “SYSVOL”…
2025-05-02 18:17:43.260501+00:002025-05-02 20:17:43: ERROR: Error creating empty image subvolume. “cannot create ‘Backups/urBackup/backup/images/TestClient2[data]/250502-2017_Image_SYSVOL’: invalid character ‘[’ in name”
2025-05-02 18:17:43.260521+00:002025-05-02 20:17:43: ERROR: Error creating image backup destination.
2025-05-02 18:17:43.260547+00:002025-05-02 20:17:43: Updating statistics…
2025-05-02 18:17:43.260884+00:002025-05-02 20:17:43: Updating image stats…
2025-05-02 18:17:43.260903+00:002025-05-02 20:17:43: Updating file statistics…
2025-05-02 18:17:43.261111+00:002025-05-02 20:17:43: Done updating statistics.
2025-05-02 18:17:44.225627+00:002025-05-02 20:17:44: ERROR: Backing up System Reserved (SYSVOL) partition failed. Image backup failed
2025-05-02 18:17:44.225740+00:002025-05-02 20:17:44: Time taken for backing up client TestClient2[data]:
2025-05-02 18:17:44.225780+00:002025-05-02 20:17:44: ERROR: Backup failed
2025-05-02 18:17:45.227324+00:002025-05-02 20:17:45: WARNING: Exponential backoff: Waiting at least 40m before next image backup
2025-05-02 18:23:32.388612+00:002025-05-02 20:23:32: Client exited: TestClient2
2025-05-02 18:23:32.388743+00:002025-05-02 20:23:32: Client exited: TestClient2[data]
2025-05-02 18:23:35.389768+00:002025-05-02 20:23:35: client_main Thread for client TestClient2 finished
2025-05-02 18:23:35.389873+00:002025-05-02 20:23:35: client_main Thread for client TestClient2[data] finished
2025-05-02 18:24:22.421745+00:002025-05-02 20:24:22: Client finished: TestClient2
2025-05-02 18:24:22.422017+00:002025-05-02 20:24:22: Client finished: TestClient2[data]
2025-05-02 18:25:45.845482+00:002025-05-02 20:25:45: Looking for old Sessions… 4 sessions
2025-05-02 18:34:31.825948+00:002025-05-02 20:34:31: Looking for old Sessions… 6 sessions
2025-05-02 18:34:31.826070+00:002025-05-02 20:34:31: Session timeout: Session Ht3gIQBJ2VFZIiWSleeGCPcSAHy09F