Virtual Appliance (hyperv) Server ran out of space. Now will not load web interface. Will not mount backup drive

Sorry… the hard way it is then… Could you post the output of ls -lh /dev/disk/by-partlabel/ ?

root@demi:/home/admin# ls -lh /dev/disk/by-partlabel/
total 0
lrwxrwxrwx 1 root root 10 Nov 13 17:28 BM-614afb1b9dbb4d88a11eb92b3604b965 -> …/…/sdb1
root@demi:/home/admin#

Make sure backup_server.db is in place, i.e.:

echo "SELECT COUNT(*) FROM backups; SELECT COUNT(*) FROM backup_images;" | sqlite3 /var/urbackup/backup_server.db

returns positive values.

Start sqlite3 /var/urbackup/app.db and run:

INSERT OR REPLACE INTO settings (key, value) VALUES ('email', 'user@email');
INSERT OR REPLACE INTO settings (key, value) VALUES ('password', 'passw0rd');
INSERT OR REPLACE INTO settings (key, value) VALUES ('appname', 'appliancename');
INSERT OR REPLACE INTO misc (key, value) VALUES ('is_setup', 'true');
INSERT INTO devices (uuid, usage, name, size, enckey, serial) VALUES ('614afb1b9dbb4d88a11eb92b3604b965', 'storage', 'Disk', 1073741824, 'enckey', '-');

replacing user@email, passw0rd, appliancename, enckey with appropriate values.

Then reboot. Reconfigure the timezone. Reconfigure monitoring.

I get that done and then the webinterface says.

Sorry, UrBackup seems to have crashed. Please reboot to retry. UrBackup will reboot automatically one hour after this message is shown.
If possible, submit an issue report after reboot about this problem describing what might have caused the crash and attaching log/crash information (report problem link on the bottom).

However the backups to mount.

Just noticed this at


It actually says the appliance is online.

Did you re-enable the urbackup-server service ? (systemctl enable urbackup-server)

What does systemctl status urbackup-server say? If that has an error, does tail -n 100 /var/log/urbackup.log show something relevant?

root@demi:/home/admin# systemctl status urbackup-server
● urbackup-server.service - UrBackup Client/Server Network Backup System
Loaded: loaded (/lib/systemd/system/urbackup-server.service; enabled; vendor preset: enabled)
Active: failed (Result: signal) since Mon 2020-11-16 22:14:29 UTC; 3min 6s ago
Process: 861 ExecStart=/usr/bin/urbackupsrv run --config /etc/default/urbackupsrv --no-consoletime -w /var/run/urbackupsrv.pid (code=killed, signal
Main PID: 861 (code=killed, signal=SEGV)

Nov 16 22:14:27 demi urbackupsrv[861]: WARNING: SQLite: no such table: image_stats errorcode: 1
Nov 16 22:14:27 demi urbackupsrv[861]: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats. Retrying in
Nov 16 22:14:28 demi urbackupsrv[861]: WARNING: SQLite: no such table: image_stats errorcode: 1
Nov 16 22:14:28 demi urbackupsrv[861]: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats. Retrying in
Nov 16 22:14:29 demi urbackupsrv[861]: Client authentication failure for SS-JAMES from 71.238.210.229
Nov 16 22:14:29 demi urbackupsrv[861]: WARNING: SQLite: no such table: image_stats errorcode: 1
Nov 16 22:14:29 demi urbackupsrv[861]: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats [db=main file
Nov 16 22:14:29 demi systemd[1]: urbackup-server.service: Main process exited, code=killed, status=11/SEGV
Nov 16 22:14:29 demi systemd[1]: urbackup-server.service: Unit entered failed state.
Nov 16 22:14:29 demi systemd[1]: urbackup-server.service: Failed with result ‘signal’.

root@demi:/home/admin# tail -n 100 /var/log/urbackup.log
2020-11-16 22:16:06: SQLite: recovered 16 frames from WAL file /var/urbackup/backup_server_link_journal.db-wal code: 283
2020-11-16 22:16:06: Started UrBackup…
2020-11-16 22:16:06: Removing temporary files…
2020-11-16 22:16:06: Recreating temporary folder…
2020-11-16 22:16:06: InternetService: Server started up successfully!
2020-11-16 22:16:06: UrBackup Server start up complete.
2020-11-16 22:16:06: Looking for old Sessions… 0 sessions
2020-11-16 22:16:06: Server started up successfully!
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Did not find backup suitable for archiving with backup_type=2 image=false letter=
2020-11-16 22:16:06: Removing unknown for in folder /media/backup/backups…
2020-11-16 22:16:06: Removing unknown for client “AGC-MAIN”
2020-11-16 22:16:06: Broadcasting on interface IP 192.168.1.35
2020-11-16 22:16:06: Removing unknown for client “GE-RICKY”
2020-11-16 22:16:06: Removing unknown for client “PDS-PERRY”
2020-11-16 22:16:06: Removing unknown for client “PDS-ROBERT”
2020-11-16 22:16:06: Removing unknown for client “PDS-DISPATCH”
2020-11-16 22:16:06: Removing unknown for client “PDS-OFFICE”
2020-11-16 22:16:06: Removing unknown for client “PDS-GARY”
2020-11-16 22:16:07: Removing unknown for client “I-GEORGE-COLLIN”
2020-11-16 22:16:07: Removing unknown for client “I-GEORGE-CROOK”
2020-11-16 22:16:07: Removing unknown for client “GENE-DONNA”
2020-11-16 22:16:07: Removing unknown for client “GENE-OFFICE”
2020-11-16 22:16:07: Removing unknown for client “WS00”
2020-11-16 22:16:07: Removing unknown for client “AMR-ACCOUNTING”
2020-11-16 22:16:07: Removing unknown for client “AMR-RETAIL-POS”
2020-11-16 22:16:07: Removing unknown for client “AMRDC2”
2020-11-16 22:16:07: Removing unknown for client “RICHARD-CONE”
2020-11-16 22:16:07: Removing unknown for client “SS-RICK”
2020-11-16 22:16:07: Removing unknown for client “SS-JAMES”
2020-11-16 22:16:07: Removing unknown for client “SS-HEAVY”
2020-11-16 22:16:07: Removing unknown for client “IVYHALL”
2020-11-16 22:16:07: Removing unknown for client “JHOOKSVR”
2020-11-16 22:16:07: Removing unknown for client “MURDAUGH-KIM”
2020-11-16 22:16:07: Removing unknown for client “MURDAUGH-JOE”
2020-11-16 22:16:07: Removing unknown for client “GALVATRON”
2020-11-16 22:16:07: Removing unknown for client “SHOCKWAVE”
2020-11-16 22:16:07: Removing unknown for client “BOWMAN”
2020-11-16 22:16:07: Removing unknown for client “JAZZ”
2020-11-16 22:16:07: Removing unknown for client “SOUNDWAVE”
2020-11-16 22:16:07: Removing unknown for client “GEYER”
2020-11-16 22:16:07: Removing unknown for client “SRV2012”
2020-11-16 22:16:07: Removing unknown for client “HMC-WS”
2020-11-16 22:16:07: Removing unknown for client “OPAL-PC”
2020-11-16 22:16:07: Removing unknown for client “ART-WS1”
2020-11-16 22:16:07: Removing unknown for client “TERRY-HILL”
2020-11-16 22:16:07: Removing unknown for client “ACN-COMMIT”
2020-11-16 22:16:07: Removing unknown for client “ACN-AUTOMATE”
2020-11-16 22:16:07: Removing unknown for client “I-Jane-Lanning”
2020-11-16 22:16:07: Removing unknown for client “I-Kaylee-Jconst”
2020-11-16 22:16:07: Removing unknown for client “SS-Sales-Rob”
2020-11-16 22:16:07: Removing unknown for client “I-TIM0-GINA”
2020-11-16 22:16:07: Removing unknown for client “I-TIMO”
2020-11-16 22:16:07: Removing unknown for client “NK-NATHAN-AIO”
2020-11-16 22:16:07: Removing unknown for client “SS-Tanner”
2020-11-16 22:16:07: Removing unknown for client “SS-TannerLT”
2020-11-16 22:16:07: Cleaning up search databases…
2020-11-16 22:16:07: WARNING: Cleaning up search databases failed
2020-11-16 22:16:07: Cleaning up search databases backup…
2020-11-16 22:16:07: Downloading version file…
2020-11-16 22:16:08: Downloading version file…
2020-11-16 22:16:08: Downloading version file…
2020-11-16 22:16:09: Downloading dataplan database…
2020-11-16 22:16:09: ERROR: Error downloading dataplan database: HTTP response code said error(ec=22), The requested URL returned error: 404 Not Found
2020-11-16 22:16:09: Updating statistics (startup)…
2020-11-16 22:16:09: Updating image stats…
2020-11-16 22:16:09: Updating file statistics…
2020-11-16 22:16:09: WARNING: SQLite: no such table: image_stats errorcode: 1
2020-11-16 22:16:09: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats. Retrying in 1s…
2020-11-16 22:16:10: WARNING: SQLite: no such table: image_stats errorcode: 1
2020-11-16 22:16:10: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats. Retrying in 1s…
2020-11-16 22:16:11: WARNING: SQLite: no such table: image_stats errorcode: 1
2020-11-16 22:16:11: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats. Retrying in 1s…
2020-11-16 22:16:12: New Backupclient: ACN-COMMIT
2020-11-16 22:16:12: New Backupclient: ACN-AVA
2020-11-16 22:16:12: New Backupclient: WS00
2020-11-16 22:16:12: Sending Identity to client “ACN-AVA” failed. Retrying in 10m… (returned “failed”)
2020-11-16 22:16:12: Sending Identity to client “ACN-COMMIT” failed. Retrying in 10m… (returned “failed”)
2020-11-16 22:16:12: Sending Identity to client “WS00” failed. Retrying in 10m… (returned “failed”)
2020-11-16 22:16:12: WARNING: SQLite: no such table: image_stats errorcode: 1
2020-11-16 22:16:12: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats. Retrying in 1s…
2020-11-16 22:16:13: WARNING: SQLite: no such table: image_stats errorcode: 1
2020-11-16 22:16:13: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats. Retrying in 1s…
2020-11-16 22:16:14: WARNING: SQLite: no such table: image_stats errorcode: 1
2020-11-16 22:16:14: ERROR: Error preparing Query [DELETE FROM image_stats WHERE refs<=0]: no such table: image_stats [db=main file=/var/urbackup/backup_server_stats.db]
root@demi:/home/admin#

Am I just looking at setting up a new server and starting all over again?

Creating the backup_server_stats.db schema:

echo "CREATE TABLE image_stats (offset INTEGER, tsize INTEGER, clientid INTEGER, refs INTEGER, PRIMARY KEY(offset, tsize, clientid) ) WITHOUT ROWID;" | sqlite3 /var/urbackup/backup_server_stats.db
echo "CREATE TABLE present_backups (backupid INTEGER);" | sqlite3 /var/urbackup/backup_server_stats.db

Yay. I am able to log into the server. However. The clients are not backing up. There is a backup error when you manually ask for a file/image backup.

I did reinstall one of the clients, and it does communicate. It does do an incremental image backup, but will not do an incremental/full file backup.

11/18/20 08:42 DEBUG Reflink copying is enabled
11/18/20 08:42 DEBUG Reflink copying is enabled
11/18/20 08:42 INFO Starting unscheduled full file backup…
11/18/20 08:42 DEBUG ACN-AUTOMATE: Connecting for filelist…
11/18/20 08:42 DEBUG ACN-AUTOMATE: Waiting for filelist
11/18/20 08:42 DEBUG ACN-AUTOMATE: Connecting for filelist (async)…
11/18/20 08:46 WARNING Restarting shadow copy of C:\ because it was started by this server
11/18/20 08:46 INFO Following symbolic link at “C:\Users\All Users” to “C:\ProgramData” confirms symlink backup target “.symlink_ProgramData” to “C:\ProgramData”
11/18/20 08:46 INFO Indexing of “Users” done. 239 filesystem lookups 0 db lookups and 0 db updates
11/18/20 08:46 DEBUG ACN-AUTOMATE: Doing backup without hashed transfer…
11/18/20 08:46 INFO ACN-AUTOMATE: Loading file list…
11/18/20 08:46 ERROR Creating new search db subvol failed
11/18/20 08:46 ERROR Error creating search db location
11/18/20 08:46 ERROR Backup had an early error. Deleting partial backup.

Hmm, now the “report problem” link on the bottom should work. That would give me more detailed information.

W.r.t. the search db issue: You could disable search db creation in the advanced settings.

Perhaps it has wrong permissions? rmdir /var/urbackup/searchdb? journalctl -u urbackup-server should show more error details.

And it seems it lost its private key/identity and therefore the old clients don’t accept it anymore :confused:

Thanks, yeah, disabling searchdb creation in the advanced settings should fix it. That would also cause less space usage on the system volume. I’ll change it such that it disables this automatically when it has a lower amount of free space on the system volume…