Server 2.5.12 beta/Client 2.5.6 beta

uroni · July 12, 2020, 5:00pm

Updated (2.5.11/2.5.5).

orogor · July 12, 2020, 6:34pm

The leak seems to be fixed. Backup frequency still has an issue.

client: /usr/local/var/urbackup/data/settings.cfg
update_freq_incr.group=86400
update_freq_incr.home=86400
update_freq_incr.client=
update_freq_incr.use=4
update_freq_incr=
update_freq_full.group=2592000
update_freq_full.home=2592000
update_freq_full.client=
update_freq_full.use=4
update_freq_full=

Also for the port, i am not sure for example how the server can parse the port it should listen to if you have multiple internet servers.
Maybe move the server url to the client setting internet tab and keep the internet port where it was (that would allow for ex, different external url for different groups).

uroni · July 13, 2020, 5:32pm

I think I was able to reproduce the problem. Will be improved with the next version.

It’s like ws://example.com uses port 80 as default. urbackup://example.com connects to 55415 per default. Other ports can be specified via e.g. urbackup://example.com:55417. Multiple servers with urbackup://example.com:55415;urbackup://example.com:55417… now I just have to recheck that this actually works

GieltjE · July 14, 2020, 9:45am

Just upgraded our setup to server 2.5.11 and client 2.5.5 but the server doesn’t appear to bind the internet port anymore (all clients are disconnected, even the localhost):

urbackupsrv run -i -v debug -b lo
2020-07-14 11:37:36: Starting HTTP-Server on port 55414
2020-07-14 11:37:36: HTTP: Server started up successfully!
2020-07-14 11:37:36: SQLite: recovered 9772 frames from WAL file /var/lib/urbackup/backup_server.db-wal code: 283
2020-07-14 11:37:36: SQLite: recovered 7574 frames from WAL file /var/lib/urbackup/backup_server_link_journal.db-wal code: 283
2020-07-14 11:37:36: SQLite: recovered 50868 frames from WAL file /var/lib/urbackup/backup_server_links.db-wal code: 283
2020-07-14 11:37:36: SQLite: recovered 720 frames from WAL file /var/lib/urbackup/backup_server_settings.db-wal code: 283
2020-07-14 11:37:36: SQLite: recovered 9772 frames from WAL file /var/lib/urbackup/backup_server.db-wal code: 283
2020-07-14 11:37:36: SQLite: recovered 720 frames from WAL file /var/lib/urbackup/backup_server_settings.db-wal code: 283
2020-07-14 11:37:36: SQLite: recovered 50868 frames from WAL file /var/lib/urbackup/backup_server_links.db-wal code: 283
2020-07-14 11:37:36: SQLite: recovered 7574 frames from WAL file /var/lib/urbackup/backup_server_link_journal.db-wal code: 283
2020-07-14 11:37:36: Started UrBackup…
2020-07-14 11:37:36: Removing temporary files…
2020-07-14 11:37:36: Recreating temporary folder…
Backupfolder not set
2020-07-14 11:37:36: Image mounting disabled: Backupfolder not set
2020-07-14 11:37:36: Testing if backup destination can handle subvolumes and snapshots…
Backupfolder not set
2020-07-14 11:37:36: Backup destination cannot handle subvolumes and snapshots. Snapshots disabled.
2020-07-14 11:37:36: Testing if backup destination can handle filesystem transactions…
2020-07-14 11:37:36: Testing for hardlinks in backup destination…
2020-07-14 11:37:36: Could create hardlink at backup destination. Hardlinks enabled.
2020-07-14 11:37:36: Testing for reflinks in backup destination…
2020-07-14 11:37:36: Could create reflink at backup destination. Reflinks enabled.
2020-07-14 11:37:37: InternetService: Server started up successfully!
2020-07-14 11:37:37: UrBackup Server start up complete.
2020-07-14 11:37:37: Server started up successfully!
2020-07-14 11:37:37: Looking for old Sessions… 0 sessions
2020-07-14 11:37:37: Archived backup with id=1587 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1579 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1586 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1578 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1585 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1576 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1584 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1581 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1583 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1575 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1588 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1559 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1589 image=false letter= for 0 seconds
2020-07-14 11:37:37: Archived backup with id=1580 image=false letter= for 0 seconds
2020-07-14 11:37:38: Downloading version file…
2020-07-14 11:37:38: Downloading version file…
2020-07-14 11:37:38: Downloading server version info…
2020-07-14 11:37:38: Downloading dataplan database…
2020-07-14 11:38:10: HTTP: No available slots… starting new Worker

The server url is defined as: urbackup://backup.xxx.nl:4435
A simple test reveals: telnet backup.xxx.nl 4435
Trying 2a00:f10:121:xxxx:xxxx:xxxx:xxxx:xxxx…
Trying 185.xxx.xxx.xxx…
telnet: Unable to connect to remote host: Connection refused

The client: /usr/local/sbin/urbackupclientbackend --config /etc/default/urbackupclient -v debug
2020-07-14 11:49:41: SQLite: recovered 10945 frames from WAL file /usr/local/var/urbackup/backup_client.db-wal code: 283
2020-07-14 11:49:41: urbackupserver: Server started up successfully!
2020-07-14 11:49:41: FileSrv: Server started up successfully
2020-07-14 11:49:41: Started UrBackupClient Backend…
2020-07-14 11:49:42: Looking for old Sessions… 0 sessions
2020-07-14 11:49:42: Final path: /etc
2020-07-14 11:49:42: Final path: /root
2020-07-14 11:49:42: Final path: /var/www
2020-07-14 11:49:42: Final path: /lib/systemd/system
2020-07-14 11:49:42: Final path: /var/spool/cron/crontabs
2020-07-14 11:49:43: Trying to connect to internet server backup.xxx.nl
2020-07-14 11:49:43: Socket has error: 111
2020-07-14 11:49:43: Socket has error: 111
2020-07-14 11:49:43: Connecting failed.

uroni · July 14, 2020, 2:41pm

Updated.

Yeah, theoretically, you’d have to set the port via config file/args file now (like for e.g. the http port). But I realize there might be many with non-default Internet port, so I have added a setting in the advanced section for configuring the Internet port via web interface again.

GieltjE · July 14, 2020, 2:45pm

If the server has “urbackup://backup.xxx.nl:4435” set under “internet”, “Server URL clients connect to:”. shouldn’t that “simply” be used?

uroni · July 14, 2020, 2:46pm

In 2.5.x now the client connects to the URL set under Internet, and the server binds to the port configured in the advanced settings (or more properly via config file). You could have NAT in between that maps the port to a different one e.g.

tarakesh · July 15, 2020, 1:24pm

Tried an Update from 2.4.12 deb Package to a self compiled 2.5.12 today.
Server starts, upgrades the database, webinterface is accessible.
As soon the Backupclients connect the server starts to throw sqlite errors and crashes with a seg fault after a couple of seconds.

(client names redacted)

2020-07-15 15:31:21: WARNING: SQLite: 4 values for 5 columns in “INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)” errorcode: 1
2020-07-15 15:31:21: ERROR: Error preparing Query [INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)]: 4 values for 5 columns. Retrying in 1s…
2020-07-15 15:31:21: ERROR: Could not create or read directory for client “xxxxxx”. No such file or directory (code: 2)
2020-07-15 15:31:21: WARNING: SQLite: 4 values for 5 columns in “INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)” errorcode: 1
2020-07-15 15:31:21: ERROR: Error preparing Query [INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)]: 4 values for 5 columns. Retrying in 1s…
2020-07-15 15:31:21: ERROR: Could not create or read directory for client “yyyyyyy”. No such file or directory (code: 2)
2020-07-15 15:31:21: WARNING: SQLite: 4 values for 5 columns in “INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)” errorcode: 1
2020-07-15 15:31:21: ERROR: Error preparing Query [INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)]: 4 values for 5 columns. Retrying in 1s…
2020-07-15 15:31:21: WARNING: SQLite: 4 values for 5 columns in “INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)” errorcode: 1
2020-07-15 15:31:21: ERROR: Error preparing Query [INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)]: 4 values for 5 columns. Retrying in 1s…
2020-07-15 15:31:21: WARNING: SQLite: 4 values for 5 columns in “INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)” errorcode: 1
2020-07-15 15:31:21: ERROR: Error preparing Query [INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)]: 4 values for 5 columns. Retrying in 1s…
2020-07-15 15:31:21: WARNING: SQLite: 4 values for 5 columns in “INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)” errorcode: 1
2020-07-15 15:31:21: ERROR: Error preparing Query [INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)]: 4 values for 5 columns. Retrying in 1s…
2020-07-15 15:31:21: ERROR: Could not create or read directory for client “zzzzzz”. No such file or directory (code: 2)
2020-07-15 15:31:21: ERROR: Could not create or read directory for client “aaaaaa”. No such file or directory (code: 2)
2020-07-15 15:31:21: ERROR: Could not create or read directory for client “bbbbbb”. No such file or directory (code: 2)
2020-07-15 15:31:21: ERROR: Could not create or read directory for client “cccccc”. No such file or directory (code: 2)
2020-07-15 15:31:21: WARNING: SQLite: 4 values for 5 columns in “INSERT INTO settings_db.settings (key, value_client, clientid, use, use_last_modified) VALUES (?,?,?, ?)” errorcode: 1

uroni · July 15, 2020, 4:38pm

Sorry! Since you are compiling, adding two characters like this should fix it:

tarakesh · July 15, 2020, 5:25pm

Yeah that fixed the SQL errors.
Unfortunatelly the next ones still remain.
2020-07-15 19:36:17: ERROR: Could not create or read directory for client “xxxxxx”. No such file or directory (code: 2)
2020-07-15 19:36:17: ERROR: Could not create or read directory for client “yyyyyyy”. No such file or directory (code: 2)
2020-07-15 19:36:17: ERROR: Could not create or read directory for client “zzzzzzzz”. No such file or directory (code: 2)

according to the log it seems that the server still uses the correct old backup folder. also the webgui confirms the folder.
Server is running as root for now to test

Update: This only happens to clients that are in groups. Though i can absolutly not find anything that configures any group specific backup target folder

uroni · July 15, 2020, 6:03pm

Did it work before? Does it have problems with [] in the directory name? I guess running it in strace would give more info…

tarakesh · July 15, 2020, 6:12pm

eveything runs absolutly fine with 2.4.12/13
and the strace is even more strange…
where does this F:\ClientBackup\ path come from?
This is from the old Windows installation before i even moved the server to linux. But there is no such config setting to even specify this path anywhere…

323736 mkdir(“F:\ClientBackup/xxxxxxxx”, 0770) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)
123 323736 stat(“F:\ClientBackup/xxxxxxxx”, 0x7f70a57f8e70) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)
124 323736 lstat(“F:\ClientBackup/xxxxxxxx”, 0x7f70a57f8e70) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)
125 323736 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2335, …}) = 0
126 323736 write(1, “2020-07-15 20:20:45: ERROR: Coul”…, 125) = 125
127 323736 write(3, “2020-07-15 20:20:45: ERROR: Coul”…, 125) = 125
128 323736 lseek(3, 0, SEEK_CUR) = 118445441
129 323736 nanosleep({tv_sec=1, tv_nsec=0}, <unfinished …>
130 323732 <… restart_syscall resumed> ) = 0
131 323732 mkdir(“F:\ClientBackup/yyyyyyyy”, 0770) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)
132 323732 stat(“F:\ClientBackup/yyyyyyyy”, 0x7f70a77fce70) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)
133 323732 lstat(“F:\ClientBackup/yyyyyyyy”, 0x7f70a77fce70) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)
134 323732 stat("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2335, …}) = 0
135 323732 write(1, “2020-07-15 20:20:45: ERROR: Coul”…, 121) = 121
136 323732 write(3, “2020-07-15 20:20:45: ERROR: Coul”…, 121) = 121
137 323732 lseek(3, 0, SEEK_CUR) = 118445562
138 323732 nanosleep({tv_sec=1, tv_nsec=0}, <unfinished …>
139 323655 <… poll resumed> ) = 0 (Timeout)
140 323655 poll([{fd=45, events=POLLIN}, {fd=46, events=POLLIN}], 2, 1000 <unfinished …>
141 323725 <… nanosleep resumed> NULL) = 0
142 323725 mkdir(“F:\ClientBackup/zzzzzzzz”, 0770) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)
143 323725 stat(“F:\ClientBackup/zzzzzzzzz”, 0x7f70c77fce70) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)
144 323725 lstat(“F:\ClientBackup/zzzzzzzz”, 0x7f70c77fce70) = -1 ENOENT (Datei oder Verzeichnis nicht gefunden)

uroni · July 15, 2020, 6:30pm

Yes, thanks, it uses the group setting when it should use the global setting. Fix:

uroni · October 13, 2020, 6:30pm

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.