Phash load segfault on server 2.2.1 beta

Development
1

Added my /home for backup and i can t complete it, the server process crashes, the web ui too.

[sam. mai 27 22:58:56 2017] phash load[23644]: segfault at 50 ip 0000000000572397 sp 00007feb857f9a70 error 4 in urbackupsrv[400000+900000]
[sam. mai 27 23:16:32 2017] phash load[10286]: segfault at f ip 000000000000000f sp 00007f1c9dffaab8 error 14 in urbackupsrv[400000+900000]
[dim. mai 28 01:29:46 2017] phash load[13287]: segfault at 45 ip 0000000000000045 sp 00007f8c3b7fdab8 error 14 in urbackupsrv[400000+900000]

2

Did you enable the parallel hash loading?

Could you run it with debug symbols in gdb and post a stack trace?

3

Yes, it has parallel hash loading.

I ll try to gdb it, but it s about 15 years i didn’t used it and the error is kinda random

4

client logs :
2017-06-06 16:28:22: FileSrv: Received a Packet.
2017-06-06 16:28:22: FileSrv: Sending file (normal) mCR2gn1ZB46AmwYpGCeC|.symlink_/usr/lib/gcc/x86_64-linux-gnu/6/cc1plus metadata_id=399833
2017-06-06 16:28:22: FileSrv: Mapped name: /usr/lib/gcc/x86_64-linux-gnu/6/cc1plus
2017-06-06 16:29:10: Client timeout in ClientConnector::Run - Channel (ping timeout)

client livelogs :

06/06/17 16:27 DEBUG No old file for “libgcc_s.so” (1)
06/06/17 16:27 DEBUG GT: File “colormap-remap” not found via hash. Loading file…
06/06/17 16:27 DEBUG GT: File “colorxhtml.py” not found via hash. Loading file…
06/06/17 16:28 DEBUG Loading “.symlink_/usr/lib/gcc/x86_64-linux-gnu/6/cc1”. 75% finished 16.0551 MB/21.1808 MB at 955.664 KBit/s

server backtrace :
2017-06-06 16:28:14: Loading “.symlink_/usr/lib/gcc/x86_64-linux-gnu/6/cc1”. 75% finished 16.0551 MB/21.1808 MB at 955.664 KBit/s

Thread 8 “urbackupsrv” received signal SIGPIPE, Broken pipe.
[Switching to Thread 0x7fffd77fe700 (LWP 14842)]
0x00007ffff6de24bd in write () at …/sysdeps/unix/syscall-template.S:84
84 …/sysdeps/unix/syscall-template.S: No such file or directory.
(gdb)
(gdb) backtrace
#0 0x00007ffff6de24bd in write () at …/sysdeps/unix/syscall-template.S:84
#1 0x00007ffff601fb35 in ?? () from /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
#2 0x00007ffff601db5c in BIO_write () from /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
#3 0x00007ffff6376bf2 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#4 0x00007ffff6378e13 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#5 0x00007ffff6374a22 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#6 0x00007ffff7bbb4c3 in ?? () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#7 0x00007ffff7b896e7 in ?? () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#8 0x00007ffff7b8a0fa in ?? () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#9 0x00007ffff7b9e5d6 in ?? () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#10 0x00007ffff7b9eeed in curl_multi_perform () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#11 0x00007ffff7b9594b in curl_easy_perform () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#12 0x00000000008c70ce in UrlFactory::sendMail(MailServer const&, std::vector<std::string, std::allocatorstd::string > const&, std::string const&, std::string const&, std::string*) ()
#13 0x000000000088307f in Mailer::operator()() ()
#14 0x000000000042ae95 in thread_helper_f(void*) ()
#15 0x00007ffff6dd96ba in start_thread (arg=0x7fffd77fe700) at pthread_create.c:333
#16 0x00007ffff6b0f82d in clone () at …/sysdeps/unix/sysv/linux/x86_64/clone.S:109
(gdb)

5

Seems to not be the relevant thread. Enter handle SIPIPE nostop and then continue with continue.

6

Seems to be in the same place

2017-06-08 09:50:43: GT: Loaded file “springcontent.sdz”
2017-06-08 09:50:43: Loading file “bitmaps.sdz”
2017-06-08 09:50:43: PT: Hashing file “springcontent.sdz”
2017-06-08 09:50:43: HT: Copying file: “/data/urbackup2/pascalou/170608-0848/.symlink_/usr/share/games/spring/base/springcontent.sdz”
2017-06-08 09:50:43: New fileindex entry for “/data/urbackup2/pascalou/170608-0848/.symlink_/usr/share/games/spring/base/springcontent.sdz” id=7711908 hash=vJiM8aLdNZx72vxEdkN1sg==

Thread 8 “urbackupsrv” received signal SIGPIPE, Broken pipe.
[Switching to Thread 0x7fffe9ffb700 (LWP 24055)]
0x00007ffff6de24bd in write () at …/sysdeps/unix/syscall-template.S:84
84 …/sysdeps/unix/syscall-template.S: No such file or directory.
(gdb) backtrace
#0 0x00007ffff6de24bd in write () at …/sysdeps/unix/syscall-template.S:84
#1 0x00007ffff601fb35 in ?? () from /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
#2 0x00007ffff601db5c in BIO_write () from /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
#3 0x00007ffff6376bf2 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#4 0x00007ffff6378e13 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#5 0x00007ffff6374a22 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#6 0x00007ffff7bbb4c3 in ?? () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#7 0x00007ffff7b896e7 in ?? () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#8 0x00007ffff7b8a0fa in ?? () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#9 0x00007ffff7b9e5d6 in ?? () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#10 0x00007ffff7b9eeed in curl_multi_perform () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#11 0x00007ffff7b9594b in curl_easy_perform () from /usr/lib/x86_64-linux-gnu/libcurl.so.4
#12 0x00000000008c70ce in UrlFactory::sendMail(MailServer const&, std::vector<std::string, std::allocatorstd::string > const&, std::string const&, std::string const&, std::string*) ()
#13 0x000000000088307f in Mailer::operator()() ()
#14 0x000000000042ae95 in thread_helper_f(void*) ()
#15 0x00007ffff6dd96ba in start_thread (arg=0x7fffe9ffb700) at pthread_create.c:333
#16 0x00007ffff6b0f82d in clone () at …/sysdeps/unix/sysv/linux/x86_64/clone.S:109
(gdb) handle SIGPIPE nostop
Signal Stop Print Pass to program Description
SIGPIPE No Yes Yes Broken pipe
(gdb) continue
Continuing.
2017-06-11 12:54:20: InternetService: No available slots… starting new Worker
[New Thread 0x7fff63fff700 (LWP 9612)]
2017-06-11 12:54:20: Looking for old Sessions… 0 sessions
2017-06-11 12:54:20: WARNING: Error sending mail to “edited”. Timeout was reached(ec=28), server response timeout. Retrying in 30m
2017-06-11 12:54:20: Lost channel connection to pascalou. has_error=true
2017-06-11 12:54:20: Server timeout (2) in FileClient
2017-06-11 12:54:20: Lost channel connection to boulledebetise. has_error=true
2017-06-11 12:54:20: Encryption overhead: 323.247 KB
[New Thread 0x7fff61ffb700 (LWP 9619)]
2017-06-11 12:54:20: Lost channel connection to pascalou[home]. has_error=true
2017-06-11 12:54:20: Connection broken: Error sending ‘running’ (2) ping to client
2017-06-11 12:54:20: Sending file “/usr/share/urbackup/www”
2017-06-11 12:54:20: LMDB: PUT clientid=1 filesize=22230 hash=B/+rYqPhW7clg01Ofs93Pw== target=7711760
2017-06-11 12:54:20: Sending file: /usr/share/urbackup/www/index.htm
2017-06-11 12:54:20: Sending file: /usr/share/urbackup/www/index.htm done
2017-06-11 12:54:20: Sending file “/usr/share/urbackup/www/css/bootstrap.chash-2f624089c65f12185e79925bc5a7fc42.min.css”
2017-06-11 12:54:20: LMDB: PUT clientid=1 filesize=10572 hash=CAzwpXUM2PquX6AvUjYRDQ== target=7711906
2017-06-11 12:54:20: LMDB: PUT clientid=1 filesize=17708 hash=CMr9IlXHoL8HBQ8WzEoJYA== target=7711761
[New Thread 0x7fff617fa700 (LWP 9623)]
2017-06-11 12:54:20: Sending file “/usr/share/urbackup/www/css/bootstrap-theme.chash-46d96593303e4c8666f497bb7602c999.min.css”
2017-06-11 12:54:20: LMDB: PUT clientid=1 filesize=6628 hash=GEDLFGoXAi4eYNY2Z3k3AA== target=7711780
[New Thread 0x7fff60ff9700 (LWP 9624)]
2017-06-11 12:54:20: Sending file “/usr/share/urbackup/www/css/bootstrap-select.chash-d2d8b0cbdd75333eb01a025abd0ed954.min.css”
2017-06-11 12:54:20: HTTP: No available slots… starting new Worker
2017-06-11 12:54:20: Sending file: /usr/share/urbackup/www/css/bootstrap.chash-2f624089c65f12185e79925bc5a7fc42.min.css
[New Thread 0x7fff42ffd700 (LWP 9626)]
[New Thread 0x7fff43fff700 (LWP 9625)]
2017-06-11 12:54:20: HTTP: No available slots… starting new Worker
2017-06-11 12:54:20: Sending file “/usr/share/urbackup/www/css/dataTables.chash-199ff38fd61a7e4516ee546eaa4c29c7.bootstrap.css”
2017-06-11 12:54:20: Sending file: /usr/share/urbackup/www/css/bootstrap-theme.chash-46d96593303e4c8666f497bb7602c999.min.css

7

As expected. Now wait till it gets SIGSEGV and then enter bt.