I'll admit I'm using obsolete versions of the bacula demons, but they have been
working great. I know it would be good to upgrade, I try to keep everything in
my realm upgraded, but with my limited time and varying versions of OSes, it's
better to keep using the old version, still.
All I did was make some small changes to: baconfig.h, dird/dird_conf.c,
filed/restore.c, and findlib/create_file.c. I suppose the changes to
baconfig.h triggered pretty much everything to be re-compiled including
bacula-sd. That leads me to think it's crashing due to the newer compiler or
OS being used? These binaries were last compiled on Debian 8 using GCC 4. Now
I'm on Debian 10 with GCC 8. The mods I made were successful, and bacula-dir
and bacula-fd start and run fine. For some reason, bacula-sd crashes with the
below debug output plus traceback, but none of the modified files are
mentioned. Instead, you can see the debug code leading up the crash.
Fortunately, I saved backups of the binaries before running `make install` and
the backup bacula-sd still runs fine with the newly compiled bacula-dir and
-fd, although I'm not sure it's a good idea since it's based on the previous
version of baconfig.h. I'd like to know why the newly compiled version is
suddenly crashing, can you make any sense of the below output?
Many thanks!
# /sbin/bacula-sd.new -d 9001 -dt -f -m -v -c /etc/bacula/bacula-sd.conf
[thousands of lines removed]
dump_resource type=3003
Device: name=ZFS4-restore MediaType=File Device=/bacula LabelType=0
rew_wait=300 min_bs=0 max_bs=0 chgr_wait=300
max_jobs=0 max_files=0 max_size=0
max_file_size=1000000000 capacity=0
spool_directory=*None*
max_spool_size=0 max_job_spool_size=0
CAP_EOF CAP_BSR CAP_BSF CAP_FSR CAP_FSF CAP_EOM CAP_RACCESS
CAP_AUTOMOUNT CAP_LABEL
dump_resource type=3004
Messages: name=Standard
Warning: no "autochanger" resource (3005) defined.
22-Jan-2023 23:54:41 bacula-sd: lex.c:131-0 Close lex file:
/etc/bacula/bacula-sd.conf
22-Jan-2023 23:54:41 bacula-sd: lex.c:140-0 Close cfg file
/etc/bacula/bacula-sd.conf
22-Jan-2023 23:54:41 bacula-sd: smartall.c:190-0 sm_free 68 at 55f9a9055b08
from lex.c:173
22-Jan-2023 23:54:41 bacula-sd: smartall.c:190-0 sm_free 5065 at 55f9a9056e58
from lex.c:210
22-Jan-2023 23:54:41 bacula-sd: mem_pool.c:235-0 free_pool_memory 55f9a9056e58
pool=0 from lex.c:142
22-Jan-2023 23:54:41 bacula-sd: smartall.c:190-0 sm_free 681 at 55f9a9055b58
from lex.c:186
22-Jan-2023 23:54:41 bacula-sd: parse_conf.c:1033-0 Leave parse_config()
22-Jan-2023 23:54:41 bacula-sd: message.c:504-0 Close_msg jcr=0
22-Jan-2023 23:54:41 bacula-sd: message.c:529-0 ===Begin close msg resource at
55f9a9054178
22-Jan-2023 23:54:41 bacula-sd: mem_pool.c:123-0 sm_get_pool_memory reuse
55f9a905a978 to message.c:530
22-Jan-2023 23:54:41 bacula-sd: mem_pool.c:235-0 free_pool_memory 55f9a905a978
pool=3 from message.c:636
22-Jan-2023 23:54:41 bacula-sd: message.c:637-0 Done walking message chain.
22-Jan-2023 23:54:41 bacula-sd: message.c:644-0 ===End close msg resource
22-Jan-2023 23:54:41 bacula-sd: smartall.c:147-0 smalloc 97 at 55f9a9056e58
from message.c:317
22-Jan-2023 23:54:41 bacula-sd: smartall.c:147-0 smalloc 50 at 55f9a905ac38
from message.c:326
22-Jan-2023 23:54:41 bacula-sd: smartall.c:190-0 sm_free 97 at 55f9a9054248
from message.c:409
22-Jan-2023 23:54:41 bacula-sd: smartall.c:190-0 sm_free 185 at 55f9a9054178
from message.c:303
22-Jan-2023 23:54:41 bacula-sd: smartall.c:147-0 smalloc 185 at 55f9a9054178
from message.c:341
22-Jan-2023 23:54:41 bacula-sd: message.c:347-0 Copy message resource
55f9a905ac78 to 55f9a9056e58
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 321 at 55f9a9056ec8 from
bsys.c:457
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:139-0 sm_get_pool_memory give
55f9a9056ec8 to bsys.c:457
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:235-0 free_pool_memory 55f9a9056ec8
pool=2 from bsys.c:500
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:123-0 sm_get_pool_memory reuse
55f9a9056ec8 to bsys.c:546
22-Jan-2023 23:54:41 hind-sd: jcr.c:140-0 read_last_jobs seek to 192
22-Jan-2023 23:54:41 hind-sd: jcr.c:147-0 Read num_items=10
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057018 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057118 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057218 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057318 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057418 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057518 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057618 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057718 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057818 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 241 at 55f9a9057918 from
jcr.c:160
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:235-0 free_pool_memory 55f9a9056ec8
pool=2 from bsys.c:587
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 65 at 55f9a9055b08 from
lockmgr.c:617
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 1921 at 55f9a9057b48
from lockmgr.c:643
22-Jan-2023 23:54:41 hind-sd: sd_plugins.c:173-0 Load sd plugins
22-Jan-2023 23:54:41 hind-sd: sd_plugins.c:175-0 No sd plugin dir!
22-Jan-2023 23:54:41 hind-sd: priv.c:60-0 uname=NONE gname=NONE
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:123-0 sm_get_pool_memory reuse
55f9a905a978 to stored.c:470
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 577 at 55f9a90582d8 from
stored.c:471
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:139-0 sm_get_pool_memory give
55f9a90582d8 to stored.c:471
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:123-0 sm_get_pool_memory reuse
55f9a9055fb8 to ../lib/berrno.h:77
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 1921 at 7f0af0000b48
from lockmgr.c:643
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 2345 at 55f9a9063ff8
from stored.c:508
22-Jan-2023 23:54:41 hind-sd: stored.c:516-0 Skipped: .
22-Jan-2023 23:54:41 hind-sd: stored.c:516-0 Skipped: ..
22-Jan-2023 23:54:41 hind-sd: stored.c:516-0 Skipped: BackupCatalog.bsr
22-Jan-2023 23:54:41 hind-sd: stored.c:516-0 Skipped: bacula-fd.9102.state
22-Jan-2023 23:54:41 hind-sd: stored.c:516-0 Skipped: bacula.db
22-Jan-2023 23:54:41 hind-sd: stored.c:516-0 Skipped: bacula-sd.9103.state
22-Jan-2023 23:54:41 hind-sd: stored.c:516-0 Skipped: bacula-dir.9101.state
22-Jan-2023 23:54:41 hind-sd: smartall.c:190-0 sm_free 2345 at 55f9a9063ff8
from stored.c:508
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:235-0 free_pool_memory 55f9a905a978
pool=3 from stored.c:534
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:235-0 free_pool_memory 55f9a90582d8
pool=3 from stored.c:535
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:235-0 free_pool_memory 55f9a9055fb8
pool=4 from ../lib/berrno.h:84
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 65 at 55f9a9058f78 from
vol_mgr.c:693
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 65 at 55f9a9065ca8 from
vol_mgr.c:696
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 57 at 55f9a9065388 from
lockmgr.c:951
22-Jan-2023 23:54:41 hind-sd: watchdog.c:91-0 Initialising NicB-hacked watchdog
thread
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 65 at 55f9a9058938 from
watchdog.c:99
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 65 at 55f9a9059018 from
watchdog.c:100
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 57 at 55f9a9058fc8 from
lockmgr.c:951
22-Jan-2023 23:54:41 22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 105
at 55f9a9059168 from watchdog.c:172
hind-sd: smartall.c:147-0 smalloc 1921 at 7f0ae8000b48 from lockmgr.c:643
22-Jan-2023 23:54:41 hind-sd: watchdog.c:206-0 Registered watchdog
55f9a9059168, interval 30
22-Jan-2023 23:54:41 hind-sd: smartall.c:190-0 sm_free 57 at 55f9a9065388 from
lockmgr.c:951
22-Jan-2023 23:54:41 hind-sd: jcr.c:339-0 Enter new_jcr
22-Jan-2023 23:54:41 22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc
1193 at 7f0ae80012d8 from jcr.c:345
hind-sd: smartall.c:147-0 smalloc 1921 at 7f0aec000b48 from lockmgr.c:643
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 65 at 55f9a9065388 from
jcr.c:347
22-Jan-2023 23:54:41 hind-sd: smartall.c:190-0 sm_free 57 at 55f9a9058fc8 from
lockmgr.c:951
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:123-0 sm_get_pool_memory reuse
55f9a9056ec8 to jcr.c:358
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:123-0 sm_get_pool_memory reuse
55f9a90582d8 to jcr.c:360
22-Jan-2023 23:54:41 22-Jan-2023 23:54:41 22-Jan-2023 23:54:41 hind-sd:
watchdog.c:263-0 NicB-reworked watchdog thread entered
hind-sd: smartall.c:147-0 smalloc 321 at 7f0ae8001798 from jcr.c:362
22-Jan-2023 23:54:41 hind-sd: mem_pool.c:139-0 sm_get_pool_memory give
7f0ae8001798 to jcr.c:362
hind-sd: bnet_server.c:112-0 Addresses host[ipv4:X.X.X.X:9103]
host[ipv4:X.X.X.X:9103] host[ipv4:X.X.X.X:9103]
22-Jan-2023 23:54:41 hind-sd: watchdog.c:318-0 pthread_cond_timedwait 30
22-Jan-2023 23:54:41 hind-sd: jcr.c:910-0 set_jcr_job_status(*System*, C)
22-Jan-2023 23:54:41 hind-sd: jcr.c:919-0 OnEntry JobStatus=22-Jan-2023
23:54:41 hind-sd: jcr.c:930-0 Set new stat. old: 22-Jan-2023 23:54:41 hind-sd:
jcr.c:935-0 leave setJobStatus old=22-Jan-2023 23:54:41 hind-sd: stored.c:564-0
calling init_dev /bacula
22-Jan-2023 23:54:41 hind-sd: smartall.c:147-0 smalloc 2441 at 7f0ae80018e8
from dev.c:177
22-Jan-2023 23:54:41 hind-sd: signal.c:142-0 sig=11 Segmentation violation
Bacula interrupted by signal 11: Segmentation violation
Kaboom! bacula-sd.new, hind-sd got signal 11 - Segmentation violation.
Attempting traceback.
Kaboom! exepath=/sbin/
22-Jan-2023 23:54:41 hind-sd: signal.c:205-0 Working=/var/lib/bacula
22-Jan-2023 23:54:41 hind-sd: signal.c:206-0 btpath=/sbin/btraceback
22-Jan-2023 23:54:41 hind-sd: signal.c:207-0 exepath=/sbin/bacula-sd.new
22-Jan-2023 23:54:41 hind-sd: signal.c:236-0 Doing waitpid
Calling: /sbin/btraceback /sbin/bacula-sd.new 13743 /var/lib/bacula
22-Jan-2023 23:54:42 hind-sd: signal.c:238-0 Done waitpid
hind-sd: signal.c:238-0 Done waitpid
It looks like the traceback worked...
#
Thread 4 (Thread 0x7f0af753a700 (LWP 13747)):
#0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f0af7539e00, expected=0,
futex_word=0x7f0af8da55a8 <_ZL5timer+40>) at
../sysdeps/unix/sysv/linux/futex-internal.h:205
#1 __pthread_cond_wait_common (abstime=0x7f0af7539e00, mutex=0x7f0af8da55c0
<_ZL11timer_mutex>, cond=0x7f0af8da5580 <_ZL5timer>) at pthread_cond_wait.c:539
#2 __pthread_cond_timedwait (cond=cond@entry=0x7f0af8da5580 <_ZL5timer>,
mutex=mutex@entry=0x7f0af8da55c0 <_ZL11timer_mutex>,
abstime=abstime@entry=0x7f0af7539e00) at pthread_cond_wait.c:667
#3 0x00007f0af8d8d6fc in bthread_cond_timedwait_p (cond=cond@entry=0x7f0af8da5580 <_ZL5timer>,
m=m@entry=0x7f0af8da55c0 <_ZL11timer_mutex>, abstime=abstime@entry=0x7f0af7539e00,
file=file@entry=0x7f0af8d965c2 "watchdog.c", line=line@entry=321) at lockmgr.c:824
#4 0x00007f0af8d872ca in watchdog_thread (arg=arg@entry=0x0) at watchdog.c:321
#5 0x00007f0af8d8d1fc in lmgr_thread_launcher (x=0x55f9a9058fc8) at
lockmgr.c:939
#6 0x00007f0af8d16fa3 in start_thread (arg=<optimized out>) at
pthread_create.c:486
#7 0x00007f0af892006f in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 3 (Thread 0x7f0af7d3b700 (LWP 13746)):
#0 0x00007f0af8d210ca in __waitpid (pid=pid@entry=13748,
stat_loc=stat_loc@entry=0x7f0af7d3a48c, options=options@entry=0) at
../sysdeps/unix/sysv/linux/waitpid.c:30
#1 0x00007f0af8d7e953 in signal_handler (sig=11) at signal.c:237
#2 <signal handler called>
#3 VOLRES::set_slot (slot=-1, this=0x5555555555555555) at vol_mgr.h:88
#4 DEVICE::clear_slot (this=0x7f0ae80018e8) at dev.c:1444
#5 m_init_dev (jcr=0x0, device=0x55f9a90596f8, new_init=false) at dev.c:183
#6 0x000055f9a8132170 in device_initialization (arg=arg@entry=0x0) at
stored.c:565
#7 0x00007f0af8d8d1fc in lmgr_thread_launcher (x=0x55f9a9065388) at
lockmgr.c:939
#8 0x00007f0af8d16fa3 in start_thread (arg=<optimized out>) at
pthread_create.c:486
#9 0x00007f0af892006f in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 2 (Thread 0x7f0af853c700 (LWP 13745)):
#0 0x00007f0af8d20bf0 in __GI___nanosleep
(requested_time=requested_time@entry=0x7f0af853be00,
remaining=remaining@entry=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
#1 0x00007f0af8d60248 in bmicrosleep (sec=sec@entry=30, usec=usec@entry=0) at
bsys.c:106
#2 0x00007f0af8d8d0a9 in check_deadlock () at lockmgr.c:574
#3 0x00007f0af8d16fa3 in start_thread (arg=<optimized out>) at
pthread_create.c:486
#4 0x00007f0af892006f in clone () at
../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 1 (Thread 0x7f0af8822740 (LWP 13743)):
#0 0x00007f0af8917bd7 in __GI___select (nfds=nfds@entry=7,
readfds=readfds@entry=0x7ffd7eb44750, writefds=writefds@entry=0x0,
exceptfds=exceptfds@entry=0x0, timeout=timeout@entry=0x0) at
../sysdeps/unix/sysv/linux/select.c:41
#1 0x00007f0af8d631f8 in bnet_thread_server (addr_list=<optimized out>,
max_clients=<optimized out>, client_wq=0x55f9a81856e0 <dird_workq>,
handle_client_request=0x55f9a814b9d0 <handle_connection_request(void*)>) at bnet_server.c:177
#2 0x000055f9a81318f7 in main (argc=<optimized out>, argv=<optimized out>) at
stored.c:284
#0 0x00007f0af8917bd7 in __GI___select (nfds=nfds@entry=7,
readfds=readfds@entry=0x7ffd7eb44750, writefds=writefds@entry=0x0,
exceptfds=exceptfds@entry=0x0, timeout=timeout@entry=0x0) at
../sysdeps/unix/sysv/linux/select.c:41
41 in ../sysdeps/unix/sysv/linux/select.c
resultvar = 18446744073709551102
sc_cancel_oldtype = 0
sc_ret = <optimized out>
#1 0x00007f0af8d631f8 in bnet_thread_server (addr_list=<optimized out>,
max_clients=<optimized out>, client_wq=0x55f9a81856e0 <dird_workq>,
handle_client_request=0x55f9a814b9d0 <handle_connection_request(void*)>) at bnet_server.c:177
177 if ((stat = select(maxfd + 1, &sockset, NULL, NULL, NULL)) < 0) {
maxfd = 6
sockset = {fds_bits = {112, 0 <repeats 15 times>}}
newsockfd = <optimized out>
stat = <optimized out>
clilen = 0
cli_addr = {sa_family = 0, sa_data = '\000' <repeats 13 times>}
tlog = <optimized out>
turnon = 1
ipaddr = <optimized out>
next = <optimized out>
fd_ptr = 0x0
buf = '\000' <repeats 25 times>, "Fkrw\341\330q", '\000' <repeats 16 times>,
"\020\254\005\251\371U\000\000\020V\005\251\371U\000\000
X\005\251\371U\000\000\025\000\000\000\000\000\000\000\022\000\000\000\000\000\000\000(\272\205\370\n\177\000\000\000\000\000\000\000\000\000\000`H\264~\375\177\000\000
\353\232\370\n\177\000\000\330,\236\370\n\177\000"
sockfds = {<SMARTALLOC> = {<No data fields>}, head = 0x7ffd7eb44610, tail =
0x7ffd7eb445d0, loffset = 0, num_items = 3}
allbuf = "host[ipv4:X.X.X.X:9103] host[ipv4:X.X.X.X:9103] host[ipv4:X.X.X.X:9103]
\000\275\v\000\000\000\000\000\000\276\v\000\000\000\000\000\000\000\310\332\370\n\177\000\000\000\310\332\370\n\177\000\000\374F\335\370\n\177\000\000\000\000\000\000\000\000\000\000(\003\000\000\000\000\000\000\000\217\320\370\n\177\000\000\001\000\000\000\000\000\000\000t\227\202\370\n\177\000\000\004K\335\370\n\177\000\000(\003\000\000\000\000\000\000،\203\370\n\177\000\000\000\217\320\370\n\177\000\000\230"...
#2 0x000055f9a81318f7 in main (argc=<optimized out>, argv=<optimized out>) at
stored.c:284
284 bnet_thread_server(me->sdaddrs, me->max_concurrent_jobs * 2 + 1,
ch = <optimized out>
no_signals = <optimized out>
test_config = false
thid = 139685084247808
uid = 0x0
gid = 0x0
#0 0x0000000000000000 in ?? ()
No symbol table info available.
#0 0x0000000000000000 in ?? ()
No symbol table info available.
#0 0x0000000000000000 in ?? ()
No symbol table info available.
#0 0x0000000000000000 in ?? ()
No symbol table info available.
#0 0x0000000000000000 in ?? ()
No symbol table info available.
[Inferior 1 (process 13743) detached]
_______________________________________________
Bacula-devel mailing list
Bacula-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-devel
