[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-12 Thread Julia Kreger 
Yes, still happens with 2.90-0ubuntu0.22.04.1.

It is a problem with the upstream code as far as I can tell from
dnsmasq, not the ubuntu package build itself.

   Message: Process 1671294 (dnsmasq) of user 65534 dumped core.

Found module linux-vdso.so.1 with build-id: 
975d8292a19f8c241322ae7eb151b63f4f01d8e2
Found module ld-linux-x86-64.so.2 with build-id: 
15921ea631d9f36502d20459c43e5c85b7d6ab76
Found module libc.so.6 with build-id: 
c289da5071a3399de893d2af81d6a30c62646e1e
Found module dnsmasq with build-id: 
aa89f97a7ccd45a1c50674eb7d5da473d605d476
Stack trace of thread 1671294:
#0  0x7fbd66ca29fc __pthread_kill_implementation (libc.so.6 
+ 0x969fc)
#1  0x7fbd66c4e476 __GI_raise (libc.so.6 + 0x42476)
#2  0x7fbd66c347f3 __GI_abort (libc.so.6 + 0x287f3)
#3  0x7fbd66c95676 __libc_message (libc.so.6 + 0x89676)
#4  0x7fbd66caccfc malloc_printerr (libc.so.6 + 0xa0cfc)
#5  0x7fbd66caea44 _int_free (libc.so.6 + 0xa2a44)
#6  0x7fbd66cb1453 __GI___libc_free (libc.so.6 + 0xa5453)
#7  0x555899cd1a32 dhcp_netid_free (dnsmasq + 0x16a32)
#8  0x555899cdc001 clear_dynamic_conf (dnsmasq + 0x21001)
#9  0x555899ce58af clear_cache_and_reload (dnsmasq + 
0x2a8af)
#10 0x555899cc5ad7 async_event (dnsmasq + 0xaad7)
#11 0x7fbd66c35d90 __libc_start_call_main (libc.so.6 + 
0x29d90)
#12 0x7fbd66c35e40 __libc_start_main_impl (libc.so.6 + 
0x29e40)
#13 0x555899cc6375 _start (dnsmasq + 0xb375)

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-07 Thread Julia Kreger 
So, I tossed the change because I wanted to try and produce the failure.
I tried to re-create it, but didn't have the best of luck which makes me
think I masked the issue a bit too well. Playing with valgrind has me
questioning reality:

==1119241== ERROR SUMMARY: 9 errors from 6 contexts (suppressed: 0 from 0)
==1119241== 
==1119241== 1 errors in context 1 of 6:
==1119241== Invalid read of size 8
==1119241==at 0x11EA27: dhcp_netid_free (option.c:1332)
==1119241==by 0x11EA27: dhcp_netid_list_free (option.c:1363)
==1119241==by 0x11EA27: dhcp_config_free (option.c:1381)
==1119241==by 0x128F60: clear_dynamic_conf (option.c:5777)
==1119241==by 0x128F60: reread_dhcp (option.c:5818)
==1119241==by 0x1327FE: clear_cache_and_reload (dnsmasq.c:1738)
==1119241==by 0x112AD6: async_event (dnsmasq.c:1482)
==1119241==by 0x112AD6: main (dnsmasq.c:1224)
==1119241==  Address 0x1ffefffbc0 is on thread 1's stack
==1119241==  624 bytes below stack pointer
==1119241== 
==1119241== 
==1119241== 2 errors in context 2 of 6:
==1119241== Invalid read of size 8
==1119241==at 0x11EA23: dhcp_netid_free (option.c:1331)
==1119241==by 0x11EA23: dhcp_netid_list_free (option.c:1363)
==1119241==by 0x11EA23: dhcp_config_free (option.c:1381)
==1119241==by 0x128F60: clear_dynamic_conf (option.c:5777)
==1119241==by 0x128F60: reread_dhcp (option.c:5818)
==1119241==by 0x1327FE: clear_cache_and_reload (dnsmasq.c:1738)
==1119241==by 0x112AD6: async_event (dnsmasq.c:1482)
==1119241==by 0x112AD6: main (dnsmasq.c:1224)
==1119241==  Address 0x1ffefffbc8 is on thread 1's stack
==1119241==  616 bytes below stack pointer
==1119241== 
==1119241== 
==1119241== 2 errors in context 3 of 6:
==1119241== Invalid free() / delete / delete[] / realloc()
==1119241==at 0x484B27F: free (in 
/usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so)
==1119241==by 0x11EA37: dhcp_netid_free (option.c:1333)
==1119241==by 0x11EA37: dhcp_netid_list_free (option.c:1363)
==1119241==by 0x11EA37: dhcp_config_free (option.c:1381)
==1119241==by 0x128F60: clear_dynamic_conf (option.c:5777)
==1119241==by 0x128F60: reread_dhcp (option.c:5818)
==1119241==by 0x1327FE: clear_cache_and_reload (dnsmasq.c:1738)
==1119241==by 0x112AD6: async_event (dnsmasq.c:1482)
==1119241==by 0x112AD6: main (dnsmasq.c:1224)
==1119241==  Address 0x1ffefffbc0 is on thread 1's stack
==1119241==  544 bytes below stack pointer

Which has me sort of wondering if the overall pattern of the cleanup
might be something we should be looking at.

** Attachment added: "valgrind-local-dnsmasq-build.txt"
   
https://bugs.launchpad.net/ironic/+bug/2026757/+attachment/5753913/+files/valgrind-local-dnsmasq-build.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-06 Thread Julia Kreger 
Petr messaged me and suggested maybe we try using rr to capture the
execution and failure to aid in debugging, unfortunately the cpu
performance events are unavailable on the machine I'm attempting
reproduction on.

I did manage to spend a little time the last two days adding some
additional debug logging into a source build of 2.90 which includes the
patch Brian posted to the dnsmasq mailing list in regards to dhcpv6.

I was still able to reproduce this issue leveraging one of ironic's
combined scenario tests jobs which exercises the dhcp configuration a
number of times. I also turned off inotify updates, and dhcp6 in my
local build, and was also still able to reproduce the failure.

I also tried sending a HUP signal a substantial number of times, and
tried massaging the configuration files which were being loaded for
static entries and I was still unable to reproduce the crash. There *IS*
a distinct possibility I just didn't do it "enough", but reproduced
crashes can barely be running for a long time and end up crashing.

From what I've seen, it appears that it can happen after a dhcp offer
response has been sent back to a v4 client, however at least looking
through the code, it appears netids being set is rather sparing to
configuration loading and do_options in src/rfc2131.c. I unfortunately
don't have the context to understand what and why that is being done in
do_options.

I have also been able to figure out a change to prevent the sigabrt by
only calling free() if a parameter is not null which seems to prevent
crashing, but only masks the root cause and there is no telling how long
and what impact that is having long term.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-01 Thread Julia Kreger 
This is from v2.90 from the ubuntu packaging:

Stack trace of thread 34:
#0  0x7f21c90499fc pthread_kill (libc.so.6 + 0x969fc)
#1  0x7f21c8ff5476 raise (libc.so.6 + 0x42476)
#2  0x7f21c8fdb7f3 abort (libc.so.6 + 0x287f3)
#3  0x7f21c903c676 n/a (libc.so.6 + 0x89676)
#4  0x7f21c9053cfc n/a (libc.so.6 + 0xa0cfc)
#5  0x7f21c9055a54 n/a (libc.so.6 + 0xa2a54)
#6  0x7f21c9058453 free (libc.so.6 + 0xa5453)
#7  0x55ea8f653810 dhcp_netid_free (dnsmasq + 0x1b810)
#8  0x55ea8f6538df dhcp_netid_list_free (dnsmasq + 0x1b8df)
#9  0x55ea8f653956 dhcp_config_free (dnsmasq + 0x1b956)
#10 0x55ea8f661868 clear_dynamic_conf (dnsmasq + 0x29868)
#11 0x55ea8f661947 reread_dhcp (dnsmasq + 0x29947)
#12 0x55ea8f6737b7 clear_cache_and_reload (dnsmasq + 
0x3b7b7)
#13 0x55ea8f672db5 async_event (dnsmasq + 0x3adb5)
#14 0x55ea8f6725aa main (dnsmasq + 0x3a5aa)
#15 0x7f21c8fdcd90 n/a (libc.so.6 + 0x29d90)
#16 0x7f21c8fdce40 __libc_start_main (libc.so.6 + 0x29e40)
#17 0x55ea8f642bc5 _start (dnsmasq + 0xabc5)

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-01 Thread Julia Kreger 
So, trying to at least get symbols for the dnsmasq binary has been
largely unsucessful, so i build v2.90 from dnsmasq git, and here is what
I got:

Found module linux-vdso.so.1 with build-id: 
975d8292a19f8c241322ae7eb151b63f4f01d8e2
Found module ld-linux-x86-64.so.2 with build-id: 
15921ea631d9f36502d20459c43e5c85b7d6ab76
Found module libc.so.6 with build-id: 
c289da5071a3399de893d2af81d6a30c62646e1e
Found module dnsmasq with build-id: 
9ebcae185737a13e7a224834f99a5781c2ba5e14
Stack trace of thread 338919:
#0  0x7fb0ad8399fc pthread_kill (libc.so.6 + 0x969fc)
#1  0x7fb0ad7e5476 raise (libc.so.6 + 0x42476)
#2  0x7fb0ad7cb7f3 abort (libc.so.6 + 0x287f3)
#3  0x7fb0ad82c676 n/a (libc.so.6 + 0x89676)
#4  0x7fb0ad843cfc n/a (libc.so.6 + 0xa0cfc)
#5  0x7fb0ad845a44 n/a (libc.so.6 + 0xa2a44)
#6  0x7fb0ad848453 free (libc.so.6 + 0xa5453)
#7  0x5585456f6a30 dhcp_config_free (dnsmasq + 0x16a30)
#8  0x558545700f61 reread_dhcp (dnsmasq + 0x20f61)
#9  0x55854570a7ff clear_cache_and_reload (dnsmasq + 
0x2a7ff)
#10 0x5585456eaad7 main (dnsmasq + 0xaad7)
#11 0x7fb0ad7ccd90 n/a (libc.so.6 + 0x29d90)
#12 0x7fb0ad7cce40 __libc_start_main (libc.so.6 + 0x29e40)
#13 0x5585456eb375 _start (dnsmasq + 0xb375)

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-01 Thread Julia Kreger 
Listing... Done
dnsmasq-base-lua/unknown,unknown 2.90-0ubuntu0.22.04.1 amd64
dnsmasq-base/unknown,unknown,now 2.90-0ubuntu0.22.04.1 amd64 
[installed,automatic]
dnsmasq-utils/unknown,unknown,now 2.90-0ubuntu0.22.04.1 amd64 [installed]
dnsmasq/unknown,unknown,now 2.90-0ubuntu0.22.04.1 all [installed]
root@np0036907443:/opt/stack/dnsmasq#

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-01 Thread Julia Kreger 
** Attachment added: "core dump file from 2.90 on Ubuntu Jammy"
   
https://bugs.launchpad.net/ironic/+bug/2026757/+attachment/5751256/+files/dnsmasq-jammy-2.90-package-coredumpctl_dump.core

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-01 Thread Julia Kreger 
** Attachment added: "core dump file from 2.90 on Ubuntu Jammy"
   
https://bugs.launchpad.net/ironic/+bug/2026757/+attachment/5751255/+files/dnsmasq-jammy-2.90-package-coredumpctl_dump.core

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-01 Thread Julia Kreger 
** Attachment added: "coredumpctl info output for 2.90 from Ubuntu Jammy"
   
https://bugs.launchpad.net/ironic/+bug/2026757/+attachment/5751229/+files/dnsmasq-jammy-2.90-package-coredumpctl_info

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-03-01 Thread Julia Kreger 
Took some effort, but I've managed to capture a core dump

root@np0036907443:/opt/stack/dnsmasq# coredumpctl info 328293
   PID: 328293 (dnsmasq)
   UID: 65534 (nobody)
   GID: 30 (dip)
Signal: 6 (ABRT)
 Timestamp: Fri 2024-03-01 16:19:37 UTC (2min 34s ago)
  Command Line: dnsmasq --no-hosts "" 
--pid-file=/opt/stack/data/neutron/dhcp/77cabae0-26bf-4374-997a-781947f2e5b2/pid
 
--dhcp-hostsfile=/opt/stack/data/neutron/dhcp/77cabae0-26bf-4374-997a-781947f2e5b2/host
 --a>
Executable: /usr/sbin/dnsmasq
 Control Group: /user.slice/user-0.slice/session-54.scope
  Unit: session-54.scope
 Slice: user-0.slice
   Session: 54
 Owner UID: 0 (root)
   Boot ID: 9aed02ce9d8a44b9845ff26acd24ad62
Machine ID: 312834901b204815afc5cf70e422129b
  Hostname: dnsmasq
   Storage: 
/var/lib/systemd/coredump/core.dnsmasq.65534.9aed02ce9d8a44b9845ff26acd24ad62.328293.170930997700.zst
 (present)
 Disk Size: 29.7K
   Message: Process 328293 (dnsmasq) of user 65534 dumped core.

Found module linux-vdso.so.1 with build-id: 
975d8292a19f8c241322ae7eb151b63f4f01d8e2
Found module ld-linux-x86-64.so.2 with build-id: 
15921ea631d9f36502d20459c43e5c85b7d6ab76
Found module libc.so.6 with build-id: 
c289da5071a3399de893d2af81d6a30c62646e1e
Found module dnsmasq with build-id: 
d8802051e6d28c6d5d2b5ac326a392c5d5a05f5b
Stack trace of thread 328293:
#0  0x7fda047499fc pthread_kill (libc.so.6 + 0x969fc)
#1  0x7fda046f5476 raise (libc.so.6 + 0x42476)
#2  0x7fda046db7f3 abort (libc.so.6 + 0x287f3)
#3  0x7fda0473c676 n/a (libc.so.6 + 0x89676)
#4  0x7fda04753cfc n/a (libc.so.6 + 0xa0cfc)
#5  0x7fda04755a44 n/a (libc.so.6 + 0xa2a44)
#6  0x7fda04758453 free (libc.so.6 + 0xa5453)
#7  0x563328e86068 dhcp_config_free (dnsmasq + 0x14068)
#8  0x563328e8f5e1 reread_dhcp (dnsmasq + 0x1d5e1)
#9  0x563328e9864f clear_cache_and_reload (dnsmasq + 
0x2664f)
#10 0x563328e7b8f6 main (dnsmasq + 0x98f6)
#11 0x7fda046dcd90 n/a (libc.so.6 + 0x29d90)
#12 0x7fda046dce40 __libc_start_main (libc.so.6 + 0x29e40)
#13 0x563328e7c1b5 _start (dnsmasq + 0xa1b5)


** Attachment added: "core dump file - 2.85-9-g10d8b5f"
   
https://bugs.launchpad.net/ironic/+bug/2026757/+attachment/5751227/+files/dnsmasq.core

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-02-29 Thread Julia Kreger 
https://lists.thekelleys.org.uk/pipermail/dnsmasq-
discuss/2023q2/017134.html and original post relates.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 2026757] Re: dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

2024-02-29 Thread Julia Kreger 
Indeed, and unfortunately it seems like I've been able to identify the
root cause which is still present in 2.90. What changed, we're no longer
seeing a segfault which was the tell-tale sign we were looking for, but
instead we just see it quietly exit with no trace. This led me to
getting a setup where I could reproduce the issue, which we've seen
trigger on Ironic's "standalone" jobs as they exercise a number of
different scenarios involving port/address updates quite a bit, and I
just sat with strace attached to the dnsmasq process.

alarm(77377)= 77377
poll([{fd=4, events=POLLIN}, {fd=5, events=POLLIN}, {fd=6, events=POLLIN}, 
{fd=7, events=POLLIN}, {fd=8, events=POLLIN}, {fd=9, events=POLLIN}, {fd=10, 
events=POLLIN}, {fd=11, events=POLLIN}, {fd=12, events=POLLIN}, {fd=13, 
events=POLLIN}, {fd=14, events=POLLIN}, {fd=15, events=POLLIN}, {fd=16, 
events=POLLIN}, {fd=17, events=POLLIN}], 14, -1) = ? ERESTART_RESTARTBLOCK 
(Interrupted by signal)
--- SIGHUP {si_signo=SIGHUP, si_code=SI_USER, si_pid=236696, si_uid=0} ---
getpid()= 235993
writev(18, [{iov_base="\1\0\0\0\0\0\0\0\0\0\0\0", iov_len=12}], 1) = 12
rt_sigreturn({mask=[]}) = -1 EINTR (Interrupted system call)
poll([{fd=4, events=POLLIN}, {fd=5, events=POLLIN}, {fd=6, events=POLLIN}, 
{fd=7, events=POLLIN}, {fd=8, events=POLLIN}, {fd=9, events=POLLIN}, {fd=10, 
events=POLLIN}, {fd=11, events=POLLIN}, {fd=12, events=POLLIN}, {fd=13, 
events=POLLIN}, {fd=14, events=POLLIN}, {fd=15, events=POLLIN}, {fd=16, 
events=POLLIN}, {fd=17, events=POLLIN}], 14, -1) = 1 ([{fd=17, revents=POLLIN}])
read(17, "\1\0\0\0\0\0\0\0\0\0\0\0", 12) = 12
newfstatat(AT_FDCWD, 
"/opt/stack/data/neutron/dhcp/77cabae0-26bf-4374-997a-781947f2e5b2/addn_hosts", 
{st_mode=S_IFREG|0644, st_size=1268, ...}, 0) = 0
openat(AT_FDCWD, 
"/opt/stack/data/neutron/dhcp/77cabae0-26bf-4374-997a-781947f2e5b2/addn_hosts", 
O_RDONLY) = 20
newfstatat(20, "", {st_mode=S_IFREG|0644, st_size=1268, ...}, AT_EMPTY_PATH) = 0
read(20, "10.1.0.1\thost-10-1-0-1.openstack"..., 4096) = 1268
read(20, "", 4096)  = 0
close(20)   = 0
getpid()= 235993
newfstatat(AT_FDCWD, "/etc/localtime", {st_mode=S_IFREG|0644, st_size=114, 
...}, 0) = 0
getpid()= 235993
write(19, "<30>Feb 29 22:35:30 dnsmasq[2359"..., 133) = 133
writev(2, [{iov_base="free(): invalid pointer", iov_len=23}, {iov_base="\n", 
iov_len=1}], 2) = 24
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7fec3171
rt_sigprocmask(SIG_UNBLOCK, [ABRT], NULL, 8) = 0
gettid()= 235993
getpid()= 235993
tgkill(235993, 235993, SIGABRT) = 0
--- SIGABRT {si_signo=SIGABRT, si_code=SI_TKILL, si_pid=235993, si_uid=65534} 
---
+++ killed by SIGABRT +++


The above was captured from a dnsmasq install with 
https://thekelleys.org.uk/gitweb/?p=dnsmasq.git;a=commit;h=10d8b5f001a34ff46b3a72575f3af64b065f8637
 where as running the commit before it, I don't crash out dnsmasq. The result 
with 2.90 is basically identical (https://paste.openstack.org/show/823338/). 

In terms of the actual logging which results, all we get is along the
lines of https://paste.opendev.org/show/823337/, at least with the
install on jammy, where neutron is directly launching the dnsmasq
processes. Looking at the contents of the commit where this starts
(https://thekelleys.org.uk/gitweb/?p=dnsmasq.git;a=blobdiff;f=src/option.c;h=23cf058e8ad9fdcffe621ce0b92d626578d31f82;hp=e8926a49f46050eea9cba7cc90e12d67821f3a2f;hb=10d8b5f001a34ff46b3a72575f3af64b065f8637;hpb=ffd3ceb856eb3e1ff923cae95a2ddb889beab7c1),
it is clear that the logic has been changed into a different which
explains the error we are able to capture with stracce.

I think ironic is going to have to pin to dnsmasq 2.85 for the time
being, until we're able to get this fixed and fully understood in
upstream dnsmasq since this is impacting numerous CI branches and test
jobs.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2026757

Title:
  dnsmasq on Ubuntu Jammy crashes on neutron-dhcp-agent updates

To manage notifications about this bug go to:
https://bugs.launchpad.net/ironic/+bug/2026757/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs