[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326063#comment-17326063
]
ASF GitHub Bot commented on DISPATCH-1844:
--
jiridanek closed pull request #1050:
URL: https://github.com/apache/qpid-dispatch/pull/1050
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Labels: lsan
> Fix For: 1.17.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {noformat}
> 70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {noformat}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17322495#comment-17322495
]
Jiri Daněk commented on DISPATCH-1844:
--
https://travis-ci.com/github/apache/qpid-dispatch/jobs/498890969#L8314
{noformat}
54: Direct leak of 128 byte(s) in 2 object(s) allocated from:
54: #0 0x496f97 in posix_memalign
(/home/travis/build/apache/qpid-dispatch/build/router/qdrouterd+0x496f97)
54: #1 0x7f5e41157290 in sys_mutex
/home/travis/build/apache/qpid-dispatch/src/posix/threading.c:43:5
54: #2 0x7f5e411071e3 in qd_message
/home/travis/build/apache/qpid-dispatch/src/message.c:1017:26
54: #3 0x7f5e411bc453 in _create_message_CT
/home/travis/build/apache/qpid-dispatch/src/router_core/core_client_api.c:683:29
54: #4 0x7f5e411bc453 in _flush_send_queue_CT
/home/travis/build/apache/qpid-dispatch/src/router_core/core_client_api.c:288:29
54: #5 0x7f5e411b8ced in _send_request_CT
/home/travis/build/apache/qpid-dispatch/src/router_core/core_client_api.c:271:5
54: #6 0x7f5e411b8ced in qdrc_client_request_CT
/home/travis/build/apache/qpid-dispatch/src/router_core/core_client_api.c:260:5
54: #7 0x7f5e41265640 in qcm_edge_mgmt_request_CT
/home/travis/build/apache/qpid-dispatch/src/router_core/modules/edge_router/edge_mgmt.c:293:12
54: #8 0x7f5e4125ff26 in _sync_interior_proxies
/home/travis/build/apache/qpid-dispatch/src/router_core/modules/edge_router/link_route_proxy.c:153:13
54: #9 0x7f5e411b0745 in qdrc_event_addr_raise
/home/travis/build/apache/qpid-dispatch/src/router_core/core_events.c:125:13
54: #10 0x7f5e41201a3c in qdr_link_route_deactivate_CT
/home/travis/build/apache/qpid-dispatch/src/router_core/route_control.c:229:9
54: #11 0x7f5e41207035 in deactivate_route_connection
/home/travis/build/apache/qpid-dispatch/src/router_core/route_control.c:620:13
54: #12 0x7f5e41206317 in qdr_route_connection_closed_CT
/home/travis/build/apache/qpid-dispatch/src/router_core/route_control.c:695:9
54: #13 0x7f5e411888cd in qdr_connection_closed_CT
/home/travis/build/apache/qpid-dispatch/src/router_core/connections.c:1477:5
54: #14 0x7f5e4122bc41 in router_core_thread
/home/travis/build/apache/qpid-dispatch/src/router_core/router_core_thread.c:240:13
54: #15 0x7f5e40d13608 in start_thread
(/lib/x86_64-linux-gnu/libpthread.so.0+0x9608)
{noformat}
https://github.com/apache/qpid-dispatch/pull/1050/checks?check_run_id=2343920572#step:9:6516
{noformat}
72: ==4323==ERROR: LeakSanitizer: detected memory leaks
72:
72: Direct leak of 64 byte(s) in 1 object(s) allocated from:
72: #0 0x7f2b6c99faa5 in posix_memalign
(/lib/x86_64-linux-gnu/libasan.so.5+0x10eaa5)
72: #1 0x7f2b6c1784d4 in sys_mutex ../src/posix/threading.c:43
72: #2 0x7f2b6c133ee6 in qd_message ../src/message.c:1017
72: #3 0x7f2b6c0887e4 in handle_incoming_impl
../src/adaptors/tcp_adaptor.c:249
72: #4 0x7f2b6c1af7ba in qdr_connection_process
../src/router_core/connections.c:421
72: #5 0x7f2b6c08d931 in handle_connection_event
../src/adaptors/tcp_adaptor.c:683
72: #6 0x7f2b6c2b4dc5 in handle_event_with_context ../src/server.c:804
72: #7 0x7f2b6c2b4dc5 in do_handle_raw_connection_event ../src/server.c:810
72: #8 0x7f2b6c2b4dc5 in handle ../src/server.c:1090
72: #9 0x7f2b6c2bd2f5 in thread_run ../src/server.c:1122
72: #10 0x7f2b6bb47608 in start_thread
(/lib/x86_64-linux-gnu/libpthread.so.0+0x9608)
{noformat}
https://github.com/apache/qpid-dispatch/pull/1050/checks?check_run_id=2343920542#step:9:1408
{noformat}
25: ==2309==ERROR: LeakSanitizer: detected memory leaks
25:
25: Direct leak of 64 byte(s) in 1 object(s) allocated from:
25: #0 0x7fee688ffaa5 in posix_memalign
(/lib/x86_64-linux-gnu/libasan.so.5+0x10eaa5)
25: #1 0x7fee680d84d4 in sys_mutex ../src/posix/threading.c:43
25: #2 0x7fee68093ee6 in qd_message ../src/message.c:1017
25: #3 0x7fee680ad38c in qd_message_receive ../src/message.c:1462
25: #4 0x7fee6820473e in AMQP_rx_handler ../src/router_node.c:455
25: #5 0x7fee68068406 in do_receive ../src/container.c:227
25: #6 0x7fee68068406 in qd_container_handle_event ../src/container.c:737
25: #7 0x7fee68214d19 in handle ../src/server.c:1097
25: #8 0x7fee6821d260 in thread_run ../src/server.c:1122
25: #9 0x7fee6821f7fa in qd_server_run ../src/server.c:1487
25: #10 0x5577eabb51bc in main_process ../router/src/main.c:115
25: #11 0x5577eabb4ce0 in main ../router/src/main.c:369
25: #12 0x7fee66f660b2 in __libc_start_main
(/lib/x86_64-linux-gnu/libc.so.6+0x270b2)
{noformat}
https://github.com/apache/qpid-dispatch/pull/1050/checks?check_run_id=2343920572#step:9:3704
{noformat}
54: ==3486==ERROR: LeakSanitizer: detected memory leaks
54:
54: Direct leak of 64 byte(s) in 1 object(s) allocated from:
54: #0 0x7fdde5fe1aa5 in posix_memalign
(/lib/x86_64-linux-gnu/libasan.so.5+0x10eaa5)
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306244#comment-17306244
]
Jiri Daněk commented on DISPATCH-1844:
--
bq. can I re-assign is Jira to you?
[~kgiusti] Not sure. WDYT about the PR that is moving things around? Is that a
viable start? I don't know dispatch well enough to just start refactoring
things...
My interest in resolving this is that I need dispatch to be able to do a clean
shutdown like this because other leak issues depend on it: e.g. the IoAdapter
leak from Python needs this leak resolved, otherwise all Python objects won't
be GCd (if I remember the situation correctly, its already a month old in my
head).
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Labels: lsan
> Fix For: 1.16.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306232#comment-17306232
]
Ken Giusti commented on DISPATCH-1844:
--
[~jdanek] can I re-assign is Jira to you?
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Labels: lsan
> Fix For: 1.16.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305406#comment-17305406
]
ASF GitHub Bot commented on DISPATCH-1844:
--
jiridanek commented on pull request #1050:
URL: https://github.com/apache/qpid-dispatch/pull/1050#issuecomment-803295321
I've updated https://issues.apache.org/jira/browse/DISPATCH-1844 with a note
that leak is still manifesting when running system_tests_http2. I will close
the PR if I can't update it to fix the leak.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Fix For: 1.16.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305405#comment-17305405
]
Jiri Daněk commented on DISPATCH-1844:
--
This now happens every time in system_tests_http2. The leak is currently
suppressed in {{lsan.supp}}.
{noformat}
69: test_zzz_http_connector_delete
(system_tests_http2.Http2TestEdgeToEdgeViaInteriorRouter) ... ok
69:
69: Router EDGE.A debug dump file:
69:
69: alloc.c: Items of type 'qd_iterator_t' remain allocated at shutdown: 9
(SUPPRESSED)
69: alloc.c: Items of type 'qd_timer_t' remain allocated at shutdown: 1
(SUPPRESSED)
69: alloc.c: Items of type 'qd_buffer_t' remain allocated at shutdown: 3
(SUPPRESSED)
69: alloc.c: Items of type 'qd_connector_t' remain allocated at shutdown: 1
(SUPPRESSED)
69: alloc.c: Items of type 'qd_message_t' remain allocated at shutdown: 3
(SUPPRESSED)
69: alloc.c: Items of type 'qd_message_content_t' remain allocated at shutdown:
2 (SUPPRESSED)
69: alloc.c: Items of type 'qdr_delivery_t' remain allocated at shutdown: 3
(SUPPRESSED)
69: alloc.c: Items of type 'qd_link_ref_t' remain allocated at shutdown: 1
(SUPPRESSED)
69: alloc.c: Items of type 'qd_parsed_field_t' remain allocated at shutdown: 4
(SUPPRESSED)
69:
69:
69:
69: Router EDGE.A output file:
69:
69: ../src/router_core/core_link_endpoint.c:143:25: runtime error: store to
misaligned address 0x616000137e9c for type 'uint64_t', which requires 8 byte
alignment
69: 0x616000137e9c: note: pointer points here
69: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00
69: ^
69: ../src/router_core/core_link_endpoint.c:124:24: runtime error: store to
misaligned address 0x616000137e9c for type 'uint64_t', which requires 8 byte
alignment
69: 0x616000137e9c: note: pointer points here
69: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00
69: ^
69:
69: =
69: ==3569==ERROR: LeakSanitizer: detected memory leaks
69:
69: Direct leak of 64 byte(s) in 1 object(s) allocated from:
69: #0 0x7f73f8dedaa5 in posix_memalign
(/lib/x86_64-linux-gnu/libasan.so.5+0x10eaa5)
69: #1 0x7f73f85c6754 in sys_mutex ../src/posix/threading.c:41
69: #2 0x7f73f8581f27 in qd_message ../src/message.c:1012
69: #3 0x7f73f8732f7f in create_http2_stream_data
../src/adaptors/http2/http2_adaptor.c:408
69: #4 0x7f73f8733d58 in on_begin_headers_callback
../src/adaptors/http2/http2_adaptor.c:632
69: #5 0x7f73f6a83af1 (/lib/x86_64-linux-gnu/libnghttp2.so.14+0xbaf1)
69:
69: Direct leak of 64 byte(s) in 1 object(s) allocated from:
69: #0 0x7f6a26c66aa5 in posix_memalign
(/lib/x86_64-linux-gnu/libasan.so.5+0x10eaa5)
69: #1 0x7f6a2643f754 in sys_mutex ../src/posix/threading.c:41
69: #2 0x7f6a263faf27 in qd_message ../src/message.c:1012
69: #3 0x7f6a265abf7f in create_http2_stream_data
../src/adaptors/http2/http2_adaptor.c:408
69: #4 0x7f6a265c97b0 in qdr_http_deliver
../src/adaptors/http2/http2_adaptor.c:1888
69: #5 0x7f6a2651ce76 in qdr_link_process_deliveries
../src/router_core/transfer.c:175
69: #6 0x7f6a26475cf1 in qdr_connection_process
../src/router_core/connections.c:412
69: #7 0x7f6a265caab0 in handle_connection_event
../src/adaptors/http2/http2_adaptor.c:2398
69: #8 0x7f6a2657c1b5 in handle_event_with_context ../src/server.c:804
69: #9 0x7f6a2657c1b5 in do_handle_raw_connection_event ../src/server.c:810
69: #10 0x7f6a2657c1b5 in handle ../src/server.c:1090
69: #11 0x7f6a265846e5 in thread_run ../src/server.c:1122
69: #12 0x7f6a25e0e608 in start_thread
(/lib/x86_64-linux-gnu/libpthread.so.0+0x9608)
69:
69: -
69: Suppressions used:
69: count bytes template
69: 7465 qd_dispatch_configure_connector
69: 7 65 load_server_config
69: 1 64 qd_message_receive
69: 1 24 ^pn_condition$
69: 1 1536 ^pn_raw_connection$
69: 1 56 qdr_core_subscribe
69: 12 6656 ^_PyObject_Realloc
69: 588 893426 ^PyObject_Malloc$
69: 1 32 ^PyThread_allocate_lock$
69: 4 9897 ^PyMem_Malloc$
69: 1856 ^_PyObject_GC_Resize$
69: 1848 ^list_resize$
69: 5248 ^pn_object_new$
69: 1128 ^pn_list$
69: 2 48 ^pni_record_create$
69: -
69:
69: SUMMARY: AddressSanitizer: 64 byte(s) leaked in 1 allocation(s).
{noformat}
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project:
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304267#comment-17304267
]
ASF GitHub Bot commented on DISPATCH-1844:
--
jiridanek commented on a change in pull request #1050:
URL: https://github.com/apache/qpid-dispatch/pull/1050#discussion_r597046371
##
File path: cmake/RuntimeChecks.cmake
##
@@ -106,9 +106,17 @@ elseif(RUNTIME_CHECK STREQUAL "asan")
message(FATAL_ERROR "libubsan not installed - address sanitizer not
available")
endif(UBSAN_LIBRARY-NOTFOUND)
message(STATUS "Runtime memory checker: gcc/clang address sanitizers")
+ option(SANITIZE_3RD_PARTY "Detect leaks in 3rd party libraries used by
Dispatch while running tests" OFF)
+ file (COPY "${CMAKE_SOURCE_DIR}/tests/lsan.supp" DESTINATION
"${CMAKE_BINARY_DIR}/tests")
+ if (NOT SANITIZE_3RD_PARTY)
+# Append wholesale library suppressions
+# this is necessary if target system does not have debug symbols for
these libraries installed
+# and therefore the more specific suppressions do not match
+file(APPEND "${CMAKE_BINARY_DIR}/tests/lsan.supp"
"\nleak:/libpython2.*.so\nleak:/libpython3.*.so\n")
+ endif ()
set(SANITIZE_FLAGS "-g -fno-omit-frame-pointer -fsanitize=address,undefined")
set(RUNTIME_ASAN_ENV_OPTIONS "detect_leaks=true
suppressions=${CMAKE_SOURCE_DIR}/tests/asan.supp")
- set(RUNTIME_LSAN_ENV_OPTIONS
"suppressions=${CMAKE_SOURCE_DIR}/tests/lsan.supp")
+ set(RUNTIME_LSAN_ENV_OPTIONS
"suppressions=${CMAKE_BINARY_DIR}/tests/lsan.supp")
Review comment:
Problem is, in the PR it is done the wrong way. CMake only copies the
files when you run cmake to configure the build. If you later change the source
file and rebuild, the copy won't be updated. I have to use `configure_file` in
cmake to achieve that update, as Ganesh pointed out in the main (not-WIP) PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Fix For: 1.16.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292945#comment-17292945
]
ASF GitHub Bot commented on DISPATCH-1844:
--
jiridanek commented on pull request #1050:
URL: https://github.com/apache/qpid-dispatch/pull/1050#issuecomment-788023043
@ChugR Thanks for having a look, but at this point, this and the other
leak-fixing issues are not ready to be reviewed. I need to get in
https://github.com/apache/qpid-dispatch/pull/1048 first, which will spell out
all the suppressions.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Fix For: 1.16.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292934#comment-17292934
]
ASF GitHub Bot commented on DISPATCH-1844:
--
ChugR commented on pull request #1050:
URL: https://github.com/apache/qpid-dispatch/pull/1050#issuecomment-788015068
+0 This patch looks fine to be but I have no experience in the issues that
it is addressing.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Fix For: 1.16.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292931#comment-17292931
]
ASF GitHub Bot commented on DISPATCH-1844:
--
ChugR commented on a change in pull request #1050:
URL: https://github.com/apache/qpid-dispatch/pull/1050#discussion_r584780043
##
File path: cmake/RuntimeChecks.cmake
##
@@ -106,9 +106,17 @@ elseif(RUNTIME_CHECK STREQUAL "asan")
message(FATAL_ERROR "libubsan not installed - address sanitizer not
available")
endif(UBSAN_LIBRARY-NOTFOUND)
message(STATUS "Runtime memory checker: gcc/clang address sanitizers")
+ option(SANITIZE_3RD_PARTY "Detect leaks in 3rd party libraries used by
Dispatch while running tests" OFF)
+ file (COPY "${CMAKE_SOURCE_DIR}/tests/lsan.supp" DESTINATION
"${CMAKE_BINARY_DIR}/tests")
+ if (NOT SANITIZE_3RD_PARTY)
+# Append wholesale library suppressions
+# this is necessary if target system does not have debug symbols for
these libraries installed
+# and therefore the more specific suppressions do not match
+file(APPEND "${CMAKE_BINARY_DIR}/tests/lsan.supp"
"\nleak:/libpython2.*.so\nleak:/libpython3.*.so\n")
+ endif ()
set(SANITIZE_FLAGS "-g -fno-omit-frame-pointer -fsanitize=address,undefined")
set(RUNTIME_ASAN_ENV_OPTIONS "detect_leaks=true
suppressions=${CMAKE_SOURCE_DIR}/tests/asan.supp")
- set(RUNTIME_LSAN_ENV_OPTIONS
"suppressions=${CMAKE_SOURCE_DIR}/tests/lsan.supp")
+ set(RUNTIME_LSAN_ENV_OPTIONS
"suppressions=${CMAKE_BINARY_DIR}/tests/lsan.supp")
Review comment:
Copying lsan.supp to BINARY_DIR is a good idea regardless of the rest of
this PR. The self tests use SOURCE_DIR and BINARY_DIR in a mixed and confusing
manner, like configuring system_tests_handle_failover.py.in back in to
SOURCE_DIR, but that's the topic for another jira.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Fix For: 1.16.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[ https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287788#comment-17287788 ] ASF GitHub Bot commented on DISPATCH-1844: -- jiridanek opened a new pull request #1050: URL: https://github.com/apache/qpid-dispatch/pull/1050 ``` 69: ../src/router_core/core_link_endpoint.c:124:24: runtime error: store to misaligned address 0x616000147d9c for type 'uint64_t', which requires 8 byte alignment 69: 0x616000147d9c: note: pointer points here 69: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 69: ^ 69: 69: = 69: ==3434==ERROR: LeakSanitizer: detected memory leaks 69: 69: Direct leak of 64 byte(s) in 1 object(s) allocated from: 69: #0 0x7f9b999adaa5 in posix_memalign (/lib/x86_64-linux-gnu/libasan.so.5+0x10eaa5) 69: #1 0x7f9b991917f4 in sys_mutex ../src/posix/threading.c:41 69: #2 0x7f9b9914e927 in qd_message ../src/message.c:1012 69: #3 0x7f9b992fdbbf in create_http2_stream_data ../src/adaptors/http2/http2_adaptor.c:399 69: #4 0x7f9b993197f0 in qdr_http_deliver ../src/adaptors/http2/http2_adaptor.c:1816 69: #5 0x7f9b9926e866 in qdr_link_process_deliveries ../src/router_core/transfer.c:175 69: #6 0x7f9b991c7d91 in qdr_connection_process ../src/router_core/connections.c:412 69: #7 0x7f9b9931ab70 in handle_connection_event ../src/adaptors/http2/http2_adaptor.c:2293 69: #8 0x7f9b992ce085 in handle_event_with_context ../src/server.c:804 69: #9 0x7f9b992ce085 in do_handle_raw_connection_event ../src/server.c:810 69: #10 0x7f9b992ce085 in handle ../src/server.c:1090 69: #11 0x7f9b992d65b5 in thread_run ../src/server.c:1122 69: #12 0x7f9b992d8aca in qd_server_run ../src/server.c:1484 69: #13 0x55c9b5e061bc in main_process ../router/src/main.c:113 69: #14 0x55c9b5e05ce0 in main ../router/src/main.c:367 69: #15 0x7f9b9802a0b2 in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x270b2) 69: 69: - 69: Suppressions used: 69: count bytes template 69: 7465 qd_dispatch_configure_connector 69: 7 65 load_server_config 69: 1 64 qd_message_receive 69: 1 24 ^pn_condition$ 69: 1 1536 ^pn_raw_connection$ 69: 1 56 qdr_core_subscribe 69: 10 5656 ^_PyObject_Realloc 69: 541 863651 ^PyObject_Malloc$ 69: 1 32 ^PyThread_allocate_lock$ 69: 4 9897 ^PyMem_Malloc$ 69: 1856 ^_PyObject_GC_Resize$ 69: 5248 ^pn_object_new$ 69: 1128 ^pn_list$ 69: 2 48 ^pni_record_create$ 69: - 69: 69: SUMMARY: AddressSanitizer: 64 byte(s) leaked in 1 allocation(s). 69: 69: 69: 69: Router EDGE.A command file: 69: 69: qdrouterd -c edge-router.conf -I /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/python 69: pid=3434 ``` ``` 69: 0x616000147d9c: note: pointer points here 69: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 69: ^ 69: 69: = 69: ==3434==ERROR: LeakSanitizer: detected memory leaks 69: 69: Direct leak of 64 byte(s) in 1 object(s) allocated from: 69: #0 0x7f9b999adaa5 in posix_memalign (/lib/x86_64-linux-gnu/libasan.so.5+0x10eaa5) 69: #1 0x7f9b991917f4 in sys_mutex ../src/posix/threading.c:41 69: #2 0x7f9b9914e927 in qd_message ../src/message.c:1012 69: #3 0x7f9b992fdbbf in create_http2_stream_data ../src/adaptors/http2/http2_adaptor.c:399 69: #4 0x7f9b993197f0 in qdr_http_deliver ../src/adaptors/http2/http2_adaptor.c:1816 69: #5 0x7f9b9926e866 in qdr_link_process_deliveries ../src/router_core/transfer.c:175 69: #6 0x7f9b991c7d91 in qdr_connection_process ../src/router_core/connections.c:412 69: #7 0x7f9b9931ab70 in handle_connection_event ../src/adaptors/http2/http2_adaptor.c:2293 69: #8 0x7f9b992ce085 in handle_event_with_context ../src/server.c:804 69: #9 0x7f9b992ce085 in do_handle_raw_connection_event ../src/server.c:810 69: #10 0x7f9b992ce085 in handle ../src/server.c:1090 69: #11 0x7f9b992d65b5 in thread_run ../src/server.c:1122 69: #12 0x7f9b992d8aca in qd_server_run ../src/server.c:1484 69: #13 0x55c9b5e061bc in main_process ../router/src/main.c:113 69: #14 0x55c9b5e05ce0 in main ../router/src/main.c:367 69: #15 0x7f9b9802a0b2 in __libc_start_main
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234720#comment-17234720
]
ASF subversion and git services commented on DISPATCH-1844:
---
Commit 3902a534d4a473e55f737d04b1998b31185a0367 in qpid-dispatch's branch
refs/heads/dev-protocol-adaptors-2 from Ken Giusti
[ https://gitbox.apache.org/repos/asf?p=qpid-dispatch.git;h=3902a53 ]
DISPATCH-1844: suppress leaks of sys_mutex (shutdown leak)
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Fix For: 1.15.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234721#comment-17234721
]
ASF GitHub Bot commented on DISPATCH-1844:
--
asfgit merged pull request #916:
URL: https://github.com/apache/qpid-dispatch/pull/916
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Fix For: 1.15.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (DISPATCH-1844) sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
[
https://issues.apache.org/jira/browse/DISPATCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234668#comment-17234668
]
ASF GitHub Bot commented on DISPATCH-1844:
--
kgiusti opened a new pull request #916:
URL: https://github.com/apache/qpid-dispatch/pull/916
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> sys_mutex leak detected by LeakSanitizer ASAN (shutdown)
>
>
> Key: DISPATCH-1844
> URL: https://issues.apache.org/jira/browse/DISPATCH-1844
> Project: Qpid Dispatch
> Issue Type: Bug
> Components: Router Node
>Affects Versions: 1.14.0
>Reporter: Ken Giusti
>Assignee: Ken Giusti
>Priority: Major
> Fix For: 1.15.0
>
>
> The LSAN (ASAN) leak sanitizer occasionally detects a leak of sys_mutex items
> that are used by the qd_message_t content:
>
> {quote}70: ==1475684==ERROR: LeakSanitizer: detected memory leaks
> 70:
> 70: Direct leak of 128 byte(s) in 2 object(s) allocated from:
> 70: #0 0x7f52044ebbf5 in __interceptor_posix_memalign
> (/lib64/libasan.so.5+0x10ebf5)
> 70: #1 0x7f5203b7e2cc in sys_mutex
> /home/kgiusti/work/dispatch/qpid-dispatch/src/posix/threading.c:41
> 70: #2 0x7f5203b31b0f in qd_message
> /home/kgiusti/work/dispatch/qpid-dispatch/src/message.c:1012
> 70: #3 0x7f5203a9edae in _server_rx_headers_done_cb
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:862
>
> 70: #4 0x7f5203a64d2a in process_headers_done
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:831
>
> 70: #5 0x7f5203a66411 in parse_header
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:911
>
> 70: #6 0x7f5203a6d065 in decode_incoming
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1301
>
> 70: #7 0x7f5203a6e09a in h1_codec_connection_rx_data
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_codec.c:1346
>
> 70: #8 0x7f5203a9a3fe in _handle_connection_events
> /home/kgiusti/work/dispatch/qpid-dispatch/src/adaptors/http1/http1_server.c:562
>
> 70: #9 0x7f5203ceb754 in handle_event_with_context
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:804
> 70: #10 0x7f5203ceb796 in do_handle_raw_connection_event
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:810
> 70: #11 0x7f5203ceffe5 in handle
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1090
> 70: #12 0x7f5203cf0297 in thread_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1122
> 70: #13 0x7f5203cf770f in qd_server_run
> /home/kgiusti/work/dispatch/qpid-dispatch/src/server.c:1484
> 70: #14 0x4026f8 in main_process
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:113
> 70: #15 0x404576 in main
> /home/kgiusti/work/dispatch/qpid-dispatch/router/src/main.c:367
> 70: #16 0x7f52025761a2 in __libc_start_main (/lib64/libc.so.6+0x271a2)
> {quote}
> This leak is easily triggered by the HTTP1 adaptor but can also be triggered
> using plain AMQP.
> This is a shutdown leak. This occurs when a qdr_delivery_t is left on the
> link's updated_deliveries list at the point where the shutdown occurs.
> Since this is a shutdown leak I will add a suppression to the lsan.supp list
> for now - this Jira remains open until the issue is actually fixed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
