[
https://issues.apache.org/jira/browse/DISPATCH-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17378129#comment-17378129
]
Jiri Daněk commented on DISPATCH-2084:
--------------------------------------
This has happened again, this time on Fedora Linux
https://github.com/apache/qpid-dispatch/pull/1289/checks?check_run_id=3029606646#step:25:837
{noformat}
17: ::RouterTest::test_29_fast_teardown_test PASSED
17: Router EA1 output file:
17: >>>>
17: ERROR: Aborted due to unexpected alloc pool leak of type 'qdr_terminus_t'
17:
17: <<<<
17:
17: Router EA1 debug dump file:
17: >>>>
17: alloc.c: Items of type 'qd_iterator_t' remain allocated at shutdown: 1
(SUPPRESSED)
17: alloc.c: Items of type 'qdr_field_t' remain allocated at shutdown: 1
(SUPPRESSED)
17: alloc.c: Items of type 'qd_buffer_t' remain allocated at shutdown: 1
(SUPPRESSED)
17: alloc.c: Items of type 'qdr_terminus_t' remain allocated at shutdown: 2
17: Leak: 2021-07-09 13:52:12.385179 +0000 type: qdr_terminus_t address:
0x7b4000080090
17: /lib64/libtsan.so.0(backtrace+0xdb) [0x7f9e451551cb]
17: qdrouterd(qd_alloc+0xfd) [0x44c0dd]
17: qdrouterd(qdr_terminus+0x37) [0x4c2117]
17: qdrouterd() [0x4d87fc]
17: qdrouterd(qd_container_handle_event+0x371) [0x463b41]
17: qdrouterd() [0x4e1952]
17: qdrouterd() [0x4e3c0c]
17: qdrouterd() [0x48665e]qdr_terminus_t
17: /lib64/libtsan.so.0(+0x2f550) [0x7f9e45145550]
17: /lib64/libpthread.so.0(+0x9299) [0x7f9e4508c299]
17:
17: Leak: 2021-07-09 13:52:12.385198 +0000 type: qdr_terminus_t address:
0x7b4000077f90
17: /lib64/libtsan.so.0(backtrace+0xdb) [0x7f9e451551cb]
17: qdrouterd(qd_alloc+0xfd) [0x44c0dd]
17: qdrouterd(qdr_terminus+0x37) [0x4c2117]
17: qdrouterd() [0x4d880f]
17: qdrouterd(qd_container_handle_event+0x371) [0x463b41]
17: qdrouterd() [0x4e1952]
17: qdrouterd() [0x4e3c0c]
17: qdrouterd() [0x48665e]
17: /lib64/libtsan.so.0(+0x2f550) [0x7f9e45145550]
17: /lib64/libpthread.so.0(+0x9299) [0x7f9e4508c299]
17:
17:
17: <<<<
17:
17: Router EA1 output file:
17: >>>>
17: ERROR: Aborted due to unexpected alloc pool leak of type 'qdr_terminus_t'
17:
17: <<<<
17:
17: Router EA1 command file:
17: >>>>
17: qdrouterd -c EA1.conf -I
/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/python
17: pid=1743
17:
17: <<<<
17:
17: Router EA1 log file tail:
17: >>>>
17: 2021-07-09 13:57:13.650347 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery created qdr_link_deliver_to_routed_link
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/transfer.c:130)
17: 2021-07-09 13:57:13.650405 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery incref: rc:1 qdr_link_deliver_to_routed_link - newly created
delivery, add to action list
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:115)
17: 2021-07-09 13:57:13.650455 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery incref: rc:2 qdr_link_deliver_to_routed_link - protect returned
value
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:115)
17: 2021-07-09 13:57:13.650513 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery incref: rc:3 referenced by a pn_delivery
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:115)
17: 2021-07-09 13:57:13.650570 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery decref: rc:2 release protection of return from
deliver_to_routed_link
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:149)
17: 2021-07-09 13:57:13.650629 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery incref: rc:3 qdr_delivery_update_disposition - add to action list
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:115)
17: 2021-07-09 13:57:13.650682 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery decref: rc:2 removed reference from pn_delivery
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:149)
17: 2021-07-09 13:57:13.650836 +0000 ROUTER_CORE (trace) Core action
'link_flow'
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:238)
17: 2021-07-09 13:57:13.650893 +0000 ROUTER_CORE (trace) Core client sender
flow granted c=0x7b4800025e90 credit=32 d=F
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:440)
17: 2021-07-09 13:57:13.650944 +0000 ROUTER_CORE (trace) Core action
'link_deliver'
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:238)
17: 2021-07-09 13:57:13.650992 +0000 ROUTER_CORE (trace) Core client received
msg c=0x7b4800025e90 complete=T
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:514)
17: 2021-07-09 13:57:13.651083 +0000 ROUTER_CORE (trace) Core client received
msg c=0x7b4800025e90 rc=0x7b4000043f90 cid=client-0000000060e855b92d08d29a
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:531)
17: 2021-07-09 13:57:13.651213 +0000 ROUTER_CORE (debug) [C19][L43][D81]
Delivery decref_CT: rc:0 core client send request
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:640)
17: 2021-07-09 13:57:13.651276 +0000 ROUTER_CORE (debug) [C19][L43][D81]
Delivery outcome pre-settled: is unknown (0x0)
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:392)
17: 2021-07-09 13:57:13.651333 +0000 ROUTER_CORE (trace) Freeing core client
request c=0x7b4800025e90, rc=0x7b4000043f90 (request complete)
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:366)
17: 2021-07-09 13:57:13.651383 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery incref: rc:3 qdr_delivery_push_CT - add to updated list
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:115)
17: 2021-07-09 13:57:13.651460 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery decref_CT: rc:2 qdrc_endpoint_settle_CT - no longer held by endpoint
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:640)
17: 2021-07-09 13:57:13.651540 +0000 ROUTER_CORE (trace) Core action
'update_delivery'
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:238)
17: 2021-07-09 13:57:13.651587 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery decref_CT: rc:1 qdr_update_delivery_CT - remove from action
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:640)
17: 2021-07-09 13:57:13.651705 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery decref: rc:0 qdr_connection_process - remove from updated list
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:149)
17: 2021-07-09 13:57:13.651869 +0000 PROTOCOL (trace) [C19]:FRAME: 1 ->
@flow(19) [next-incoming-id=19, incoming-window=2147483647,
next-outgoing-id=19, outgoing-window=2147483647, handle=4, delivery-count=3,
link-credit=250, drain=false]
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:111)
17: 2021-07-09 13:57:13.652320 +0000 ROUTER_CORE (trace) Core action
'qdr_connection_process - remove from updated list'
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:238)
17: 2021-07-09 13:57:13.652407 +0000 ROUTER_CORE (debug) [C19][L44][D82]
Delivery outcome pre-settled: is unknown (0x0)
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/delivery.c:392)
17: 2021-07-09 13:57:13.750440 +0000 ROUTER_CORE (trace) Core action
'process_tick'
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:238)
17: 2021-07-09 13:57:13.824537 +0000 SERVER (notice) Shut Down
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1508)
17: 2021-07-09 13:57:13.824666 +0000 HTTP (trace) lws_context_destroy: ctx
0x7b8c00003800
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.824756 +0000 HTTP (trace) _lws_state_transition:
system: changed 1 'CONTEXT_CREATED' -> 13 'POLICY_INVALID'
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.824812 +0000 HTTP (trace) lws_destroy_event_pipe
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.824870 +0000 HTTP (trace) lws_pt_destroy: pt destroyed
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.824916 +0000 HTTP (trace) lws_context_destroy2: ctx
0x7b8c00003800
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.824960 +0000 HTTP (trace) 0x7f9e44cf99e0: post vh listl
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.825001 +0000 HTTP (trace) 0x7f9e44cf99e0: post pdl
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.828093 +0000 HTTP (trace) 0x7f9e44cf99e0: baggage
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.828160 +0000 HTTP (trace) 0x7f9e44cf99e0: post dc2
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.831248 +0000 HTTP (trace) lws_context_destroy3: ctx
0x7b8c00003800 freed
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/http-libwebsockets.c:58)
17: 2021-07-09 13:57:13.831448 +0000 CONTAINER (trace) Default node removed
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:852)
17: 2021-07-09 13:57:13.831689 +0000 ROUTER_CORE (info) Router Core thread
exited
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:259)
17: 2021-07-09 13:57:13.831915 +0000 TCP_ADAPTOR (info) Shutting down TCP
protocol adaptor
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/adaptors/tcp_adaptor.c:1760)
17: 2021-07-09 13:57:13.832965 +0000 ROUTER_CORE (trace) Core client sender
detached c=0x7b4800025d10
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:581)
17: 2021-07-09 13:57:13.833042 +0000 ROUTER_CORE (trace) edge mgmt client state
change: uc=(nil) down
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/modules/edge_router/edge_mgmt.c:139)
17: 2021-07-09 13:57:13.833112 +0000 ROUTER_CORE (trace) Core client receiver
detached c=0x7b4800025d10
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:614)
17: 2021-07-09 13:57:13.833171 +0000 ROUTER_CORE (trace) Core client sender
detached c=0x7b4800025e90
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:581)
17: 2021-07-09 13:57:13.833229 +0000 ROUTER_CORE (trace) Core client receiver
detached c=0x7b4800025e90
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:614)
17: 2021-07-09 13:57:13.833282 +0000 ROUTER_CORE (info) Finalizing core module:
streaming_link_scrubber
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:138)
17: 2021-07-09 13:57:13.833341 +0000 ROUTER_CORE (info) Finalizing core module:
stuck_delivery_detection
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:138)
17: 2021-07-09 13:57:13.833388 +0000 ROUTER_CORE (info) Finalizing core module:
address_lookup_client
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:138)
17: 2021-07-09 13:57:13.833441 +0000 ROUTER_CORE (trace) Core client freed
c=0x7b4800025e90
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:224)
17: 2021-07-09 13:57:13.833503 +0000 ROUTER_CORE (info) Finalizing core module:
edge_router
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core_thread.c:138)
17: 2021-07-09 13:57:13.833571 +0000 ROUTER_CORE (trace) Core client freed
c=0x7b4800025d10
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/core_client_api.c:224)
17: 2021-07-09 13:57:13.833845 +0000 SERVER (info) [C19] Closing connection on
shutdown
(/home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1388)
17:
17: <<<<
17:
17: ::RouterTest::test_29_fast_teardown_test ERROR
{noformat}
> [macOS] Leak of qdr_terminus_t in system_tests_link_route_credit
> ----------------------------------------------------------------
>
> Key: DISPATCH-2084
> URL: https://issues.apache.org/jira/browse/DISPATCH-2084
> Project: Qpid Dispatch
> Issue Type: Test
> Affects Versions: 1.16.0
> Reporter: Jiri Daněk
> Priority: Major
> Labels: macOS
> Fix For: 1.17.0
>
>
> https://travis-ci.com/github/apache/qpid-dispatch/jobs/501204452#L2718
> {noformat}
> 16: Leak: 2021-04-26 18:52:24.682533 +0000 type: qdr_terminus_t address:
> 0x6120000b91d0
> 16: 0 libqpid-dispatch.dylib 0x000000010ebd8ca0 qd_alloc + 4240
> 16: 1 libqpid-dispatch.dylib 0x000000010eddb99c qdr_terminus +
> 44
> 16: 2 libqpid-dispatch.dylib 0x000000010ee4f68b
> AMQP_outgoing_link_handler + 251
> 16: 3 libqpid-dispatch.dylib 0x000000010ee6e7c7 handle + 455
> 16: 4 libqpid-dispatch.dylib 0x000000010ee673f4 thread_run +
> 340
> 16: 5 libqpid-dispatch.dylib 0x000000010ee66bcb qd_server_run
> + 1291
> 16: 6 qdrouterd 0x000000010eb2596f main_process +
> 191
> 16: 7 qdrouterd 0x000000010eb2427c main + 1260
> 16: 8 libdyld.dylib 0x00007fff7e5a13d5 start + 1
> 16:
> 16: Leak: 2021-04-26 18:52:24.682539 +0000 type: qdr_terminus_t address:
> 0x6120000b9050
> 16: 0 libqpid-dispatch.dylib 0x000000010ebd8ca0 qd_alloc + 4240
> 16: 1 libqpid-dispatch.dylib 0x000000010eddb99c qdr_terminus +
> 44
> 16: 2 libqpid-dispatch.dylib 0x000000010ee4f69f
> AMQP_outgoing_link_handler + 271
> 16: 3 libqpid-dispatch.dylib 0x000000010ee6e7c7 handle + 455
> 16: 4 libqpid-dispatch.dylib 0x000000010ee673f4 thread_run +
> 340
> 16: 5 libqpid-dispatch.dylib 0x000000010ee66bcb qd_server_run
> + 1291
> 16: 6 qdrouterd 0x000000010eb2596f main_process +
> 191
> 16: 7 qdrouterd 0x000000010eb2427c main + 1260
> 16: 8 libdyld.dylib 0x00007fff7e5a13d5 start + 1
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
