[jira] [Commented] (PROTON-2546) Leak of raw connection pn_event
[ https://issues.apache.org/jira/browse/PROTON-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17543547#comment-17543547 ] Jiri Daněk commented on PROTON-2546: And here for Skupper Router CI https://github.com/skupperproject/skupper-router/runs/6639278966?#step:6:233 {noformat} skrouterd: Suppressions used: skrouterd: count bytes template skrouterd: 12 6752 ^pn_raw_connection$ skrouterd: 8192 ^pn_record_def skrouterd: 6366 ^pn_string_grow$ skrouterd: 26 1232 ^pn_object_new$ skrouterd: 249 572750 /libpython3.*.so skrouterd: - {noformat} https://github.com/skupperproject/skupper-router/runs/6639279150?#step:27:1180 {noformat} 53: - 53: Suppressions used: 53: count bytes template 53: 1 56 ^load_server_config$ 53: 1288 ^pni_data_grow$ 53: 2 96 ^pn_buffer$ 53: - {noformat} https://github.com/skupperproject/skupper-router/runs/6639279150?#step:27:1661 {noformat} 53: - 53: Suppressions used: 53: count bytes template 53: 1 56 ^load_server_config$ 53: 1 4608 ^pni_data_grow$ 53: 1 32 ^pn_buffer$ 53: 1256 ^pn_buffer_ensure$ 53: - {noformat} https://github.com/skupperproject/skupper-router/runs/6639279150?#step:27:2443 {noformat} 57: Router TestBadEndpoints output file: 57: 57: - 57: Suppressions used: 57: count bytes template 57: 1 64 ^pgetaddrinfo$ 57: - {noformat} > Leak of raw connection pn_event > --- > > Key: PROTON-2546 > URL: https://issues.apache.org/jira/browse/PROTON-2546 > Project: Qpid Proton > Issue Type: Bug > Components: proton-c >Affects Versions: proton-c-0.38.0 >Reporter: Ken Giusti >Assignee: Andrew Stitcher >Priority: Major > Fix For: proton-c-0.38.0 > > Attachments: proton-2546.conf > > > See: > [https://github.com/skupperproject/skupper-router/issues/469|https://github.com/skupperproject/skupper-router/issues/469?] > This leak appeared on main about five days ago: > https://github.com/skupperproject/skupper-router/runs/6489086985?check_suite_focus=true#step:26:1757 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (PROTON-2546) Leak of raw connection pn_event
[ https://issues.apache.org/jira/browse/PROTON-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17543548#comment-17543548 ] Jiri Daněk commented on PROTON-2546: [~astitcher] so, which suppressions do you want removed next? > Leak of raw connection pn_event > --- > > Key: PROTON-2546 > URL: https://issues.apache.org/jira/browse/PROTON-2546 > Project: Qpid Proton > Issue Type: Bug > Components: proton-c >Affects Versions: proton-c-0.38.0 >Reporter: Ken Giusti >Assignee: Andrew Stitcher >Priority: Major > Fix For: proton-c-0.38.0 > > Attachments: proton-2546.conf > > > See: > [https://github.com/skupperproject/skupper-router/issues/469|https://github.com/skupperproject/skupper-router/issues/469?] > This leak appeared on main about five days ago: > https://github.com/skupperproject/skupper-router/runs/6489086985?check_suite_focus=true#step:26:1757 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (PROTON-2546) Leak of raw connection pn_event
[ https://issues.apache.org/jira/browse/PROTON-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17543545#comment-17543545 ] Jiri Daněk commented on PROTON-2546: I had a look at Travis CI for proton: https://app.travis-ci.com/github/apache/qpid-proton/jobs/571695357#L4867 {noformat} 27: Suppressions used: 27: count bytes template 27: 303 16968 ^pn_data$ 27: 6 1728 ^pni_data_grow$ 27: 34 5728 ^pn_buffer$ 27: 6768 ^pn_buffer_ensure$ 27: 1 16 ^pn_error$ 27: 162 14256 ^pn_list$ 27: 42 21504 ^pni_map_allocate$ 27: 132 4248 ^pni_record_create$ 27: 249 7248 ^pn_stringn$ 27: 23 2340 ^pn_string_grow$ 27: 6 17000 ^pn_transport$ 27: 44 2464 ^pn_ssl_domain$ 27: 14303 ^SWIG_Python_addvarlink$ 27:1848 289124 libcrypto.so 27:11552153387 bin/python3 27: - 27: 27/49 Test #27: python-test .. Passed 32.71 sec {noformat} https://app.travis-ci.com/github/apache/qpid-proton/jobs/571695357#L5094 {noformat} 28: Suppressions used: 28: count bytes template 28: 90 5040 ^pn_data$ 28: 14448 ^pn_buffer$ 28: 2256 ^pn_buffer_ensure$ 28: 24 2112 ^pn_list$ 28: 8 4096 ^pni_map_allocate$ 28: 18720 ^pni_record_create$ 28: 53 1568 ^pn_stringn$ 28: 7668 ^pn_string_grow$ 28: 4224 ^pn_ssl_domain$ 28: 168 26284 libcrypto.so 28: 7581423896 bin/python3 28: - 28: 28/49 Test #28: python-integration-test .. Passed 26.73 sec {noformat} > Leak of raw connection pn_event > --- > > Key: PROTON-2546 > URL: https://issues.apache.org/jira/browse/PROTON-2546 > Project: Qpid Proton > Issue Type: Bug > Components: proton-c >Affects Versions: proton-c-0.38.0 >Reporter: Ken Giusti >Assignee: Andrew Stitcher >Priority: Major > Fix For: proton-c-0.38.0 > > Attachments: proton-2546.conf > > > See: > [https://github.com/skupperproject/skupper-router/issues/469|https://github.com/skupperproject/skupper-router/issues/469?] > This leak appeared on main about five days ago: > https://github.com/skupperproject/skupper-router/runs/6489086985?check_suite_focus=true#step:26:1757 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (PROTON-2546) Leak of raw connection pn_event
[ https://issues.apache.org/jira/browse/PROTON-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17543164#comment-17543164 ] ASF subversion and git services commented on PROTON-2546: - Commit e2fa36f86990a95581363b07bcb0fd498956ce04 in qpid-proton's branch refs/heads/main from Andrew Stitcher [ https://gitbox.apache.org/repos/asf?p=qpid-proton.git;h=e2fa36f86 ] PROTON-2546: Rearrange how raw connection generates events Also Implement a proactor forced cleanup for raw connections to try to limit leaking of events on forced shutdowns. > Leak of raw connection pn_event > --- > > Key: PROTON-2546 > URL: https://issues.apache.org/jira/browse/PROTON-2546 > Project: Qpid Proton > Issue Type: Bug > Components: proton-c >Affects Versions: proton-c-0.38.0 >Reporter: Ken Giusti >Assignee: Andrew Stitcher >Priority: Major > Attachments: proton-2546.conf > > > See: > [https://github.com/skupperproject/skupper-router/issues/469|https://github.com/skupperproject/skupper-router/issues/469?] > This leak appeared on main about five days ago: > https://github.com/skupperproject/skupper-router/runs/6489086985?check_suite_focus=true#step:26:1757 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (PROTON-2546) Leak of raw connection pn_event
[ https://issues.apache.org/jira/browse/PROTON-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541003#comment-17541003 ] Ken Giusti commented on PROTON-2546: How to reproduce: Build skupper-router from the main branch in Debug mode (-DCMAKE_BUILD_TYPE=Debug) with -DRUNTIME_CHECK=asan Set env vars to filter out known leak suppressions (use the correct path to the tests/*.supp files, and the lsan.supp is in BUILD directory!) : export ASAN_OPTIONS="disable_coredump=0 detect_odr_violation=0 strict_string_checks=1 detect_stack_use_after_return=1 check_initialization_order=1 strict_init_order=1 detect_invalid_pointer_pairs=2 suppressions={*}/home/kgiusti/work/skupper/skupper-router/tests/asan.supp{*}" export LSAN_OPTIONS="disable_coredump=0 suppressions={*}/home/kgiusti/work/skupper/skupper-router/BUILD/tests/lsan.supp{*}" Run the skupper router against the attached config file: skrouterd proton-2546.conf & In a separate window, run curl against the router "curl http://127.0.0.1:8000; while curl is running, kill the router: $ kill That should trigger a leak of the pn_raw_connection. > Leak of raw connection pn_event > --- > > Key: PROTON-2546 > URL: https://issues.apache.org/jira/browse/PROTON-2546 > Project: Qpid Proton > Issue Type: Bug > Components: proton-c >Affects Versions: proton-c-0.38.0 >Reporter: Ken Giusti >Assignee: Andrew Stitcher >Priority: Major > Attachments: proton-2546.conf > > > See: > [https://github.com/skupperproject/skupper-router/issues/469|https://github.com/skupperproject/skupper-router/issues/469?] > This leak appeared on main about five days ago: > https://github.com/skupperproject/skupper-router/runs/6489086985?check_suite_focus=true#step:26:1757 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org For additional commands, e-mail: dev-h...@qpid.apache.org
[jira] [Commented] (PROTON-2546) Leak of raw connection pn_event
[ https://issues.apache.org/jira/browse/PROTON-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540999#comment-17540999 ] Ken Giusti commented on PROTON-2546: I've been debugging this a bit and think that the pn_raw_connection is being leaked. - Suppressions used: count bytes template *2 3072 ^pn_raw_connection$* 6 384 sys_mutex 390 408014 /libpython3.*.so - SUMMARY: AddressSanitizer: 896 byte(s) leaked in 18 allocation(s). I can reproduce these leaks by shutting down the skupper-router while there is at least one active pn_raw_connection. I shut down the router by sending a SIGTERM to it via kill. In this case the router does not attempt to call pn_raw_connection_close() and wait for the disconnect. Instead the shutdown code calls pn_proactor_free() and expects any outstanding raw connection memory to be freed by that. Is this assumption correct? If no raw connections are present at shutdown these leaks do not occur. > Leak of raw connection pn_event > --- > > Key: PROTON-2546 > URL: https://issues.apache.org/jira/browse/PROTON-2546 > Project: Qpid Proton > Issue Type: Bug > Components: proton-c >Affects Versions: proton-c-0.38.0 >Reporter: Ken Giusti >Assignee: Andrew Stitcher >Priority: Major > > See: > [https://github.com/skupperproject/skupper-router/issues/469|https://github.com/skupperproject/skupper-router/issues/469?] > This leak appeared on main about five days ago: > https://github.com/skupperproject/skupper-router/runs/6489086985?check_suite_focus=true#step:26:1757 > > -- This message was sent by Atlassian Jira (v8.20.7#820007) - To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org For additional commands, e-mail: dev-h...@qpid.apache.org