[
https://issues.apache.org/jira/browse/DISPATCH-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913305#comment-16913305
]
ASF GitHub Bot commented on DISPATCH-1266:
------------------------------------------
ChugR commented on issue #554: DISPATCH-1266: Fix unsettled multicast forwarding
URL: https://github.com/apache/qpid-dispatch/pull/554#issuecomment-523907220
I ran this with a tortured configuration:
4 interior routers zigzagging between two hosts
8 edge routers: four on each host connecting to all the interiors
Send 1M multicast messages
1 sender
4 receivers: two on each host receiving from an edge on this host and that
host
After 550K messages the setup died. One host was OOM and an interior router
disappeared without crashing. It went defunct. Fortunately one of the interior
routers would still respond to qdstat.
Will run this test again with a simpler configurations to get a reproducer.
```
$ qdstat -g -b taj:21015
Router Statistics
attr value
=================================================
Version 1.9.0-SNAPSHOT
Mode interior
Router Id INTC
Area 0
Link Routes 2
Auto Links 2
Links 10
Nodes 0
Addresses 19
Connections 3
Presettled Count 0
Dropped Presettled Count 0
Accepted Count 555330
Rejected Count 0
Released Count 0
Modified Count 0
Deliveries Delayed > 1sec 0
Deliveries Delayed > 10sec 0
Deliveries to Fallback 0
Ingress Count 1
Egress Count 555329
Transit Count 555329
Deliveries from Route Container 0
Deliveries to Route Container 0
chug@unused apr5> qdstat -m -b taj:21015
Types
type size batch thread-max total
in-threads rebal-in rebal-out
==================================================================================================
_endpoint_ref_t 32 64 128 64 64
0 0
qd_bitmask_t 24 64 128 640 192
8,713 8,720
qd_buffer_t 536 64 128 2,225,472 2,221,504
26,862 26,924
qd_composed_field_t 64 64 128 256 256
0 0
qd_composite_t 112 64 128 320 320
0 0
qd_connection_t 2,360 16 32 80 64
4 5
qd_connector_t 504 64 128 64 64
0 0
qd_hash_handle_t 16 64 128 128 128
0 0
qd_hash_item_t 32 64 128 192 192
0 0
qd_iterator_t 160 64 128 5,004,608 4,998,272
1,130 1,229
qd_link_ref_t 24 64 128 832 384
2,192 2,199
qd_link_t 104 64 128 128 128
0 0
qd_listener_t 440 64 128 64 64
0 0
qd_log_entry_t 2,112 16 32 1,072 1,072
0 0
qd_management_context_t 56 64 128 64 64
0 0
qd_message_content_t 1,080 64 128 556,288 555,456
953 966
qd_message_t 144 64 128 1,112,512 555,584
1,806 10,508
qd_node_t 56 64 128 64 64
0 0
qd_parse_node_t 104 64 128 128 128
0 0
qd_parsed_field_t 88 64 128 2,224,000 2,221,632
45 82
qd_parsed_turbo_t 64 64 128 256 256
0 0
qd_timer_t 56 64 128 128 128
0 0
qdr_action_t 160 64 128 448 128
44,487 44,492
qdr_addr_endpoint_state_t 48 64 128 64 64
0 0
qdr_address_config_t 72 64 128 64 64
0 0
qdr_address_t 376 64 128 64 64
0 0
qdr_auto_link_t 136 64 128 64 64
0 0
qdr_conn_identifier_t 112 64 128 64 64
0 0
qdr_connection_info_t 88 64 128 128 128
0 0
qdr_connection_t 568 64 128 128 128
0 0
qdr_connection_work_t 48 64 128 64 64
0 0
qdr_delivery_cleanup_t 32 64 128 555,712 384
8,732 17,409
qdr_delivery_ref_t 24 64 128 832 384
8,671 8,678
qdr_delivery_t 288 64 128 1,111,104 555,520
78 8,759
qdr_field_t 40 64 128 320 320
950 950
qdr_forward_deliver_info_t 32 64 128 64 64
0 0
qdr_general_work_t 128 64 128 1,728 320
1,412 1,434
qdr_link_ref_t 24 64 128 640 448
6,672 6,675
qdr_link_route_t 112 64 128 64 64
0 0
qdr_link_t 512 64 128 192 192
0 0
qdr_link_work_t 48 64 128 512 448
6,492 6,493
qdr_node_t 64 64 128 64 64
0 0
qdr_query_t 344 64 128 128 128
0 0
qdr_terminus_t 64 64 128 192 192
0 0
qdrc_endpoint_t 24 64 128 64 64
0 0
qdtm_router_t 16 64 128 64 64
0 0
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Improve router's handling of unsettled multicast deliveries
> -----------------------------------------------------------
>
> Key: DISPATCH-1266
> URL: https://issues.apache.org/jira/browse/DISPATCH-1266
> Project: Qpid Dispatch
> Issue Type: Improvement
> Components: Documentation, Management Agent, Routing Engine, Tests
> Affects Versions: 1.5.0
> Reporter: Ken Giusti
> Assignee: Ken Giusti
> Priority: Major
>
> The current implementation of multicast forwarding will immediately settle
> the delivery on ingress to the router and forward the delivery as pre-settled.
> This means the settlement state sent back to the producer provides no
> indication of actual delivery state. And the credit is replenished
> immediately rather than gate on the settlement coming from the consumer.
> Improve this behavior by settling of the inbound delivery after all outbound
> deliveries have settled.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
