pvardanis commented on issue #34607: URL: https://github.com/apache/arrow/issues/34607#issuecomment-1966764855
Ok posting actual times here so we're all on the same page, thanks for the follow-up in any case. **Summary** I have a `do_exchange` endpoint on my flight server with a 20s sleep on purpose just for benchmarking purposes. I'm sending 10 requests in two ways and comparing: - using the same `FlightClient` and sending 10 requests sequentially in a for loop: 200.04s - using 10 `FlightClient` instances and sending concurrently using `asyncio` as seen [here](https://github.com/apache/arrow/issues/34607#issuecomment-1966712089): 200.16s I've set the `GRPC_VERBOSITY=DEBUG` and after the server is initialized I see the following: ``` D0227 15:58:33.382416000 7916605440 config.cc:113] gRPC EXPERIMENT tcp_frame_size_tuning OFF (default:OFF) D0227 15:58:33.382428000 7916605440 config.cc:113] gRPC EXPERIMENT tcp_read_chunks OFF (default:OFF) D0227 15:58:33.382430000 7916605440 config.cc:113] gRPC EXPERIMENT tcp_rcv_lowat OFF (default:OFF) D0227 15:58:33.382433000 7916605440 config.cc:113] gRPC EXPERIMENT peer_state_based_framing OFF (default:OFF) D0227 15:58:33.386899000 7916605440 config.cc:113] gRPC EXPERIMENT flow_control_fixes OFF (default:OFF) D0227 15:58:33.386981000 7916605440 config.cc:113] gRPC EXPERIMENT memory_pressure_controller OFF (default:OFF) D0227 15:58:33.386989000 7916605440 config.cc:113] gRPC EXPERIMENT periodic_resource_quota_reclamation OFF (default:OFF) D0227 15:58:33.386995000 7916605440 config.cc:113] gRPC EXPERIMENT unconstrained_max_quota_buffer_size OFF (default:OFF) D0227 15:58:33.387001000 7916605440 config.cc:113] gRPC EXPERIMENT new_hpack_huffman_decoder OFF (default:OFF) D0227 15:58:33.387006000 7916605440 config.cc:113] gRPC EXPERIMENT event_engine_client OFF (default:OFF) D0227 15:58:33.387147000 7916605440 ev_posix.cc:141] Using polling engine: poll D0227 15:58:33.387170000 7916605440 dns_resolver_ares.cc:831] Using ares dns resolver I0227 15:58:33.390538000 7916605440 server_builder.cc:348] Synchronous server. Num CQs: 1, Min pollers: 1, Max Pollers: 2, CQ timeout (msec): 10000 D0227 15:58:33.390578000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "priority_experimental" D0227 15:58:33.390601000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "weighted_target_experimental" D0227 15:58:33.390610000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "pick_first" D0227 15:58:33.390616000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "round_robin" D0227 15:58:33.390622000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "ring_hash_experimental" D0227 15:58:33.390643000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "grpclb" D0227 15:58:33.390674000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "rls_experimental" D0227 15:58:33.394581000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "xds_cluster_manager_experimental" D0227 15:58:33.394607000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "xds_cluster_impl_experimental" D0227 15:58:33.394619000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "cds_experimental" D0227 15:58:33.394635000 7916605440 lb_policy_registry.cc:45] registering LB policy factory for "xds_cluster_resolver_experimental" D0227 15:58:33.394661000 7916605440 certificate_provider_registry.cc:35] registering certificate provider factory for "file_watcher" ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
