lidavidm commented on PR #35603: URL: https://github.com/apache/arrow/pull/35603#issuecomment-1549928769
That's not the right thread to focus on then. If most of the time is spent waiting for `take`, that means gRPC isn't populating the queue fast enough, i.e. it seems most of the time is actually waiting for data transfer. (Or possibly we're being slow at processing messages from gRPC, which is FlightStream.Observer#onNext.) And so then I'd be curious about things like, what is the bandwidth the client is getting? What is the max theoretical bandwidth, what is the observed bandwidth in a synthetic benchmark (like iperf3)? 4%, without further qualification, could still be in the realm of natural variation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
