[
https://issues.apache.org/jira/browse/ARROW-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17190481#comment-17190481
]
Yibo Cai commented on ARROW-9905:
---------------------------------
Tested with batch size = 2M and 4K. Latency changes as expected, and 4K
significantly hurts throughput.
Interestingly, 2M doesn't improve throughput, actually lower than 128K.
Perf shows most CPU time spent in kernel mode copying data to/from user space.
Too large batch size doesn't help.
!flight-skylake-2M.png|width=890,height=336!
!flight-skylake-4k.png|width=890,height=336!
> [C++][Flight] Evaluate FlightRPC performance
> --------------------------------------------
>
> Key: ARROW-9905
> URL: https://issues.apache.org/jira/browse/ARROW-9905
> Project: Apache Arrow
> Issue Type: Task
> Components: C++, FlightRPC
> Reporter: Yibo Cai
> Assignee: Yibo Cai
> Priority: Major
> Attachments: flight-skylake-2M.png, flight-skylake-4k.png,
> flight-skylake.png
>
>
> We did some benchmmark tests about flight throughput, latency and
> scalability. Would like to share our test results and steps. Comments
> welcomed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
