[
https://issues.apache.org/jira/browse/IMPALA-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-5441:
----------------------------------
Component/s: Perf Investigation
> Send larger row batches over the wire
> -------------------------------------
>
> Key: IMPALA-5441
> URL: https://issues.apache.org/jira/browse/IMPALA-5441
> Project: IMPALA
> Issue Type: Improvement
> Components: Perf Investigation
> Affects Versions: Impala 2.10.0
> Reporter: Henry Robinson
> Priority: Major
>
> Our on-the-wire row batch size is the same as the in-memory size (1024 rows
> by default). It might make sense to increase the wire-size to reduce the
> RPC-per-row overhead, and decrease context-switching in the receiver.
> KRPC makes it quite natural to do that: each row batch can be serialized as a
> sidecar in memory-size batches. The receiver can then read each batch in turn
> as though it were sent individually, without any need to stitch together (or
> split up) serialized batches.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
