Abhishek Rawat created IMPALA-15390:
---------------------------------------
Summary: Bypass KRPC for same process local exchanges
Key: IMPALA-15390
URL: https://issues.apache.org/jira/browse/IMPALA-15390
Project: IMPALA
Issue Type: Task
Reporter: Abhishek Rawat
While IMPALA-12430 optimized same-process data exchanges by skipping LZ4
compression, local traffic still pays the overhead of serialization, KRPC
loopback routing, and receiver-side deserialization. We could bypass the KRPC
layer entirely when a data stream sender and receiver reside in the same
{{impalad}} process. By executing a single direct deep copy (seems unavoidable)
of the row batch straight from the sender into the receiver's queue, we can
eliminate all remaining RPC and payload conversion overhead, significantly
reducing execution latency and CPU utilization for local query fragments.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
