Bikas Saha created TEZ-2411:
-------------------------------
Summary: Offload DataMovement event creation from the AM to the
tasks
Key: TEZ-2411
URL: https://issues.apache.org/jira/browse/TEZ-2411
Project: Apache Tez
Issue Type: Task
Reporter: Bikas Saha
Assignee: Bikas Saha
Today the AM creates a new DataMovement event from the original event sent by
the producer task and supplements the new event with source/target indices for
the consumer task. This new event creation can be offloaded to the task runtime
and thus save CPU cycles on the AM for the object creation. Secondly, the
original event can be kept in serialized form inside the AM and sent as is to
the task over the RPC, thus potentially saving serde CPU for these events in
addition to the object creation CPU.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)