[
https://issues.apache.org/jira/browse/HIVE-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123787#comment-16123787
]
Siddharth Seth edited comment on HIVE-17294 at 8/11/17 6:21 PM:
----------------------------------------------------------------
The endpoint is in the LLAP AM plugin. However, that extends an upstream tez
plugin - so some translation will likely be required. That's an unnecessary
step. Other than time to work on this, another thing to watch out for is the
cost of serializing protobuf, and memory overhead of copying buffers with
protobuf rpc engine.
At the moment, some parts of the system use the ProtobufRpcEngine from Hadoop,
other parts use the WritableRpcEngine (specifically the task to AM
communication).
When I say part of he work is done - it's the representation of various pieces
of information in protobuf.
was (Author: sseth):
The endpoint is in the LLAP AM plugin. However, that extends an upstream tez
plugin - so some translation will likely be required. That's an unnecessary
step. Other than time to work on this, another thing to watch out for is the
cost of serializing protobuf, and memory overhead of copying buffers with
protobuf rpc engine.
At the moment, some parts of the system use the ProtobufRpcEngine from Hadoop,
other parts use the WritableRpcEngine (specifically the task to AM
communication).
> LLAP: switch task heartbeats to protobuf
> ----------------------------------------
>
> Key: HIVE-17294
> URL: https://issues.apache.org/jira/browse/HIVE-17294
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
