[ https://issues.apache.org/jira/browse/HIVE-17294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123787#comment-16123787 ]
Siddharth Seth edited comment on HIVE-17294 at 8/11/17 6:21 PM: ---------------------------------------------------------------- The endpoint is in the LLAP AM plugin. However, that extends an upstream tez plugin - so some translation will likely be required. That's an unnecessary step. Other than time to work on this, another thing to watch out for is the cost of serializing protobuf, and memory overhead of copying buffers with protobuf rpc engine. At the moment, some parts of the system use the ProtobufRpcEngine from Hadoop, other parts use the WritableRpcEngine (specifically the task to AM communication). When I say part of he work is done - it's the representation of various pieces of information in protobuf. was (Author: sseth): The endpoint is in the LLAP AM plugin. However, that extends an upstream tez plugin - so some translation will likely be required. That's an unnecessary step. Other than time to work on this, another thing to watch out for is the cost of serializing protobuf, and memory overhead of copying buffers with protobuf rpc engine. At the moment, some parts of the system use the ProtobufRpcEngine from Hadoop, other parts use the WritableRpcEngine (specifically the task to AM communication). > LLAP: switch task heartbeats to protobuf > ---------------------------------------- > > Key: HIVE-17294 > URL: https://issues.apache.org/jira/browse/HIVE-17294 > Project: Hive > Issue Type: Bug > Reporter: Sergey Shelukhin > -- This message was sent by Atlassian JIRA (v6.4.14#64029)