[
https://issues.apache.org/jira/browse/HIVE-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335011#comment-15335011
]
Siddharth Seth commented on HIVE-13970:
---------------------------------------
[~sershe] - SubmitWorkInfo currently contains information which is common to
all InputSplits. It's created only once, and should be sent over the network
only once.
The sending over the network part does not happen at the moment (there's a jira
open to change that).
I don't think we should make this change, since it'll make it difficult to
avoid sending the same information along with each and every split. (The size
of the vertexSpec can get quite large)
> refactor LLAPIF splits - get rid of SubmitWorkInfo
> --------------------------------------------------
>
> Key: HIVE-13970
> URL: https://issues.apache.org/jira/browse/HIVE-13970
> Project: Hive
> Issue Type: Sub-task
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-13970.01.patch, HIVE-13970.only.patch,
> HIVE-13970.patch, HIVE-13970.patch
>
>
> First we build the signable vertex spec, convert it into bytes (as we
> should), and put it inside SubmitWorkInfo. Then we serialize that into byte[]
> and put it into LlapInputSplit. Then we serialize that to return... We should
> get rid of one of the steps.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)