[
https://issues.apache.org/jira/browse/IMPALA-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16559241#comment-16559241
]
ASF subversion and git services commented on IMPALA-7340:
---------------------------------------------------------
Commit 04ed7ac132d37bff1c648a807059705ae5fac220 in impala's branch
refs/heads/master from [~tlipcon]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=04ed7ac ]
IMPALA-7340. Only send necessary fields in THdfsPartition
The THdfsPartition Thrift struct is used both for partition metadata
(sent from catalogd to coordinator) and for descriptors (sent from
coordinator frontend to backends). In the case of the descriptor,
not all fields are actually used.
This patch cleans up the Thrift struct definition to be more clear
which fields are used where, and changes the serialization code to
only fill in the necessary fields.
Change-Id: I97e8402efdfdeea06463bb71a40ebb6abd1f11f0
Reviewed-on: http://gerrit.cloudera.org:8080/11026
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Todd Lipcon <[email protected]>
> Clarify which fields belong in "descriptor" vs "full" catalog thrift objects
> ----------------------------------------------------------------------------
>
> Key: IMPALA-7340
> URL: https://issues.apache.org/jira/browse/IMPALA-7340
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Affects Versions: Impala 3.1.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Minor
> Fix For: Impala 3.1.0
>
>
> Currently some Thrift objects like THdfsPartition are used both in the
> context of descriptors (i.e sent to the backend) and in the context of
> catalog objects (sent from the catalogd to impalad). The Thrift struct
> definition doesn't really clarify which fields are used where, and in fact
> the frontend currently fills in some fields in the Descriptor which are not
> actually read by the backend. We should more clearly document which fields
> are necessary where, and only serialize those that are necessary.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
