[
https://issues.apache.org/jira/browse/IMPALA-13666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fang-Yu Rao updated IMPALA-13666:
---------------------------------
Description:
IMPALA-13154 added the method {{getFileMetadataStats()}} to
[HdfsPartition.java|https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/HdfsPartition.java]
that would return the file metadata statistics. The method requires the
corresponding {{HdfsPartition}} instance to have a non-null field of
'{{{}fileMetadataStats_{}}}'.
However, currently in order to set up the field of '{{{}fileMetadataStats_{}}}'
when instantiating an {{{}HdfsPartition{}}}, we also need to provide the value
of the field '{{{}id_{}}}', which should be unique across the whole catalog for
each partition. Since it's possible that we may not always know what value we
should be using for '{{{}id_{}}}' when instantiating an {{HdfsPartition}} via a
third party extension, if would be good that we add a new constructor for
{{HdfsPartition}} to allow us to set up the field of
'{{{}fileMetadataStats_{}}}' when instantiating an {{HdfsPartition}} without
having to provide the value of the field '{{{}id_{}}}'.
An alternative would be revising the existing constructors of
{{HdfsPartition}} to provide a non-null value for '{{{}fileMetadataStats_{}}}'.
was:
IMPALA-13154 added the method {{getFileMetadataStats()}} to
[HdfsPartition.java|https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/HdfsPartition.java]
that would return the file metadata statistics. The method requires the
corresponding {{HdfsPartition}} instance to have a non-null field of
'{{{}fileMetadataStats_{}}}'.
However, currently in order to set up the field of '{{{}fileMetadataStats_{}}}'
when instantiating an {{{}HdfsPartition{}}}, we also need to provide the value
of the field '{{{}id_{}}}', which should be unique across the whole catalog for
each partition. Since it's possible that we may not always know what value we
should be using for '{{{}id_{}}}' when instantiating an {{HdfsPartition}} via a
third party extension, if would be good that we add a new constructor for
{{HdfsPartition}} to allow us to set up the field of
'{{{}fileMetadataStats_{}}}' when instantiating an {{HdfsPartition}} without
having to provide the value of the field '{{{}id_{}}}'.
> Add a new constructor for ImpalaHdfsPartition after IMPALA-13154
> ----------------------------------------------------------------
>
> Key: IMPALA-13666
> URL: https://issues.apache.org/jira/browse/IMPALA-13666
> Project: IMPALA
> Issue Type: Task
> Reporter: Fang-Yu Rao
> Assignee: Fang-Yu Rao
> Priority: Major
>
> IMPALA-13154 added the method {{getFileMetadataStats()}} to
> [HdfsPartition.java|https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/HdfsPartition.java]
> that would return the file metadata statistics. The method requires the
> corresponding {{HdfsPartition}} instance to have a non-null field of
> '{{{}fileMetadataStats_{}}}'.
> However, currently in order to set up the field of
> '{{{}fileMetadataStats_{}}}' when instantiating an {{{}HdfsPartition{}}}, we
> also need to provide the value of the field '{{{}id_{}}}', which should be
> unique across the whole catalog for each partition. Since it's possible that
> we may not always know what value we should be using for '{{{}id_{}}}' when
> instantiating an {{HdfsPartition}} via a third party extension, if would be
> good that we add a new constructor for {{HdfsPartition}} to allow us to set
> up the field of '{{{}fileMetadataStats_{}}}' when instantiating an
> {{HdfsPartition}} without having to provide the value of the field
> '{{{}id_{}}}'.
> An alternative would be revising the existing constructors of
> {{HdfsPartition}} to provide a non-null value for
> '{{{}fileMetadataStats_{}}}'.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
