[
https://issues.apache.org/jira/browse/IMPALA-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang updated IMPALA-10886:
------------------------------------
Description:
[https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/14670/testReport/junit/custom_cluster.test_local_catalog/TestReusePartitionMetadata/test_reuse_partition_meta/]
{code:java}
custom_cluster/test_local_catalog.py:586: in test_reuse_partition_meta
self.check_missing_partitions(unique_database, 1)
custom_cluster/test_local_catalog.py:595: in check_missing_partitions
assert match.group(1) == str(partition_misses)
E assert '0' == '1'
E - 0
E + 1
{code}
*RCA*
There is a bug in CatalogOpExecutor#updateCatalog() that we loss the
createEventId of the new partitions. It should be used in the final call
of loadTableMetadata(). This bug causes intermittent failures in
TestReusePartitionMetadata.test_reuse_partition_meta. The last two DMLs
of the test is dropping a partition and then creating it back by an INSERT. If
the DROP_PARTITION event is processed after the INSERT
finishes, the partition will be dropped incorrectly. See more in the commit
message of the fix.
was:
https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/14670/testReport/junit/custom_cluster.test_local_catalog/TestReusePartitionMetadata/test_reuse_partition_meta/
{code}
custom_cluster/test_local_catalog.py:586: in test_reuse_partition_meta
self.check_missing_partitions(unique_database, 1)
custom_cluster/test_local_catalog.py:595: in check_missing_partitions
assert match.group(1) == str(partition_misses)
E assert '0' == '1'
E - 0
E + 1
{code}
> TestReusePartitionMetadata.test_reuse_partition_meta fails
> ----------------------------------------------------------
>
> Key: IMPALA-10886
> URL: https://issues.apache.org/jira/browse/IMPALA-10886
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Affects Versions: Impala 4.1.0
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Critical
> Labels: broken-build
> Fix For: Impala 4.1.0
>
> Attachments: test_local_catalog.patch
>
>
> [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/14670/testReport/junit/custom_cluster.test_local_catalog/TestReusePartitionMetadata/test_reuse_partition_meta/]
> {code:java}
> custom_cluster/test_local_catalog.py:586: in test_reuse_partition_meta
> self.check_missing_partitions(unique_database, 1)
> custom_cluster/test_local_catalog.py:595: in check_missing_partitions
> assert match.group(1) == str(partition_misses)
> E assert '0' == '1'
> E - 0
> E + 1
> {code}
> *RCA*
> There is a bug in CatalogOpExecutor#updateCatalog() that we loss the
> createEventId of the new partitions. It should be used in the final call
> of loadTableMetadata(). This bug causes intermittent failures in
> TestReusePartitionMetadata.test_reuse_partition_meta. The last two DMLs
> of the test is dropping a partition and then creating it back by an INSERT.
> If the DROP_PARTITION event is processed after the INSERT
> finishes, the partition will be dropped incorrectly. See more in the commit
> message of the fix.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
