bharath v created IMPALA-7717:
---------------------------------
Summary: Partition id does not exist exception - Catalog V2
Key: IMPALA-7717
URL: https://issues.apache.org/jira/browse/IMPALA-7717
Project: IMPALA
Issue Type: Bug
Components: Catalog
Reporter: bharath v
Concurrent invalidates with partial RPC on partitioned tables can throw this
exception.
{noformat}
@Override
public TGetPartialCatalogObjectResponse getPartialInfo(
TGetPartialCatalogObjectRequest req) throws TableLoadingException {
if (partIds != null) {
resp.table_info.partitions =
Lists.newArrayListWithCapacity(partIds.size());
for (long partId : partIds) {
HdfsPartition part = partitionMap_.get(partId);
Preconditions.checkArgument(part != null, "Partition id %s does not
exist",
partId); <====
{noformat}
The issue is that the invalidate command can reset the partition IDs and the
RPCs could look up with older IDs.
We should wrap this into an inconsistent metadata fetch exception and retry
rather than throwing a RTE.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
