[
https://issues.apache.org/jira/browse/IMPALA-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738571#comment-17738571
]
ASF subversion and git services commented on IMPALA-12131:
----------------------------------------------------------
Commit 59bb9259ef44d7c9d3f3eb1355d500d3ba75f513 in impala's branch
refs/heads/master from ttttttz
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=59bb9259e ]
IMPALA-12131: Fix empty partition map in non-partitioned table when file
metadata loading fails
When inserting non-partitioned tables, the catalog update
request could fail due to file not found exceptions. At that
point we have reset(cleared) the partition map so it becomes
empty after the failure, which is an illegal state and will
cause failures in later operations. Currently, users have to
manually invalidate the metadata of the table to recover. We
can improve this by making all the updates happen after all
the external loadings succeed. So any failures in loading the
file metadata won't leave the table metadata in a partially
updated state.
Testing:
1. Added a test which simulates a failure in a catalog update
request by throwing an exception through the debug action and
confirms that subsequent catalog update requests are not
affected by the failure.
Change-Id: I28e76a73b7905c24eb93b935124d20ea7abe8513
Reviewed-on: http://gerrit.cloudera.org:8080/19878
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Execute update catalog request failed cased by
> Exception:java.util.NoSuchElementException
> -----------------------------------------------------------------------------------------
>
> Key: IMPALA-12131
> URL: https://issues.apache.org/jira/browse/IMPALA-12131
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 4.1.2
> Reporter: Zhi Tang
> Assignee: Zhi Tang
> Priority: Major
> Attachments: image-2023-05-10-20-42-08-571.png,
> image-2023-06-21-15-46-07-774.png, image-2023-06-21-17-30-00-984.png
>
>
> The overwrite query of non-partition table failed due to a failure to update
> catalog. This is the stack trace of the thread:
> !image-2023-05-10-20-42-08-571.png|width=568,height=175!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
