Yida Wu created IMPALA-13069:
--------------------------------
Summary: Consider not throwing errors during deleting staging
files after insertion
Key: IMPALA-13069
URL: https://issues.apache.org/jira/browse/IMPALA-13069
Project: IMPALA
Issue Type: Improvement
Components: Backend
Reporter: Yida Wu
When inserting data, we often use staging files in the cloud storage as
temporary files. Once the insertion is done, we typically clear out these
staging files. Currently, our approach involves deleting these files
individually and raising errors if any deletion fails. However, at this stage,
the insertion process is already complete, and there might be occasional
instability with the cloud provider. It may be not optimal to fail a query for
such errors during clearing temporary files. Perhaps worth considering a softer
way to handle this case.
https://github.com/apache/impala/blob/7ad94006563b88d9221b4ac978dbf5b4fc0a3ca1/be/src/runtime/dml-exec-state.cc#L343
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
