[
https://issues.apache.org/jira/browse/IMPALA-13778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Csaba Ringhofer resolved IMPALA-13778.
--------------------------------------
Fix Version/s: Impala 4.6.0
Resolution: Fixed
> Recursive file listing should ignore more directories
> -----------------------------------------------------
>
> Key: IMPALA-13778
> URL: https://issues.apache.org/jira/browse/IMPALA-13778
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Reporter: Csaba Ringhofer
> Assignee: Csaba Ringhofer
> Priority: Critical
> Fix For: Impala 4.6.0
>
>
> The paths to ignore is governed by ignored_dir_prefix_list (default=
> ".,_tmp.,_spark_metadata").
> Hive recently started writing tmp files to folders starting with _tmp instead
> of -tmp, leading to errors if Impala loads the table when these temporary
> files still exist.
> Another prefix missing in ignored_dir_prefix_list is Impala's own tmp dir,
> _impala_insert_staging. This can only cause issues in non-partitioned tables
> as Impala writes this dir to the root folder of the table.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
