[
https://issues.apache.org/jira/browse/IMPALA-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841225#comment-16841225
]
Eric Lin commented on IMPALA-8557:
----------------------------------
Looks like it is affecting CTAS only, INSERT seems to be working.
> Impala on ABFS failed with error "IllegalArgumentException: ABFS does not
> allow files or directories to end with a dot."
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-8557
> URL: https://issues.apache.org/jira/browse/IMPALA-8557
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 3.2.0
> Reporter: Eric Lin
> Priority: Major
>
> HDFS introduced below feature to stop users from creating a file that ends
> with "." on ABFS:
> https://issues.apache.org/jira/browse/HADOOP-15860
> As a result of this change, Impala now writes to ABFS fails with such error.
> I can see that it generates temp file using this format "$0.$1.$2":
> https://github.com/cloudera/Impala/blob/cdh6.2.0/be/src/exec/hdfs-table-sink.cc#L329
> $2 is the file extension and will be empty if it is TEXT file format:
> https://github.com/cloudera/Impala/blob/cdh6.2.0/be/src/exec/hdfs-text-table-writer.cc#L65
> Since HADOOP-15860 was backported into CDH6.2, it is currently only affecting
> 6.2 and works in older versions.
> There is no way to override this empty file extension so no workaround is
> possible, unless user choose another file format.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
