[
https://issues.apache.org/jira/browse/IMPALA-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199238#comment-17199238
]
ASF subversion and git services commented on IMPALA-9652:
---------------------------------------------------------
Commit 32bb425719c28941096220d5c6cf027b9f04ac82 in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=32bb425 ]
IMPALA-9652: CTAS doesn't respect transactional properties
Because of a bug the INSERT part of a CTAS statement didn't
run in a transaction and it just put the new files under the
root directory of the table. This didn't cause too much problems
because there couldn't be any concurrent operations as the table was
under construction. However, this behavior is not working particularly
well in the context of replication, as the notification event needs
a transaction id.
With this fix the INSERT operation runs in a transaction and the new
files are created under a delta directory.
Testing:
* Added CTAS statements and SHOW FILES <tbl> queries to acid-insert.test
Check if the files are created in a delta directory, if so, then
the INSERT must have been running in a transaction.
Change-Id: I6ed96aeadbcead9fdc548da5922a066460ff9f77
Reviewed-on: http://gerrit.cloudera.org:8080/16472
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> CTAS doesn't respect transactional properties
> ---------------------------------------------
>
> Key: IMPALA-9652
> URL: https://issues.apache.org/jira/browse/IMPALA-9652
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Csaba Ringhofer
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-acid
>
> To reproduce
> {code}
> set DEFAULT_TRANSACTIONAL_TYPE=insert_only;
> create table t as select 1;
> show files in tctas;
> {code}
> The result on my machine is
> hdfs://localhost:20500/test-warehouse/managed/tctas/ae4eb75d6ad848d2-92cd5d3100000000_1108910383_data.0.txt
>
> which is wrong as the file was created in the root directory of the table and
> not in a delta/base directory. This doesn't cause a visible error for users,
> as the file will be still considered to the part of the table due to
> "upgraded table" logic until the first major compaction.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
