[
https://issues.apache.org/jira/browse/IMPALA-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099602#comment-17099602
]
ASF subversion and git services commented on IMPALA-9484:
---------------------------------------------------------
Commit cf8e41c14f684659a492799e384b9358cfef7541 in impala's branch
refs/heads/master from Sahil Takiar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=cf8e41c ]
IMPALA-9365: Disable acid-negative.test on non-HDFS filesystems
It looks like IMPALA-9484 might have accidentally broken
acid-negative.test on non-HDFS filesystems. This patch skips this test
for all filesystems, except for HDFS.
The issue is that acid-negative.test was modified to run several Hive
queries, but Impala currently does not support running Hive queries on
non-HDFS filesystems.
Change-Id: I10c6711c39825b648acfe59cb39a435e034dbc92
Reviewed-on: http://gerrit.cloudera.org:8080/15862
Reviewed-by: Anurag Mantripragada <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Zoltan Borok-Nagy <[email protected]>
> Milestone 1: properly scan files that has full ACID schema
> ----------------------------------------------------------
>
> Key: IMPALA-9484
> URL: https://issues.apache.org/jira/browse/IMPALA-9484
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-acid
> Fix For: Impala 4.0
>
>
>
> Full ACID row format looks like this:
> {
> "operation": 0,
> "originalTransaction": 1,
> "bucket": 536870912,
> "rowId": 0,
> "currentTransaction": 1,
> "row": \{"i": 1}
> }
> User columns are nested under "row". The frontend should create proper tuples
> and slot descriptors for the scan nodes to read the files correctly.
> We should be able to query the ACID columns, at least for debugging/testing.
> Hive uses the special “row__id” identifier for that.
> Impala should raise an error if there are delete deltas. Directory filtering
> should filter out minor compacted directories since the records from those
> need validation.
> Non-goals in this sub-task:
> * row validation against validWriteIdList
> * reading "original files" (files in non-ACID format)
> * reading delete deltas
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
