[
https://issues.apache.org/jira/browse/HIVE-16299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950239#comment-15950239
]
Hive QA commented on HIVE-16299:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12861352/HIVE-16299.02.patch
{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 10544 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[comments] (batchId=35)
org.apache.hive.hcatalog.api.TestHCatClient.testTransportFailure (batchId=172)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4477/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4477/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4477/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12861352 - PreCommit-HIVE-Build
> MSCK REPAIR TABLE should enforce partition key order when adding unknown
> partitions
> -----------------------------------------------------------------------------------
>
> Key: HIVE-16299
> URL: https://issues.apache.org/jira/browse/HIVE-16299
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Affects Versions: 2.2.0
> Reporter: Dudu Markovitz
> Assignee: Vihang Karajgaonkar
> Priority: Minor
> Attachments: HIVE-16299.01.patch, HIVE-16299.02.patch
>
>
> https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveMetaStoreChecker.java
> static String getPartitionName(Path tablePath, Path partitionPath,
> Set<String> partCols)
> ------------------------------------------------------------------------------------
> MSCK REPAIR validates that any sub-directory is in the format col=val and
> that there is indeed a partition column named "col".
> However, there is no validation of the partition column location and as a
> result false partitions are being created and so are directories that match
> those partitions.
> e.g. 1
> hive> dfs -mkdir -p /user/hive/warehouse/t/a=1/a=2/a=3/b=4/c=5;
> hive> create external table t (i int) partitioned by (a int,b int,c int) ;
> OK
> hive> msck repair table t;
> OK
> Partitions not in metastore: t:a=1/a=2/a=3/b=4/c=5
> Repair: Added partition to metastore t:a=1/a=2/a=3/b=4/c=5
> Time taken: 0.563 seconds, Fetched: 2 row(s)
> hive> show partitions t;
> OK
> a=3/b=4/c=5
> hive> dfs -ls -R /user/hive/warehouse/t;
> drwxr-xr-x - cloudera supergroup 0 2017-03-26 13:07
> /user/hive/warehouse/t/a=1
> drwxr-xr-x - cloudera supergroup 0 2017-03-26 13:07
> /user/hive/warehouse/t/a=1/a=2
> drwxr-xr-x - cloudera supergroup 0 2017-03-26 13:07
> /user/hive/warehouse/t/a=1/a=2/a=3
> drwxr-xr-x - cloudera supergroup 0 2017-03-26 13:07
> /user/hive/warehouse/t/a=1/a=2/a=3/b=4
> drwxr-xr-x - cloudera supergroup 0 2017-03-26 13:07
> /user/hive/warehouse/t/a=1/a=2/a=3/b=4/c=5
> drwxrwxrwx - cloudera supergroup 0 2017-03-26 13:07
> /user/hive/warehouse/t/a=3
> drwxrwxrwx - cloudera supergroup 0 2017-03-26 13:07
> /user/hive/warehouse/t/a=3/b=4
> drwxrwxrwx - cloudera supergroup 0 2017-03-26 13:07
> /user/hive/warehouse/t/a=3/b=4/c=5
> e.g. 2
> hive> dfs -mkdir -p /user/hive/warehouse/t/c=3/b=2/a=1;
> hive> create external table t (i int) partitioned by (a int,b int,c int);
> OK
> hive> msck repair table t;
> OK
> Partitions not in metastore: t:c=3/b=2/a=1
> Repair: Added partition to metastore t:c=3/b=2/a=1
> Time taken: 0.512 seconds, Fetched: 2 row(s)
> hive> show partitions t;
> OK
> a=1/b=2/c=3
> hive> dfs -ls -R /user/hive/warehouse/t;
> drwxrwxrwx - cloudera supergroup 0 2017-03-26 13:13
> /user/hive/warehouse/t/a=1
> drwxrwxrwx - cloudera supergroup 0 2017-03-26 13:13
> /user/hive/warehouse/t/a=1/b=2
> drwxrwxrwx - cloudera supergroup 0 2017-03-26 13:13
> /user/hive/warehouse/t/a=1/b=2/c=3
> drwxr-xr-x - cloudera supergroup 0 2017-03-26 13:12
> /user/hive/warehouse/t/c=3
> drwxr-xr-x - cloudera supergroup 0 2017-03-26 13:12
> /user/hive/warehouse/t/c=3/b=2
> drwxr-xr-x - cloudera supergroup 0 2017-03-26 13:12
> /user/hive/warehouse/t/c=3/b=2/a=1
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
