[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-15 Thread Eugene Koifman (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493516#comment-15493516
 ] 

Eugene Koifman commented on HIVE-14726:
---

[~ashutoshc] should this be in 2.1.1 as well?

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer, Transactions
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Fix For: 2.2.0
>
> Attachments: HIVE-14726.1.patch, HIVE-14726.2.patch, HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-12 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486039#comment-15486039
 ] 

Hive QA commented on HIVE-14726:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12828135/HIVE-14726.2.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 9 failed/errored test(s), 10546 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[acid_mapjoin]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[stats0]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_join_part_col_char]
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[acid_bucket_pruning]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainuser_3]
org.apache.hadoop.hive.metastore.TestMetaStoreMetrics.testConnections
org.apache.hadoop.hive.metastore.TestMetaStoreMetrics.testMetaDataCounts
org.apache.hadoop.hive.metastore.TestMetaStoreMetrics.testMethodCounts
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testAddJarConstructorUnCaching
{noformat}

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/1160/testReport
Console output: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/1160/console
Test logs: 
http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-MASTER-Build-1160/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 9 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12828135 - PreCommit-HIVE-MASTER-Build

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.1.patch, HIVE-14726.2.patch, HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-12 Thread Eugene Koifman (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485500#comment-15485500
 ] 

Eugene Koifman commented on HIVE-14726:
---

conincidence

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.1.patch, HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-12 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485330#comment-15485330
 ] 

Hive QA commented on HIVE-14726:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12828079/HIVE-14726.1.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 10547 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[acid_mapjoin]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[dynpart_sort_optimization_acid]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[stats0]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_join_part_col_char]
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[acid_bucket_pruning]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainuser_3]
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testAddJarConstructorUnCaching
{noformat}

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/1155/testReport
Console output: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/1155/console
Test logs: 
http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-MASTER-Build-1155/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 7 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12828079 - PreCommit-HIVE-MASTER-Build

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.1.patch, HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-12 Thread Sergey Shelukhin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485085#comment-15485085
 ] 

Sergey Shelukhin commented on HIVE-14726:
-

Hmm, so was it related to HIVE-14710 thru some slight DB logic change, or was 
it just a coincidence?

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.1.patch, HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Eugene Koifman (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478709#comment-15478709
 ] 

Eugene Koifman commented on HIVE-14726:
---

every update/delete statement in dynpart_sort_optimization_acid.q has "key" 
which is the bucketing column in the WHERE clause.  Perhaps that's why this 
works.

For ACID data only needs to be sorted in each bucket by ROW__ID.
Thus if we sort globally by partition/bucket/ROW__ID, acid would still work.

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478698#comment-15478698
 ] 

Ashutosh Chauhan commented on HIVE-14726:
-

Thanks [~alangates] for looking into it. So, we begin with ROW__ID in sort and 
shuffle key and partition column as value of RS. In this optimization if we 
change RS sort and shuffle key to ROW__ID and partition column, we need not to 
keep orc buffer open and thus avoid OOM case. But is that ok with ACID writer 
in FileSink or it assumes sort and shuffle keys as ROW__ID and nothing else?

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Alan Gates (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478671#comment-15478671
 ] 

Alan Gates commented on HIVE-14726:
---

I think the issue is that SortDynPartitionOptimizer is using the bucket column 
numbers to index into the array of columns.  UpdateDeleteSemanticAnalyzer is 
rewriting a delete query into an insert that contains only partition columns 
(see around line 150ff).  This means the bucket columns aren't in the rewritten 
query.  The bucket id is present since it's part of the ROW__ID, but we may 
need to write special code in SDPO to fetch it from there rather than look for 
the column.

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Alan Gates (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478607#comment-15478607
 ] 

Alan Gates commented on HIVE-14726:
---

I don't know what's causing dynpart_sort_optimization_acid.q to fail, but I 
don't think it's the same thing since we don't see the IndexOutOfBounds 
exception.  

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Eugene Koifman (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478501#comment-15478501
 ] 

Eugene Koifman commented on HIVE-14726:
---

Does Jenkins print Commit hash for each run?  This test passed in run 1122 but 
failed in 1123.  cc [~sershe]

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Eugene Koifman (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478489#comment-15478489
 ] 

Eugene Koifman commented on HIVE-14726:
---

as far as I can tell it started failing here 
https://builds.apache.org/view/H-L/view/Hive/job/PreCommit-HIVE-MASTER-Build/1123/
 which was for HIVE-14710, though I don't know how that could cause it

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Alan Gates (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478455#comment-15478455
 ] 

Alan Gates commented on HIVE-14726:
---

There's no info on which query the stack trace came from.  [~deepesh], do you 
have the query and any information on the table?

Agreed that we don't want to blindly turn spdo off here.

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Eugene Koifman (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478456#comment-15478456
 ] 

Eugene Koifman commented on HIVE-14726:
---

I think hive.optimize.sort.dynamic.partition was made to work with ACID 
update/delete in HIVE-13849 and HIVE-13750

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478321#comment-15478321
 ] 

Ashutosh Chauhan commented on HIVE-14726:
-

On taking a second look it seems that delete/update statements can also be 
affected by wrath of orc buffers. e.g., for the query in test case RS sort and 
shuffle key is ROW__ID and partition column is in value of RS. If I understand 
correctly in Reducers FileSink operator need to have an orc buffer open for 
each partition. This may result in similar OOM cases. However, I am not sure if 
its possible to solve that problem through this optimization for delete/update 
statement. [~ekoifman] [~prasanth_j] any suggestions?

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477432#comment-15477432
 ] 

Ashutosh Chauhan commented on HIVE-14726:
-

Reason where this optimization is useful when there are large number of 
partitions being written. That time there are many orc writers which are 
buffering data. Update and delete statement gets rewritten as insert statement 
but they won't have this issue of many dynamic partitions being written into at 
same time. So, I am not sure why there is a handling of Update/Delete at place 
you pointed out, we should simply skip this optimization step in those cases. I 
will take another look and update the patch accordingly.

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Jesus Camacho Rodriguez (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477367#comment-15477367
 ] 

Jesus Camacho Rodriguez commented on HIVE-14726:


[~ashutoshc], could you elaborate why there is no advantage of running the 
optimization for update and delete? It seems we used to optimize these cases 
(l187 in the original SortedDynPartitionOptimizer class). If we apply the patch 
attached, we should remove the code in l187.

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-09 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477342#comment-15477342
 ] 

Ashutosh Chauhan commented on HIVE-14726:
-

[~jcamachorodriguez] Can you take a quick look? Seemingly related 
dynpart_sort_optimization_acid.q is failing on master since last 15 builds.

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-08 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475602#comment-15475602
 ] 

Hive QA commented on HIVE-14726:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12827683/HIVE-14726.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 8 failed/errored test(s), 10545 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.org.apache.hadoop.hive.cli.TestCliDriver
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[acid_mapjoin]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[dynpart_sort_optimization_acid]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[stats0]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_join_part_col_char]
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[acid_bucket_pruning]
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainuser_3]
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testAddJarConstructorUnCaching
{noformat}

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/1136/testReport
Console output: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/1136/console
Test logs: 
http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-MASTER-Build-1136/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 8 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12827683 - PreCommit-HIVE-MASTER-Build

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Deepesh Khandelwal
>Assignee: Ashutosh Chauhan
> Attachments: HIVE-14726.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14726) delete statement fails when spdo is on

2016-09-08 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475322#comment-15475322
 ] 

Ashutosh Chauhan commented on HIVE-14726:
-

Stack trace:
{code}
 (SessionState.java:printError(948)) - FAILED: IndexOutOfBoundsException Index: 
8, Size: 2
java.lang.IndexOutOfBoundsException: Index: 8, Size: 2
at java.util.ArrayList.rangeCheck(ArrayList.java:653)
at java.util.ArrayList.get(ArrayList.java:429)
at 
org.apache.hadoop.hive.ql.optimizer.SortedDynPartitionOptimizer$SortedDynamicPartitionProc.getPositionsToExprNodes(SortedDynPartitionOptimizer.java:588)
at 
org.apache.hadoop.hive.ql.optimizer.SortedDynPartitionOptimizer$SortedDynamicPartitionProc.process(SortedDynPartitionOptimizer.java:217)
at 
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:95)
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:79)
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:133)
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:110)
at 
org.apache.hadoop.hive.ql.optimizer.SortedDynPartitionOptimizer.transform(SortedDynPartitionOptimizer.java:104)
at 
org.apache.hadoop.hive.ql.optimizer.Optimizer.optimize(Optimizer.java:207)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10466)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10116)
at 
org.apache.hadoop.hive.ql.parse.UpdateDeleteSemanticAnalyzer.analyzeInternal(UpdateDeleteSemanticAnalyzer.java:61)
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:230)
at 
org.apache.hadoop.hive.ql.parse.UpdateDeleteSemanticAnalyzer.reparseAndSuperAnalyze(UpdateDeleteSemanticAnal
yzer.java:316)
at 
org.apache.hadoop.hive.ql.parse.UpdateDeleteSemanticAnalyzer.analyzeDelete(UpdateDeleteSemanticAnalyzer.java:100)
{code}

> delete statement fails when spdo is on
> --
>
> Key: HIVE-14726
> URL: https://issues.apache.org/jira/browse/HIVE-14726
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 2.1.0
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)