[jira] [Updated] (HIVE-12893) Sorted dynamic partition does not work if subset of partition columns are constant folded

2016-01-31 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-12893:
-
Attachment: HIVE-12893.3.patch

> Sorted dynamic partition does not work if subset of partition columns are 
> constant folded
> -
>
> Key: HIVE-12893
> URL: https://issues.apache.org/jira/browse/HIVE-12893
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 1.3.0, 2.0.0
>Reporter: Yi Zhang
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-12893.1.patch, HIVE-12893.2.patch, 
> HIVE-12893.2.patch, HIVE-12893.3.patch
>
>
> If all partition columns are constant folded then sorted dynamic partitioning 
> should not be used as it is similar to static partitioning. But if only 
> subset of partition columns are constant folded sorted dynamic partition 
> optimization will be helpful. Currently, this optimization is disabled if 
> atleast one partition column constant folded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12893) Sorted dynamic partition does not work if subset of partition columns are constant folded

2016-01-28 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-12893:
-
Attachment: HIVE-12893.2.patch

> Sorted dynamic partition does not work if subset of partition columns are 
> constant folded
> -
>
> Key: HIVE-12893
> URL: https://issues.apache.org/jira/browse/HIVE-12893
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 1.3.0, 2.0.0
>Reporter: Yi Zhang
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-12893.1.patch, HIVE-12893.2.patch, 
> HIVE-12893.2.patch
>
>
> If all partition columns are constant folded then sorted dynamic partitioning 
> should not be used as it is similar to static partitioning. But if only 
> subset of partition columns are constant folded sorted dynamic partition 
> optimization will be helpful. Currently, this optimization is disabled if 
> atleast one partition column constant folded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12893) Sorted dynamic partition does not work if subset of partition columns are constant folded

2016-01-27 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-12893:
-
Attachment: HIVE-12893.2.patch

Addressed review comments. [~ashutoshc] Regd. your comments about converting to 
static partition spec in constant propagation optimization, I will put up a 
follow up patch. Also added more tests for this specific issue. 

> Sorted dynamic partition does not work if subset of partition columns are 
> constant folded
> -
>
> Key: HIVE-12893
> URL: https://issues.apache.org/jira/browse/HIVE-12893
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 1.3.0, 2.0.0
>Reporter: Yi Zhang
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-12893.1.patch, HIVE-12893.2.patch
>
>
> If all partition columns are constant folded then sorted dynamic partitioning 
> should not be used as it is similar to static partitioning. But if only 
> subset of partition columns are constant folded sorted dynamic partition 
> optimization will be helpful. Currently, this optimization is disabled if 
> atleast one partition column constant folded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12893) Sorted dynamic partition does not work if subset of partition columns are constant folded

2016-01-19 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-12893:
-
Attachment: HIVE-12893.1.patch

This patch moves the SortedDynamicPartition optimizer above 
PartitionConditionRemover optimization. Removal of partition condition after 
constant folding makes it complicated to determine the partition columns as the 
folded columns will be removed from row schema. Also this patch disables 
BucketingSortingReduceSinkOptimizer if SortedDynamicPartition optimizer inserts 
a new ReduceSink. 

> Sorted dynamic partition does not work if subset of partition columns are 
> constant folded
> -
>
> Key: HIVE-12893
> URL: https://issues.apache.org/jira/browse/HIVE-12893
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 1.3.0, 2.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-12893.1.patch
>
>
> If all partition columns are constant folded then sorted dynamic partitioning 
> should not be used as it is similar to static partitioning. But if only 
> subset of partition columns are constant folded sorted dynamic partition 
> optimization will be helpful. Currently, this optimization is disabled if 
> atleast one partition column constant folded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-12893) Sorted dynamic partition does not work if subset of partition columns are constant folded

2016-01-19 Thread Prasanth Jayachandran (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-12893:
-
Reporter: Yi Zhang  (was: Prasanth Jayachandran)

> Sorted dynamic partition does not work if subset of partition columns are 
> constant folded
> -
>
> Key: HIVE-12893
> URL: https://issues.apache.org/jira/browse/HIVE-12893
> Project: Hive
>  Issue Type: Bug
>  Components: Logical Optimizer
>Affects Versions: 1.3.0, 2.0.0
>Reporter: Yi Zhang
>Assignee: Prasanth Jayachandran
> Attachments: HIVE-12893.1.patch
>
>
> If all partition columns are constant folded then sorted dynamic partitioning 
> should not be used as it is similar to static partitioning. But if only 
> subset of partition columns are constant folded sorted dynamic partition 
> optimization will be helpful. Currently, this optimization is disabled if 
> atleast one partition column constant folded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)