[jira] [Created] (HIVE-15513) GroupByOperator should initialize GenericUDAFEvaluator before AggregationBuffer (recurrence of HIVE-697)

2016-12-26 Thread Teruyoshi Zenmyo (JIRA) 
Teruyoshi Zenmyo created HIVE-15513:
---

 Summary: GroupByOperator should initialize GenericUDAFEvaluator 
before AggregationBuffer (recurrence of HIVE-697)
 Key: HIVE-15513
 URL: https://issues.apache.org/jira/browse/HIVE-15513
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.1.0
Reporter: Teruyoshi Zenmyo


GenericUDAFEvaluator should be initialized before getNewAggregationBuffer() is 
invoked so that aggrecation buffers can be created based on object inspectors 
for UDF arguments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-15175) NOT IN condition is not handled correctly with predicate push down

2016-11-09 Thread Teruyoshi Zenmyo (JIRA) 
Teruyoshi Zenmyo created HIVE-15175:
---

 Summary: NOT IN condition is not handled correctly with predicate 
push down
 Key: HIVE-15175
 URL: https://issues.apache.org/jira/browse/HIVE-15175
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.1.0
Reporter: Teruyoshi Zenmyo


With predicate pushdown enabled, NOT IN conditions are treated as FALSE.

Example (pkey is a partition key)
{code}
hive> select * from test;
OK
test.keytest.valtest.pkey
a   1   a
b   2   a
c   3   a
a   1   b
b   2   b
c   3   b
Time taken: 0.171 seconds, Fetched: 6 row(s)
hive> set hive.optimize.ppd=false;
hive> select * from test where not pkey in ('a');
OK
test.keytest.valtest.pkey
a   1   b
b   2   b
c   3   b
Time taken: 0.237 seconds, Fetched: 3 row(s)
hive> set hive.optimize.ppd=true;
hive> select * from test where not pkey in ('a');
OK
test.keytest.valtest.pkey
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-15140) Fix logger name in PartitionColumnsSeparator

2016-11-07 Thread Teruyoshi Zenmyo (JIRA) 
Teruyoshi Zenmyo created HIVE-15140:
---

 Summary: Fix logger name in PartitionColumnsSeparator
 Key: HIVE-15140
 URL: https://issues.apache.org/jira/browse/HIVE-15140
 Project: Hive
  Issue Type: Bug
Reporter: Teruyoshi Zenmyo
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-14999) SparkClientUtilities does not support viewFS

2016-10-18 Thread Teruyoshi Zenmyo (JIRA) 
Teruyoshi Zenmyo created HIVE-14999:
---

 Summary: SparkClientUtilities does not support viewFS
 Key: HIVE-14999
 URL: https://issues.apache.org/jira/browse/HIVE-14999
 Project: Hive
  Issue Type: Bug
  Components: Spark
Reporter: Teruyoshi Zenmyo


In SparkClientUtilities.urlFromPathString(), viewFS is not considered and jars 
on viewFS cannot be found.
This would cause a number of problems, for instance, custom UDFs are not 
available on viewFS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-3508) create cube and rollup operators in hive without mapside aggregation

2014-06-09 Thread Teruyoshi Zenmyo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Teruyoshi Zenmyo updated HIVE-3508:
---

Status: Patch Available  (was: Open)

This patch
- adds new operator (GroupMultiplexOperator)
- modifies SemanticAnalyzer to insert the operator.
- add two qtests

 create cube and rollup operators in hive without mapside aggregation
 

 Key: HIVE-3508
 URL: https://issues.apache.org/jira/browse/HIVE-3508
 Project: Hive
  Issue Type: New Feature
  Components: Query Processor
Reporter: Namit Jain





--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HIVE-3508) create cube and rollup operators in hive without mapside aggregation

2014-06-09 Thread Teruyoshi Zenmyo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Teruyoshi Zenmyo updated HIVE-3508:
---

Attachment: HIVE-3508.patch.txt

 create cube and rollup operators in hive without mapside aggregation
 

 Key: HIVE-3508
 URL: https://issues.apache.org/jira/browse/HIVE-3508
 Project: Hive
  Issue Type: New Feature
  Components: Query Processor
Reporter: Namit Jain
 Attachments: HIVE-3508.patch.txt






--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Commented] (HIVE-3508) create cube and rollup operators in hive without mapside aggregation

2014-06-09 Thread Teruyoshi Zenmyo (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14021762#comment-14021762
 ] 

Teruyoshi Zenmyo commented on HIVE-3508:


This is a review board entry for this patch.
https://reviews.apache.org/r/22372/

 create cube and rollup operators in hive without mapside aggregation
 

 Key: HIVE-3508
 URL: https://issues.apache.org/jira/browse/HIVE-3508
 Project: Hive
  Issue Type: New Feature
  Components: Query Processor
Reporter: Namit Jain
 Attachments: HIVE-3508.patch.txt






--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HIVE-3508) create cube and rollup operators in hive without mapside aggregation

2014-06-09 Thread Teruyoshi Zenmyo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Teruyoshi Zenmyo updated HIVE-3508:
---

Status: Open  (was: Patch Available)

 create cube and rollup operators in hive without mapside aggregation
 

 Key: HIVE-3508
 URL: https://issues.apache.org/jira/browse/HIVE-3508
 Project: Hive
  Issue Type: New Feature
  Components: Query Processor
Reporter: Namit Jain
 Attachments: HIVE-3508.patch.txt






--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HIVE-3508) create cube and rollup operators in hive without mapside aggregation

2014-06-09 Thread Teruyoshi Zenmyo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Teruyoshi Zenmyo updated HIVE-3508:
---

Attachment: HIVE-3508.2.patch.txt

The patch is recreated because the previous one was not created correctly, and 
arguments in invocations of genGroupByPlanReduceSinkOperator() are fixed.

 create cube and rollup operators in hive without mapside aggregation
 

 Key: HIVE-3508
 URL: https://issues.apache.org/jira/browse/HIVE-3508
 Project: Hive
  Issue Type: New Feature
  Components: Query Processor
Reporter: Namit Jain
 Attachments: HIVE-3508.2.patch.txt, HIVE-3508.patch.txt






--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HIVE-3508) create cube and rollup operators in hive without mapside aggregation

2014-06-09 Thread Teruyoshi Zenmyo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Teruyoshi Zenmyo updated HIVE-3508:
---

Status: Patch Available  (was: Open)

 create cube and rollup operators in hive without mapside aggregation
 

 Key: HIVE-3508
 URL: https://issues.apache.org/jira/browse/HIVE-3508
 Project: Hive
  Issue Type: New Feature
  Components: Query Processor
Reporter: Namit Jain
 Attachments: HIVE-3508.2.patch.txt, HIVE-3508.patch.txt






--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Commented] (HIVE-3508) create cube and rollup operators in hive without mapside aggregation

2014-06-04 Thread Teruyoshi Zenmyo (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018501#comment-14018501
 ] 

Teruyoshi Zenmyo commented on HIVE-3508:


Is anyone working on this? Otherwise, I'll try the following.
1. add a new operator which multiplexes records for each grouping id
2. insert the new operator before ReduceSinkOperators

Please let me know if anything wrong on this.

 create cube and rollup operators in hive without mapside aggregation
 

 Key: HIVE-3508
 URL: https://issues.apache.org/jira/browse/HIVE-3508
 Project: Hive
  Issue Type: New Feature
  Components: Query Processor
Reporter: Namit Jain





--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Updated] (HIVE-6022) Load statements with incorrect order of partitions put input files to unreadable places

2013-12-13 Thread Teruyoshi Zenmyo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Teruyoshi Zenmyo updated HIVE-6022:
---

Attachment: HIVE-6022.2.patch.txt

Fixes for the failed tests
- validate partSpec before sorting according to partition keys.
- modify dyn_part4.q.out

 Load statements with incorrect order of partitions put input files to 
 unreadable places
 ---

 Key: HIVE-6022
 URL: https://issues.apache.org/jira/browse/HIVE-6022
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Teruyoshi Zenmyo
 Attachments: HIVE-6022.1.patch, HIVE-6022.1.patch.txt, 
 HIVE-6022.2.patch.txt


 Load statements with incorrect order of partitions put input files to 
 incorrect paths. 
 {code}
 CREATE TABLE test_parts (c1 string, c2 int) PARTITIONED BY (p1 string,p2 
 string);
 LOAD DATA LOCAL INPATH '/opt/hive/examples/files/kv1.txt' OVERWRITE INTO 
 TABLE test_parts PARTITION (p2='p1', p1='p2')
 {code}
 The input file is located as below and the data is not readable.
 {code}
 % find /user/hive/warehouse/test_parts/
 /user/hive/warehouse/test_parts/
 /user/hive/warehouse/test_parts//p1=p2
 /user/hive/warehouse/test_parts//p1=p2/p2=p1
 /user/hive/warehouse/test_parts//p2=p1
 /user/hive/warehouse/test_parts//p2=p1/p1=p2
 /user/hive/warehouse/test_parts//p2=p1/p1=p2/.kv1.txt.crc
 /user/hive/warehouse/test_parts//p2=p1/p1=p2/kv1.txt
 {code}



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

[jira] [Created] (HIVE-6022) Load statements with incorrect order of partitions put input files to unreadable places

2013-12-12 Thread Teruyoshi Zenmyo (JIRA) 
Teruyoshi Zenmyo created HIVE-6022:
--

 Summary: Load statements with incorrect order of partitions put 
input files to unreadable places
 Key: HIVE-6022
 URL: https://issues.apache.org/jira/browse/HIVE-6022
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Teruyoshi Zenmyo


Load statements with incorrect order of partitions put input files to incorrect 
paths. 

{code}
CREATE TABLE test_parts (c1 string, c2 int) PARTITIONED BY (p1 string,p2 
string);
LOAD DATA LOCAL INPATH '/opt/hive/examples/files/kv1.txt' OVERWRITE INTO TABLE 
test_parts PARTITION (p2='p1', p1='p2')
{code}

The input file is located as below and the data is not readable.
{code}
% find /user/hive/warehouse/test_parts/
/user/hive/warehouse/test_parts/
/user/hive/warehouse/test_parts//p1=p2
/user/hive/warehouse/test_parts//p1=p2/p2=p1
/user/hive/warehouse/test_parts//p2=p1
/user/hive/warehouse/test_parts//p2=p1/p1=p2
/user/hive/warehouse/test_parts//p2=p1/p1=p2/.kv1.txt.crc
/user/hive/warehouse/test_parts//p2=p1/p1=p2/kv1.txt
{code}





--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

[jira] [Updated] (HIVE-6022) Load statements with incorrect order of partitions put input files to unreadable places

2013-12-12 Thread Teruyoshi Zenmyo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Teruyoshi Zenmyo updated HIVE-6022:
---

Attachment: HIVE-6022.1.patch.txt

 Load statements with incorrect order of partitions put input files to 
 unreadable places
 ---

 Key: HIVE-6022
 URL: https://issues.apache.org/jira/browse/HIVE-6022
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Teruyoshi Zenmyo
 Attachments: HIVE-6022.1.patch.txt


 Load statements with incorrect order of partitions put input files to 
 incorrect paths. 
 {code}
 CREATE TABLE test_parts (c1 string, c2 int) PARTITIONED BY (p1 string,p2 
 string);
 LOAD DATA LOCAL INPATH '/opt/hive/examples/files/kv1.txt' OVERWRITE INTO 
 TABLE test_parts PARTITION (p2='p1', p1='p2')
 {code}
 The input file is located as below and the data is not readable.
 {code}
 % find /user/hive/warehouse/test_parts/
 /user/hive/warehouse/test_parts/
 /user/hive/warehouse/test_parts//p1=p2
 /user/hive/warehouse/test_parts//p1=p2/p2=p1
 /user/hive/warehouse/test_parts//p2=p1
 /user/hive/warehouse/test_parts//p2=p1/p1=p2
 /user/hive/warehouse/test_parts//p2=p1/p1=p2/.kv1.txt.crc
 /user/hive/warehouse/test_parts//p2=p1/p1=p2/kv1.txt
 {code}



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

[jira] [Updated] (HIVE-6022) Load statements with incorrect order of partitions put input files to unreadable places

2013-12-12 Thread Teruyoshi Zenmyo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Teruyoshi Zenmyo updated HIVE-6022:
---

Status: Patch Available  (was: Open)

 Load statements with incorrect order of partitions put input files to 
 unreadable places
 ---

 Key: HIVE-6022
 URL: https://issues.apache.org/jira/browse/HIVE-6022
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Teruyoshi Zenmyo
 Attachments: HIVE-6022.1.patch.txt


 Load statements with incorrect order of partitions put input files to 
 incorrect paths. 
 {code}
 CREATE TABLE test_parts (c1 string, c2 int) PARTITIONED BY (p1 string,p2 
 string);
 LOAD DATA LOCAL INPATH '/opt/hive/examples/files/kv1.txt' OVERWRITE INTO 
 TABLE test_parts PARTITION (p2='p1', p1='p2')
 {code}
 The input file is located as below and the data is not readable.
 {code}
 % find /user/hive/warehouse/test_parts/
 /user/hive/warehouse/test_parts/
 /user/hive/warehouse/test_parts//p1=p2
 /user/hive/warehouse/test_parts//p1=p2/p2=p1
 /user/hive/warehouse/test_parts//p2=p1
 /user/hive/warehouse/test_parts//p2=p1/p1=p2
 /user/hive/warehouse/test_parts//p2=p1/p1=p2/.kv1.txt.crc
 /user/hive/warehouse/test_parts//p2=p1/p1=p2/kv1.txt
 {code}



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)