[jira] [Commented] (HIVE-2723) should throw "Ambiguous column reference key" Exception in particular join condition

2012-12-08 Thread Namit Jain (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527350#comment-13527350
 ] 

Namit Jain commented on HIVE-2723:
--

I will let Navis confirm, but the output columns from the sub-query have the 
same name.

select * from (select * from src) a join (select * from src1) b on (a.key = 
b.key)

This will return a.key, a.value, b.key, b.value with column names key, value, 
key, value respectively.

> should throw  "Ambiguous column reference key"  Exception in particular join 
> condition
> --
>
> Key: HIVE-2723
> URL: https://issues.apache.org/jira/browse/HIVE-2723
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
> Environment: Linux zongren-VirtualBox 3.0.0-14-generic #23-Ubuntu SMP 
> Mon Nov 21 20:34:47 UTC 2011 i686 i686 i386 GNU/Linux
> java version "1.6.0_25"
> hadoop-0.20.2-cdh3u0
> hive-0.7.0-cdh3u0
>Reporter: caofangkun
>Assignee: Navis
>Priority: Minor
>  Labels: exception-handling, query, queryparser
> Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2723.D1275.1.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2723.D1275.2.patch, hive.2723.1.patch, 
> HIVE-2723.D1275.3.patch
>
>
>  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3717) Hive won't compile with -Dhadoop.mr.rev=20S

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527315#comment-13527315
 ] 

Ashutosh Chauhan commented on HIVE-3717:


bq. The real fix will be to update the POM file for hadoop core though.

I tested with latest released hadoop 1.1.1 and I am able to compile fine. 
Looks, like pom file bug of hadoop is taken care of in 1.1.1 release. So, I 
suggest to resolve this as won't fix and recommend folks to compile hadoop with 
1.1.1

> Hive won't compile with -Dhadoop.mr.rev=20S
> ---
>
> Key: HIVE-3717
> URL: https://issues.apache.org/jira/browse/HIVE-3717
> Project: Hive
>  Issue Type: Bug
>  Components: Build Infrastructure, Shims
>Affects Versions: 0.10.0
>Reporter: Gunther Hagleitner
> Attachments: HIVE-3717.1-1410543.txt
>
>
> ant -Dhadoop.mr.rev=20S clean package
> fails with: 
> {noformat}
> compile:
>  [echo] Project: ql
> [javac] Compiling 744 source files to /root/hive/build/ql/classes
> [javac] 
> /root/hive/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFJson.java:67: cannot 
> find symbol
> [javac] symbol  : variable ALLOW_UNQUOTED_CONTROL_CHARS
> [javac] location: class org.codehaus.jackson.JsonParser.Feature
> [javac] JSON_FACTORY.enable(Feature.ALLOW_UNQUOTED_CONTROL_CHARS);
> [javac]^
> [javac] 
> /root/hive/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFJson.java:158: cannot 
> find symbol
> [javac] symbol  : method writeValueAsString(java.lang.Object)
> [javac] location: class org.codehaus.jackson.map.ObjectMapper
> [javac] result.set(MAPPER.writeValueAsString(extractObject));
> [javac]  ^
> [javac] 
> /root/hive/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDTFJSONTuple.java:59:
>  cannot find symbol
> [javac] symbol  : variable ALLOW_UNQUOTED_CONTROL_CHARS
> [javac] location: class org.codehaus.jackson.JsonParser.Feature
> [javac] JSON_FACTORY.enable(Feature.ALLOW_UNQUOTED_CONTROL_CHARS);
> [javac]^
> [javac] 
> /root/hive/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDTFJSONTuple.java:189:
>  cannot find symbol
> [javac] symbol  : method writeValueAsString(java.lang.Object)
> [javac] location: class org.codehaus.jackson.map.ObjectMapper
> [javac]   
> retCols[i].set(MAPPER.writeValueAsString(extractObject));
> [javac]^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 4 errors
> {noformat}
> According to https://issues.apache.org/jira/browse/HADOOP-7470 hadoop 1.x has 
> been upgraded to jackson 1.8.8 but the POM file still specifies jackson 1.0.1 
> which doesn't work for hive (doesn't have the ALLOW_UNQUOTED_CONTROL_CHARS).
> The POM for hadoop 2.0.0-alpha (-Dhadoop.mr.rev=23) has the right dependency, 
> hadoop 0.20.2 (-Dhadoop.mr.rev=20) doesn't depend on jackson.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3705) Adding authorization capability to the metastore

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-3705:
---

   Resolution: Fixed
Fix Version/s: 0.11
   Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks, Sushanth!
I tried applying this on 0.10 branch, patch doesn't apply. Can you please 
generate a consolidated backport patch for 0.10

> Adding authorization capability to the metastore
> 
>
> Key: HIVE-3705
> URL: https://issues.apache.org/jira/browse/HIVE-3705
> Project: Hive
>  Issue Type: New Feature
>  Components: Authorization, Metastore
>Reporter: Sushanth Sowmyan
>Assignee: Sushanth Sowmyan
> Fix For: 0.11
>
> Attachments: HIVE-3705.D6681.1.patch, HIVE-3705.D6681.2.patch, 
> HIVE-3705.D6681.3.patch, HIVE-3705.D6681.4.patch, HIVE-3705.D6681.5.patch, 
> HIVE-3705.giant.svn.patch, hive-backend-auth.2.git.patch, 
> hive-backend-auth.git.patch, hive-backend-auth.post-review.git.patch, 
> hive-backend-auth.post-review-part2.git.patch, 
> hive-backend-auth.post-review-part3.git.patch, hivesec_investigation.pdf
>
>
> In an environment where multiple clients access a single metastore, and we 
> want to evolve hive security to a point where it's no longer simply 
> preventing users from shooting their own foot, we need to be able to 
> authorize metastore calls as well, instead of simply performing every 
> metastore api call that's made.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3446) PrimitiveObjectInspector doesn't handle timestamps properly

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527311#comment-13527311
 ] 

Ashutosh Chauhan commented on HIVE-3446:


Its good to have a .q file test since it demonstrate the functionality bug as 
well as provides protection against regression. But, in this case bug is quite 
clear and is covered by junit test case. Ed, I propose that we commit this 
patch as it, otherwise bug will keep lurking in our codebase till Sam circle 
back with new testcase. What do you say?

> PrimitiveObjectInspector doesn't handle timestamps properly
> ---
>
> Key: HIVE-3446
> URL: https://issues.apache.org/jira/browse/HIVE-3446
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 0.10.0, 0.9.1
>Reporter: Sam Tunnicliffe
> Attachments: HIVE-3446.1.patch.txt
>
>
> Getting java.sql.Timestamp from a TimestampWritable is broken due to an 
> incorrect mapping in PrimitiveObjectInspectorUtils.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-1399) Nested UDAFs cause Hive Internal Error (NullPointerException)

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527307#comment-13527307
 ] 

Ashutosh Chauhan commented on HIVE-1399:


I agree. Ed, your error message looks appropriate to me. Can you update the 
patch with that? After that, please commit the patch if tests pass.

> Nested UDAFs cause Hive Internal Error (NullPointerException)
> -
>
> Key: HIVE-1399
> URL: https://issues.apache.org/jira/browse/HIVE-1399
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.9.0
>Reporter: Mayank Lahiri
>Assignee: Adam Fokken
> Attachments: HIVE-1399.1.patch.txt
>
>
> This query does not make "real-world" sense, and I'm guessing it's not even 
> supported by HQL/SQL, but I'm pretty sure that it shouldn't be causing an 
> internal error with a NullPointerException. "normal" just has one column 
> called "val". I'm running on trunk, svn updated 5 minutes ago, ant clean 
> package.
> SELECT percentile(val, percentile(val, 0.5)) FROM normal;
> FAILED: Hive Internal Error: java.lang.NullPointerException(null)
> java.lang.NullPointerException
>   at 
> org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:153)
>   at 
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:587)
>   at 
> org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:708)
>   at 
> org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:89)
>   at 
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:88)
>   at 
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:128)
>   at 
> org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:102)
>   at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:6241)
>   at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genGroupByPlanMapGroupByOperator(SemanticAnalyzer.java:2301)
>   at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genGroupByPlanMapAggr1MR(SemanticAnalyzer.java:2860)
>   at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:5002)
>   at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:5524)
>   at 
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:6055)
>   at 
> org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:126)
>   at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:304)
>   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:377)
>   at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:138)
>   at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:197)
>   at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:303)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   at java.lang.reflect.Method.invoke(Method.java:597)
>   at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> I've also recreated this error with a GenericUDAF I'm writing, and also with 
> the following:
> SELECT percentile(val, percentile()) FROM normal;   
> SELECT avg(variance(dob_year)) FROM somedata; // this makes no sense, but 
> still a NullPointerException

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3231) msck repair should find partitions already containing data files

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527300#comment-13527300
 ] 

Ashutosh Chauhan commented on HIVE-3231:


+1 will commit if tests pass.

> msck repair should find partitions already containing data files
> 
>
> Key: HIVE-3231
> URL: https://issues.apache.org/jira/browse/HIVE-3231
> Project: Hive
>  Issue Type: Improvement
>  Components: Metastore
>Affects Versions: 0.10.0, 0.9.1
>Reporter: Keegan Mosley
>Assignee: Carl Steinbach
>  Labels: msck
> Fix For: 0.10.0
>
> Attachments: HIVE-3231.1.patch.txt, HIVE-3231.2.patch.txt
>
>
> msck repair currently will only discover partition directories if they are 
> empty.
> It seems a more apt use case to copy data files into a table, creating the 
> partition directories as you go, rather than creating a bunch of empty 
> partition directories, then running msck repair to dynamically add them, then 
> inserting your actual data files.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Hive-trunk-h0.21 - Build # 1843 - Fixed

2012-12-08 Thread Apache Jenkins Server 
Changes for Build #1831
[namit] HIVE-3747 Provide hive operation name for hookContext
(Shreepadma Venugopalan via namit)


Changes for Build #1832

Changes for Build #1833
[namit] HIVE-3750 JDBCStatsPublisher fails when ID length exceeds length of ID 
column
(Kevin Wilfong via namit)


Changes for Build #1835
[namit] HIVE-3073 Hive List Bucketing - DML support
(Gang Tim Liu via namit)

[namit] HIVE-3771 HIVE-3750 broke TestParse
(Kevin Wilfong via namit)

[hashutosh] HIVE-3384 : HIVE JDBC module won't compile under JDK1.7 as new 
methods added in JDBC specification (Shengsheng Huang, Chris Drome, Mikhail 
Bautin via Ashutosh Chauhan)

[namit] HIVE-3702 Renaming table changes table location scheme/authority
(Kevin Wilfong via namit)


Changes for Build #1836
[namit] HIVE-2723 should throw "Ambiguous column reference key" Exception in 
particular
join condition (Navis via namit)

[namit] HIVE-3594 When Group by Partition Column Type is Timestamp or STRING 
Which Format contains "HH:MM:SS",
It will occur URISyntaxException (Navis via namit)


Changes for Build #1837
[namit] HIVE-3762 Minor fix for 'tableName' in Hive.g
(Navis via namit)


Changes for Build #1838

Changes for Build #1839
[namit] HIVE-2477 Use name of original expression for name of CAST output
(Navis via namit)


Changes for Build #1840
[hashutosh] HIVE-3400 : Add Retries to Hive MetaStore Connections (Bhushan 
Mandhani via Ashutosh Chauhan)


Changes for Build #1841
[namit] HIVE-3767 BucketizedHiveInputFormat should be automatically used with 
Bucketized Map Joins also (Gang Tim Liu via namit)


Changes for Build #1842
[namit] HIVE-3140 Comment indenting is broken for "describe" in CLI
(Zhenxiao Luo via namit)


Changes for Build #1843



All tests passed

The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1843)

Status: Fixed

Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1843/ to 
view the results.

[jira] [Updated] (HIVE-3455) ANSI CORR(X,Y) is incorrect

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-3455:
---

Status: Open  (was: Patch Available)

Patch needs a testcase. Maxim / Ed, if you guys are working on this, can you 
please add a testcase and update the patch?

> ANSI CORR(X,Y) is incorrect
> ---
>
> Key: HIVE-3455
> URL: https://issues.apache.org/jira/browse/HIVE-3455
> Project: Hive
>  Issue Type: Bug
>  Components: UDF
>Affects Versions: 0.9.0, 0.8.1, 0.8.0, 0.7.1, 0.10.0, 0.9.1
>Reporter: Maxim Bolotin
>  Labels: patch
> Attachments: my.patch
>
>
> A simple test with 2 collinear vectors returns a wrong result.
> The problem is the merge of variances, file:
> http://svn.apache.org/viewvc/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFCorrelation.java?revision=1157222&view=markup
> lines:
> 347: myagg.xvar += xvarB + (xavgA - xavgB) * (xavgA - xavgB) * myagg.count;
> 348: myagg.yvar += yvarB + (yavgA - yavgB) * (yavgA - yavgB) * myagg.count;
> the correct merge should be like this:
> 347: myagg.xvar += xvarB + (xavgA - xavgB) * (xavgA - xavgB) / myagg.count * 
> nA * nB;
> 348: myagg.yvar += yvarB + (yavgA - yavgB) * (yavgA - yavgB) / myagg.count * 
> nA * nB;

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2517) Support group by on struct type

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2517:
---

Summary: Support group by on struct type  (was: Support group by on union 
and struct type)

> Support group by on struct type
> ---
>
> Key: HIVE-2517
> URL: https://issues.apache.org/jira/browse/HIVE-2517
> Project: Hive
>  Issue Type: New Feature
>  Components: Query Processor
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>  Labels: structtype, uniontype
> Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2517.D2151.1.patch, 
> hive-2517_1.patch, hive-2517_2.patch, hive-2517.patch
>
>
> Currently group by on struct and union types are not supported. This issue 
> will enable support for those.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2691) Specify location of log4j configuration files via configuration properties

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527271#comment-13527271
 ] 

Ashutosh Chauhan commented on HIVE-2691:


+1 will commit if tests pass.

> Specify location of log4j configuration files via configuration properties
> --
>
> Key: HIVE-2691
> URL: https://issues.apache.org/jira/browse/HIVE-2691
> Project: Hive
>  Issue Type: New Feature
>  Components: Configuration, Logging
>Reporter: Carl Steinbach
>Assignee: Zhenxiao Luo
> Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2691.D1131.1.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2691.D1203.1.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2691.D1203.2.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2691.D1203.3.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2691.D1203.4.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2691.D1203.5.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2691.D1203.6.patch, 
> ASF.LICENSE.NOT.GRANTED--HIVE-2691.D2667.1.patch, HIVE-2691.1.patch.txt, 
> HIVE-2691.2.patch.txt, HIVE-2691.D2667.1.patch
>
>
> Oozie needs to be able to override the default location of the log4j 
> configuration
> files from the Hive command line, e.g:
> {noformat}
> hive -hiveconf hive.log4j.file=/home/carl/hive-log4j.properties -hiveconf 
> hive.log4j.exec.file=/home/carl/hive-exec-log4j.properties
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3045) Partition column values are not valid if any of virtual columns is selected

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527258#comment-13527258
 ] 

Ashutosh Chauhan commented on HIVE-3045:


Navis,
Patch looks good, but doesn't apply cleanly on trunk. Can you rebase the patch 
and also upload it here on jira.

> Partition column values are not valid if any of virtual columns is selected
> ---
>
> Key: HIVE-3045
> URL: https://issues.apache.org/jira/browse/HIVE-3045
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Affects Versions: 0.10.0
>Reporter: Navis
>Assignee: Navis
>
> For example,
> {code}
> hive> select * from srcpart where key < 5;
> 0 val_0   2008-04-08  11
> 4 val_4   2008-04-08  11
> 0 val_0   2008-04-08  11
> 0 val_0   2008-04-08  11
> 2 val_2   2008-04-08  11
> 0 val_1   2008-04-09  12
> 4 val_5   2008-04-09  12
> 3 val_4   2008-04-09  12
> 2 val_3   2008-04-09  12
> 0 val_1   2008-04-09  12
> 1 val_2   2008-04-09  12
> hive> select *, BLOCK__OFFSET__INSIDE__FILE from srcpart where key < 5;
> 0 val_0   2008-04-09  11  968
> 4 val_4   2008-04-09  11  1218
> 0 val_0   2008-04-09  11  2088
> 0 val_0   2008-04-09  11  2632
> 2 val_2   2008-04-09  11  4004
> 0 val_1   2008-04-09  11  682
> 4 val_5   2008-04-09  11  1131
> 3 val_4   2008-04-09  11  1163
> 2 val_3   2008-04-09  11  2629
> 0 val_1   2008-04-09  11  4367
> 1 val_2   2008-04-09  11  5669
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2794) Aggregations without grouping should return NULL when applied to partitioning column of a partitionless table

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527253#comment-13527253
 ] 

Ashutosh Chauhan commented on HIVE-2794:


+1 will commit if tests pass.

> Aggregations without grouping should return NULL when applied to partitioning 
> column of a partitionless table
> -
>
> Key: HIVE-2794
> URL: https://issues.apache.org/jira/browse/HIVE-2794
> Project: Hive
>  Issue Type: Bug
>  Components: Query Processor
>Reporter: Carl Steinbach
>Assignee: Zhenxiao Luo
> Attachments: HIVE-2794.1.patch.txt
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2439) Upgrade antlr version to 3.4

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-2439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527248#comment-13527248
 ] 

Ashutosh Chauhan commented on HIVE-2439:


Thiruvel,
We usually work on trunk. So, I will suggest you to use trunk for this work. 
From trunk, we can always backport patches. 

> Upgrade antlr version to 3.4
> 
>
> Key: HIVE-2439
> URL: https://issues.apache.org/jira/browse/HIVE-2439
> Project: Hive
>  Issue Type: Improvement
>Affects Versions: 0.8.0
>Reporter: Ashutosh Chauhan
> Attachments: HIVE-2439_branch9_2.patch, HIVE-2439_branch9_3.patch, 
> HIVE-2439_branch9.patch, hive-2439_incomplete.patch
>
>
> Upgrade antlr version to 3.4

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3084) Hive CI failing due to script_broken_pipe1.q

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527240#comment-13527240
 ] 

Ashutosh Chauhan commented on HIVE-3084:


+1 

> Hive CI failing due to script_broken_pipe1.q
> 
>
> Key: HIVE-3084
> URL: https://issues.apache.org/jira/browse/HIVE-3084
> Project: Hive
>  Issue Type: Bug
>Reporter: Travis Crawford
>Assignee: Gunther Hagleitner
> Attachments: HIVE-3084_disable_failing_test.1.patch, 
> HIVE-3084_two_script_operators.patch
>
>
> Hive's [CI job|https://builds.apache.org/job/Hive-trunk-h0.21/] regularly 
> fails due to this test:
> {code}
> org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1
> {code}
> Running just that test in a loop I'm not able to reproduce the issue locally. 
> This may be related to state from a previous test causing this one to fail?
> {code}
> ant clean package
> for x in $(seq 1 10); 
>   do ant test -Dtestcase=TestNegativeCliDriver -Dqfile=script_broken_pipe1.q;
> done
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3780) RetryingMetaStoreClient Should Log the Caught Exception

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527235#comment-13527235
 ] 

Ashutosh Chauhan commented on HIVE-3780:


+1

> RetryingMetaStoreClient Should Log the Caught Exception
> ---
>
> Key: HIVE-3780
> URL: https://issues.apache.org/jira/browse/HIVE-3780
> Project: Hive
>  Issue Type: Bug
>Reporter: Bhushan Mandhani
>Assignee: Bhushan Mandhani
>Priority: Trivial
> Attachments: HIVE-3780.1.patch.txt
>
>
> Currently it logs the cause of the caught exception. It should log the caught 
> exception itself.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HIVE-3750) JDBCStatsPublisher fails when ID length exceeds length of ID column

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan resolved HIVE-3750.


   Resolution: Fixed
Fix Version/s: 0.11

Kevin,
stats19.q is still failing. I opened HIVE-3783 for it.

> JDBCStatsPublisher fails when ID length exceeds length of ID column
> ---
>
> Key: HIVE-3750
> URL: https://issues.apache.org/jira/browse/HIVE-3750
> Project: Hive
>  Issue Type: Bug
>  Components: Statistics
>Affects Versions: 0.11
>Reporter: Kevin Wilfong
>Assignee: Kevin Wilfong
> Fix For: 0.11
>
> Attachments: HIVE-3750.1.patch.txt
>
>
> When the length of the ID field passed to JDBCStatsPublisher exceeds the 
> length of the column in the table (currently 255 characters) stats collection 
> fails.  This causes the entire query to fail when hive.stats.reliable is set 
> to true.
> One way to prevent this would be to calculate a deterministic, very low 
> collision hash of the ID prefix used for aggregation and use that when the 
> length of the ID is too long.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-3783) stats19.q is failing on trunk

2012-12-08 Thread Ashutosh Chauhan (JIRA) 
Ashutosh Chauhan created HIVE-3783:
--

 Summary: stats19.q is failing on trunk
 Key: HIVE-3783
 URL: https://issues.apache.org/jira/browse/HIVE-3783
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.11
Reporter: Ashutosh Chauhan


This test-case was introduced in HIVE-3750 and is failing since as soon as it 
was introduced. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3760) TestNegativeMinimrCliDriver_mapreduce_stack_trace.q fails on hadoop-1

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527219#comment-13527219
 ] 

Ashutosh Chauhan commented on HIVE-3760:


+1

> TestNegativeMinimrCliDriver_mapreduce_stack_trace.q fails on hadoop-1
> -
>
> Key: HIVE-3760
> URL: https://issues.apache.org/jira/browse/HIVE-3760
> Project: Hive
>  Issue Type: Bug
>Reporter: Ashutosh Chauhan
>Assignee: Gunther Hagleitner
> Attachments: HIVE-3760.2.patch, hive-3760.patch
>
>
> Actually functionality is working correctly, but incorrect include/exclude 
> macro in test directive is making its .q.out comparison against incorrect 
> results.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3705) Adding authorization capability to the metastore

2012-12-08 Thread Ashutosh Chauhan (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13527216#comment-13527216
 ] 

Ashutosh Chauhan commented on HIVE-3705:


+1 Running tests.

> Adding authorization capability to the metastore
> 
>
> Key: HIVE-3705
> URL: https://issues.apache.org/jira/browse/HIVE-3705
> Project: Hive
>  Issue Type: New Feature
>  Components: Authorization, Metastore
>Reporter: Sushanth Sowmyan
>Assignee: Sushanth Sowmyan
> Attachments: HIVE-3705.D6681.1.patch, HIVE-3705.D6681.2.patch, 
> HIVE-3705.D6681.3.patch, HIVE-3705.D6681.4.patch, HIVE-3705.D6681.5.patch, 
> HIVE-3705.giant.svn.patch, hive-backend-auth.2.git.patch, 
> hive-backend-auth.git.patch, hive-backend-auth.post-review.git.patch, 
> hive-backend-auth.post-review-part2.git.patch, 
> hive-backend-auth.post-review-part3.git.patch, hivesec_investigation.pdf
>
>
> In an environment where multiple clients access a single metastore, and we 
> want to evolve hive security to a point where it's no longer simply 
> preventing users from shooting their own foot, we need to be able to 
> authorize metastore calls as well, instead of simply performing every 
> metastore api call that's made.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #223

2012-12-08 Thread Apache Jenkins Server 
See 


--
[...truncated 9916 lines...]

compile-test:
 [echo] Project: serde
[javac] Compiling 26 source files to 

[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.

create-dirs:
 [echo] Project: service
 [copy] Warning: 

 does not exist.

init:
 [echo] Project: service

ivy-init-settings:
 [echo] Project: service

ivy-resolve:
 [echo] Project: service
[ivy:resolve] :: loading settings :: file = 

[ivy:report] Processing 

 to 


ivy-retrieve:
 [echo] Project: service

compile:
 [echo] Project: service

ivy-resolve-test:
 [echo] Project: service

ivy-retrieve-test:
 [echo] Project: service

compile-test:
 [echo] Project: service
[javac] Compiling 2 source files to 


test:
 [echo] Project: hive

test-shims:
 [echo] Project: hive

test-conditions:
 [echo] Project: shims

gen-test:
 [echo] Project: shims

create-dirs:
 [echo] Project: shims
 [copy] Warning: 

 does not exist.

init:
 [echo] Project: shims

ivy-init-settings:
 [echo] Project: shims

ivy-resolve:
 [echo] Project: shims
[ivy:resolve] :: loading settings :: file = 

[ivy:report] Processing 

 to 


ivy-retrieve:
 [echo] Project: shims

compile:
 [echo] Project: shims
 [echo] Building shims 0.20

build_shims:
 [echo] Project: shims
 [echo] Compiling 

 against hadoop 0.20.2 
(

ivy-init-settings:
 [echo] Project: shims

ivy-resolve-hadoop-shim:
 [echo] Project: shims
[ivy:resolve] :: loading settings :: file = 


ivy-retrieve-hadoop-shim:
 [echo] Project: shims
 [echo] Building shims 0.20S

build_shims:
 [echo] Project: shims
 [echo] Compiling 

 against hadoop 1.0.0 
(

ivy-init-settings:
 [echo] Project: shims

ivy-resolve-hadoop-shim:
 [echo] Project: shims
[ivy:resolve] :: loading settings :: file = 


ivy-retrieve-hadoop-shim:
 [echo] Project: shims
 [echo] Building shims 0.23

build_shims:
 [echo] Project: shims
 [echo] Compiling 

 against hadoop 0.23.3 
(

[jira] [Updated] (HIVE-3782) testCliDriver_sample_islocalmode_hook fails on hadoop-1

2012-12-08 Thread Gunther Hagleitner (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gunther Hagleitner updated HIVE-3782:
-

Status: Patch Available  (was: Open)

> testCliDriver_sample_islocalmode_hook fails on hadoop-1
> ---
>
> Key: HIVE-3782
> URL: https://issues.apache.org/jira/browse/HIVE-3782
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Gunther Hagleitner
> Attachments: HIVE-3782.patch
>
>
> Actually functionality is working correctly, but incorrect include/exclude 
> macro in test directive is making its .q.out comparison against incorrect 
> results.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-3782) testCliDriver_sample_islocalmode_hook fails on hadoop-1

2012-12-08 Thread Gunther Hagleitner (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gunther Hagleitner updated HIVE-3782:
-

Attachment: HIVE-3782.patch

Adjusts the include/exclude to pick up the proper version of the test for 20S

> testCliDriver_sample_islocalmode_hook fails on hadoop-1
> ---
>
> Key: HIVE-3782
> URL: https://issues.apache.org/jira/browse/HIVE-3782
> Project: Hive
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.10.0
>Reporter: Gunther Hagleitner
> Attachments: HIVE-3782.patch
>
>
> Actually functionality is working correctly, but incorrect include/exclude 
> macro in test directive is making its .q.out comparison against incorrect 
> results.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HIVE-3782) testCliDriver_sample_islocalmode_hook fails on hadoop-1

2012-12-08 Thread Gunther Hagleitner (JIRA) 
Gunther Hagleitner created HIVE-3782:


 Summary: testCliDriver_sample_islocalmode_hook fails on hadoop-1
 Key: HIVE-3782
 URL: https://issues.apache.org/jira/browse/HIVE-3782
 Project: Hive
  Issue Type: Bug
  Components: Tests
Affects Versions: 0.10.0
Reporter: Gunther Hagleitner


Actually functionality is working correctly, but incorrect include/exclude 
macro in test directive is making its .q.out comparison against incorrect 
results.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira