[jira] [Commented] (HIVE-7011) HiveInputFormat's split generation isn't thread safe

2014-05-04 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988933#comment-13988933
 ] 

Hive QA commented on HIVE-7011:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12643168/HIVE-7011.1.patch

{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 5430 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_filter_join_breaktask
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby2_map_skew
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_list_bucket
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_dynamic_partitions_with_whitelist
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/119/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/119/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12643168

 HiveInputFormat's split generation isn't thread safe
 

 Key: HIVE-7011
 URL: https://issues.apache.org/jira/browse/HIVE-7011
 Project: Hive
  Issue Type: Bug
  Components: Tez
Affects Versions: 0.13.0, 0.14.0
Reporter: Gunther Hagleitner
Assignee: Gunther Hagleitner
 Attachments: HIVE-7011.1.patch


 Tez will do split generation in parallel. Need to protect the inputformat 
 cache against concurrent access.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HIVE-6355) sql std auth - document configuration necessary for security

2014-05-04 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988947#comment-13988947
 ] 

Lefty Leverenz commented on HIVE-6355:
--

+1

 sql std auth - document configuration necessary for security
 

 Key: HIVE-6355
 URL: https://issues.apache.org/jira/browse/HIVE-6355
 Project: Hive
  Issue Type: Sub-task
  Components: Authorization, Documentation, Security, 
 SQLStandardAuthorization
Reporter: Thejas M Nair
Assignee: Thejas M Nair
   Original Estimate: 12h
  Remaining Estimate: 12h

 Document parameters such as the authorization provider to be used, hive 
 config restricted config value.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HIVE-5823) Support for DECIMAL primitive type in AvroSerDe

2014-05-04 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988955#comment-13988955
 ] 

Hive QA commented on HIVE-5823:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12643228/HIVE-5823.6.patch

{color:red}ERROR:{color} -1 due to 13 failed/errored test(s), 5435 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_avro_decimal
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_avro_schema_literal
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby2_map_skew
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_list_bucket
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_dynamic_partitions_with_whitelist
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_stats_partialscan_autogether
org.apache.hadoop.hive.serde2.avro.TestAvroSerializer.canSerializeDecimals
org.apache.hadoop.hive.serde2.avro.TestAvroSerializer.canSerializeListOfDecimals
org.apache.hadoop.hive.serde2.avro.TestAvroSerializer.canSerializeMapOfDecimals
org.apache.hadoop.hive.serde2.avro.TestAvroSerializer.canSerializeNullableDecimals
org.apache.hadoop.hive.serde2.avro.TestAvroSerializer.canSerializeUnions
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/120/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/120/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 13 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12643228

 Support for DECIMAL primitive type in AvroSerDe
 ---

 Key: HIVE-5823
 URL: https://issues.apache.org/jira/browse/HIVE-5823
 Project: Hive
  Issue Type: New Feature
  Components: Serializers/Deserializers
Affects Versions: 0.12.0
Reporter: Mariano Dominguez
Assignee: Xuefu Zhang
  Labels: avro, serde
 Attachments: HIVE-5823.1.patch, HIVE-5823.2.patch, HIVE-5823.3.patch, 
 HIVE-5823.4.patch, HIVE-5823.5.patch, HIVE-5823.6.patch, HIVE-5823.patch, 
 dec.avro


 This new feature request would be tied to AVRO-1402.
 Adding DECIMAL support would be particularly interesting when converting 
 types from Avro to Hive, since DECIMAL is already a supported data type in 
 Hive.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-5823) Support for DECIMAL primitive type in AvroSerDe

2014-05-04 Thread Xuefu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xuefu Zhang updated HIVE-5823:
--

Attachment: HIVE-5823.7.patch

 Support for DECIMAL primitive type in AvroSerDe
 ---

 Key: HIVE-5823
 URL: https://issues.apache.org/jira/browse/HIVE-5823
 Project: Hive
  Issue Type: New Feature
  Components: Serializers/Deserializers
Affects Versions: 0.12.0
Reporter: Mariano Dominguez
Assignee: Xuefu Zhang
  Labels: avro, serde
 Attachments: HIVE-5823.1.patch, HIVE-5823.2.patch, HIVE-5823.3.patch, 
 HIVE-5823.4.patch, HIVE-5823.5.patch, HIVE-5823.6.patch, HIVE-5823.7.patch, 
 HIVE-5823.patch, dec.avro


 This new feature request would be tied to AVRO-1402.
 Adding DECIMAL support would be particularly interesting when converting 
 types from Avro to Hive, since DECIMAL is already a supported data type in 
 Hive.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


Re: Review Request 20826: HIVE-5823: Support for DECIMAL primitive type in AvroSerDe

2014-05-04 Thread Xuefu Zhang

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20826/
---

(Updated May 4, 2014, 2:02 p.m.)


Review request for hive.


Bugs: HIVE-5823
https://issues.apache.org/jira/browse/HIVE-5823


Repository: hive-git


Description
---

Support decimal type in Avro storage. The implemenation is based on 
specifications detailed in AVRO-1402.


Diffs (updated)
-

  data/files/dec.txt PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/io/avro/AvroGenericRecordReader.java 
52a22e5 
  ql/src/test/queries/clientpositive/avro_decimal.q PRE-CREATION 
  ql/src/test/queries/clientpositive/avro_schema_literal.q d77f310 
  ql/src/test/results/clientpositive/avro_decimal.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/avro_schema_literal.q.out ca945d5 
  serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroDeserializer.java 
a28861f 
  
serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroGenericRecordWritable.java
 8beffd7 
  serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerDe.java 92799ed 
  serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java 9d58d13 
  serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerializer.java b2c58c7 
  serde/src/java/org/apache/hadoop/hive/serde2/avro/SchemaToTypeInfo.java 
251f04f 
  serde/src/test/org/apache/hadoop/hive/serde2/avro/TestAvroSerializer.java 
b3559ea 
  
serde/src/test/org/apache/hadoop/hive/serde2/avro/TestGenericAvroRecordWritable.java
 a0e5018 
  serde/src/test/org/apache/hadoop/hive/serde2/avro/Utils.java d5730fa 

Diff: https://reviews.apache.org/r/20826/diff/


Testing
---

Unit tests are added. Test suite passed.


Thanks,

Xuefu Zhang



[jira] [Updated] (HIVE-6996) FS based stats broken with indexed tables

2014-05-04 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-6996:
---

   Resolution: Fixed
Fix Version/s: 0.14.0
   Status: Resolved  (was: Patch Available)

Committed to trunk.

 FS based stats broken with indexed tables
 -

 Key: HIVE-6996
 URL: https://issues.apache.org/jira/browse/HIVE-6996
 Project: Hive
  Issue Type: Bug
  Components: Indexing, Statistics
Affects Versions: 0.13.0
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 0.14.0

 Attachments: HIVE-6996.2.patch, HIVE-6996.patch






--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7008) Clean-up some old dead code

2014-05-04 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-7008:
---

   Resolution: Fixed
Fix Version/s: 0.14.0
   Status: Resolved  (was: Patch Available)

Committed to trunk. 

 Clean-up some old dead code
 ---

 Key: HIVE-7008
 URL: https://issues.apache.org/jira/browse/HIVE-7008
 Project: Hive
  Issue Type: Task
  Components: Tests
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 0.14.0

 Attachments: HIVE-7008.1.patch, HIVE-7008.patch


 There is some code to workaround limitations in historic Hadoop (hadoop-17  
 earlier). Lets get rid of those.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-6960) Set Hive pom to use Hadoop-2.4

2014-05-04 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-6960:
---

   Resolution: Fixed
Fix Version/s: 0.14.0
   Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks, Jason!

 Set Hive pom to use Hadoop-2.4
 --

 Key: HIVE-6960
 URL: https://issues.apache.org/jira/browse/HIVE-6960
 Project: Hive
  Issue Type: Bug
  Components: Build Infrastructure
Affects Versions: 0.14.0
Reporter: Jason Dere
Assignee: Jason Dere
 Fix For: 0.14.0

 Attachments: HIVE-6960.1.patch, HIVE-6960.1.patch, HIVE-6960.2.patch


 A number of the hadoop-2 unit test failures are due to HADOOP-10425, fixed in 
 Hadoop 2.4.  Perhaps we should move onto that version.
 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nullgroup3
 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_join4
 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_select_dummy_source
 - 
 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_symlink_text_input_format
 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_current_database
 - 
 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketizedhiveinputformat



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-7004) Fix more unit test failures on hadoop-2

2014-05-04 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-7004:
---

   Resolution: Fixed
Fix Version/s: 0.14.0
   Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks, Jason!

 Fix more unit test failures on hadoop-2
 ---

 Key: HIVE-7004
 URL: https://issues.apache.org/jira/browse/HIVE-7004
 Project: Hive
  Issue Type: Bug
  Components: Tests
Reporter: Jason Dere
Assignee: Jason Dere
 Fix For: 0.14.0

 Attachments: HIVE-7004.1.patch


 Still a number of precommit failures with hadoop-2, will try to fix some of 
 them.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HIVE-6374) Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly

2014-05-04 Thread Benjamin Zhitomirsky (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Benjamin Zhitomirsky updated HIVE-6374:
---

Status: Patch Available  (was: In Progress)

 Hive job submitted with non-default name node (fs.default.name) doesn't 
 process locations properly 
 ---

 Key: HIVE-6374
 URL: https://issues.apache.org/jira/browse/HIVE-6374
 Project: Hive
  Issue Type: Bug
  Components: CLI
Affects Versions: 0.12.0, 0.11.0, 0.13.0
 Environment: Any
Reporter: Benjamin Zhitomirsky
Assignee: Benjamin Zhitomirsky
 Attachments: Design of the fix HIVE-6374.docx, hive-6374.1.patch, 
 hive-6374.3.patch, hive-6374.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 Create table/index/database and add partition DDL doesn't work properly if 
 all following conditions are true:
 - Metastore service is used
 - fs.default.name is specified and it differs from the default one
 - Location is not specified or specified as a not fully qualified URI
 The root cause of this behavior is that Hive client doesn't pass 
 configuration context to the metastore services which tries to resolve the 
 paths. The fix is it too resolve the path in the Hive client if 
 fs.default.name is specified and it differs from the default one (it is must 
 easier then start passing the context, which would be a major change).
 The CR will submitted shortly after tests are done



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HIVE-5823) Support for DECIMAL primitive type in AvroSerDe

2014-05-04 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989080#comment-13989080
 ] 

Hive QA commented on HIVE-5823:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12643269/HIVE-5823.7.patch

{color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 5435 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_avro_decimal
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby2_map_skew
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_list_bucket
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_dynamic_partitions_with_whitelist
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_stats_partialscan_autogether
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/121/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/121/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 7 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12643269

 Support for DECIMAL primitive type in AvroSerDe
 ---

 Key: HIVE-5823
 URL: https://issues.apache.org/jira/browse/HIVE-5823
 Project: Hive
  Issue Type: New Feature
  Components: Serializers/Deserializers
Affects Versions: 0.12.0
Reporter: Mariano Dominguez
Assignee: Xuefu Zhang
  Labels: avro, serde
 Attachments: HIVE-5823.1.patch, HIVE-5823.2.patch, HIVE-5823.3.patch, 
 HIVE-5823.4.patch, HIVE-5823.5.patch, HIVE-5823.6.patch, HIVE-5823.7.patch, 
 HIVE-5823.patch, dec.avro


 This new feature request would be tied to AVRO-1402.
 Adding DECIMAL support would be particularly interesting when converting 
 types from Avro to Hive, since DECIMAL is already a supported data type in 
 Hive.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HIVE-7010) templeton/v1/queue REST method has been removed

2014-05-04 Thread Eugene Koifman (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989102#comment-13989102
 ] 

Eugene Koifman commented on HIVE-7010:
--

+1
Thanks!

 templeton/v1/queue REST method has been removed
 ---

 Key: HIVE-7010
 URL: https://issues.apache.org/jira/browse/HIVE-7010
 Project: Hive
  Issue Type: Bug
  Components: Documentation, WebHCat
Affects Versions: 0.14.0
Reporter: Eugene Koifman
Assignee: Lefty Leverenz

 deprecated queue REST method was removed from WebHCat in HIVE-6432.  jobs 
 is the replacement.
 https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference needs to 
 be updated



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HIVE-6765) ASTNodeOrigin unserializable leads to fail when join with view

2014-05-04 Thread Chris Drome (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989148#comment-13989148
 ] 

Chris Drome commented on HIVE-6765:
---

[~adrian-wang] this does not appear to be an issue with hive-0.13 as they are 
using Kryo for XML serialization.

For clarification, I found that several setting can impact whether this problem 
arises or not. hive.auto.convert.join.noconditionaltask.size is used to 
determine the big table candidate set. Then hive.mapjoin.smalltable.filesize is 
used as a cutoff to determine whether a map-size join should be performed.

I found that when hive.auto.convert.join is true, it will try to perform a 
map-side join first. Based on hive.auto.convert.join.noconditionaltask.size it 
will return a set of big table candidates to the physical optimizer. The 
physical optimizer will use hive.mapjoin.smalltable.filesize to determine 
whether the map-side join should proceed. If not the clonePlan method is 
called, which manifests the problem. I don't think it is solely influenced by 
the size of the tables involved in the join. In my tests, shrinking the size of 
the table allows the map-side join to proceed, while increasing the size of the 
table causes this failure.

 ASTNodeOrigin unserializable leads to fail when join with view
 --

 Key: HIVE-6765
 URL: https://issues.apache.org/jira/browse/HIVE-6765
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Adrian Wang
 Fix For: 0.13.0

 Attachments: HIVE-6765.patch.1


 when a view contains a UDF, and the view comes into a JOIN operation, Hive 
 will encounter a bug with stack trace like
 Caused by: java.lang.InstantiationException: 
 org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
   at java.lang.Class.newInstance0(Class.java:359)
   at java.lang.Class.newInstance(Class.java:327)
   at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source)
   at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:616)



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HIVE-6374) Hive job submitted with non-default name node (fs.default.name) doesn't process locations properly

2014-05-04 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989185#comment-13989185
 ] 

Hive QA commented on HIVE-6374:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12642627/hive-6374.3.patch

{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 5496 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_insert1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_load_dyn_part1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dml
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_union
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/122/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/122/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12642627

 Hive job submitted with non-default name node (fs.default.name) doesn't 
 process locations properly 
 ---

 Key: HIVE-6374
 URL: https://issues.apache.org/jira/browse/HIVE-6374
 Project: Hive
  Issue Type: Bug
  Components: CLI
Affects Versions: 0.11.0, 0.12.0, 0.13.0
 Environment: Any
Reporter: Benjamin Zhitomirsky
Assignee: Benjamin Zhitomirsky
 Attachments: Design of the fix HIVE-6374.docx, hive-6374.1.patch, 
 hive-6374.3.patch, hive-6374.patch

   Original Estimate: 168h
  Remaining Estimate: 168h

 Create table/index/database and add partition DDL doesn't work properly if 
 all following conditions are true:
 - Metastore service is used
 - fs.default.name is specified and it differs from the default one
 - Location is not specified or specified as a not fully qualified URI
 The root cause of this behavior is that Hive client doesn't pass 
 configuration context to the metastore services which tries to resolve the 
 paths. The fix is it too resolve the path in the Hive client if 
 fs.default.name is specified and it differs from the default one (it is must 
 easier then start passing the context, which would be a major change).
 The CR will submitted shortly after tests are done



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HIVE-7010) templeton/v1/queue REST method has been removed

2014-05-04 Thread Larry McCay (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989202#comment-13989202
 ] 

Larry McCay commented on HIVE-7010:
---

Hi [~leftylev] - I am curious whether the v1 is going to be bumped up to v2 in 
response to the contract change. I believe that it is easier for consuming 
projects - such as Apache Knox - to be able to multiplex across expected APIs 
with specific version indicators.


 templeton/v1/queue REST method has been removed
 ---

 Key: HIVE-7010
 URL: https://issues.apache.org/jira/browse/HIVE-7010
 Project: Hive
  Issue Type: Bug
  Components: Documentation, WebHCat
Affects Versions: 0.14.0
Reporter: Eugene Koifman
Assignee: Lefty Leverenz

 deprecated queue REST method was removed from WebHCat in HIVE-6432.  jobs 
 is the replacement.
 https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference needs to 
 be updated



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HIVE-6826) Hive-tez has issues when different partitions work off of different input types

2014-05-04 Thread Gunther Hagleitner (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989218#comment-13989218
 ] 

Gunther Hagleitner commented on HIVE-6826:
--

LGTM +1. There are two small review items, but I can fix those up when checking 
in.

 Hive-tez has issues when different partitions work off of different input 
 types
 ---

 Key: HIVE-6826
 URL: https://issues.apache.org/jira/browse/HIVE-6826
 Project: Hive
  Issue Type: Bug
  Components: Tez
Affects Versions: 0.13.0, 0.14.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
 Attachments: HIVE-6826.1.patch, HIVE-6826.2.patch


 create table test (key int, value string) partitioned by (p int) stored as 
 textfile;
 insert into table test partition (p=1) select * from src limit 10;
 alter table test set fileformat orc;
 insert into table test partition (p=2) select * from src limit 10;
 describe test;
 select * from test where p=1 and key  0;
 select * from test where p=2 and key  0;
 select * from test where key  0;
 throws a classcast exception



--
This message was sent by Atlassian JIRA
(v6.2#6252)


Is there a bug in hiveserver2 metastore caused hold huge objects

2014-05-04 Thread Meng QingPing
I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the heap
dump show huge objects hold by org.datanucleus.api.jdo.
JDOPersistenceManagerFactory as attached. It seems not release
org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is 0.13.

Thanks,
Jack


[jira] [Commented] (HIVE-6765) ASTNodeOrigin unserializable leads to fail when join with view

2014-05-04 Thread Adrian Wang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989287#comment-13989287
 ] 

Adrian Wang commented on HIVE-6765:
---

[~cdrome] good catch. I knew the serialization in Hive has been notorious for a 
long time, but I didn't know the progress they made there. Actually, I was real 
curious when I saw my case was OK with Tez with hive-0.13, while I never tried 
Apache's hive-0.13 since there was no official release.

 ASTNodeOrigin unserializable leads to fail when join with view
 --

 Key: HIVE-6765
 URL: https://issues.apache.org/jira/browse/HIVE-6765
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Adrian Wang
 Fix For: 0.13.0

 Attachments: HIVE-6765.patch.1


 when a view contains a UDF, and the view comes into a JOIN operation, Hive 
 will encounter a bug with stack trace like
 Caused by: java.lang.InstantiationException: 
 org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
   at java.lang.Class.newInstance0(Class.java:359)
   at java.lang.Class.newInstance(Class.java:327)
   at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source)
   at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:616)



--
This message was sent by Atlassian JIRA
(v6.2#6252)