date:20151001

Build failed in Jenkins: HIVE-TRUNK-JAVA8 #118

2015-10-01 Thread hiveqa

See 


Changes:

[Sergio Pena] HIVE-11940: "INSERT OVERWRITE" query is very slow because it 
creates one "distcp" per file to copy data from staging directory to target 
directory (Sergio Pena, reviewd by Ferdinand Xu)

[Jimmy Xiang] HIVE-11946: TestNotificationListener is flaky (Jimmy, reviewed by 
Sergio)

[Ashutosh Chauhan] HIVE-11132 : Queries using join and group by produce 
incorrect output when hive.auto.convert.join=false and 
hive.optimize.reducededuplication=true (Ashutosh Chauhan via Gopal V)

[Ashutosh Chauhan] HIVE-11590 : AvroDeserializer is very chatty (Swarnim 
Kulkarni via Xuefu Zhang)

[Szehon Ho] HIVE-11723 : Incorrect string literal escaping (Yongzhi Chen via 
Szehon)

[Ashutosh Chauhan] HIVE-11134 - HS2 should log open session failure (Thejas 
Nair via Vaibhav Gumashta)

[j.prasanth.j] HIVE-11945: ORC with non-local reads may not be reusing 
connection to DN (Rajesh Balamohan reviewed by Sergey Shelukhin, Prasanth 
Jayachandran)

[harisankar] HIVE-11724 : WebHcat get jobs to order jobs on time order with 
latest at top (Kiran Kumar Kolli, reviewed by Hari Subramaniyan)

[gopalv] HIVE-11468: (addendum) Vectorize Struct IN() clauses (Matt McCline, 
via Gopal V)

[sershe] HIVE-11952 : disable q tests that are both slow and less relevant 
(Sergey Shelukhin, reviewed by Sergio Peña)

[sershe] HIVE-11819 : HiveServer2 catches OOMs on request threads (Sergey 
Shelukhin, reviewed by Vaibhav Gumashta)

[pxiong] HIVE-11937: Improve StatsOptimizer to deal with query with additional 
constant columns (Pengcheng Xiong, reviewed by Ashutosh Chauhan)

[Jimmy Xiang] HIVE-11984: Add HS2 open operation metrics (Jimmy, reviewed by 
Szehon)

[ctang] HIVE-11964: RelOptHiveTable.hiveColStatsMap might contain mismatched 
column stats (Chaoyu Tang, reviewed by Laljo John Pullokkaran)

[pxiong] HIVE-11989: vector_groupby_reduce.q is failing on CLI and MiniTez 
drivers on master (Pengcheng Xiong, reviewed by Matt McCline)

[Jimmy Xiang] HIVE-11984: Add HS2 open operation metrics (addendum) (Jimmy, 
reviewed by Szehon)

[jdere] HIVE-11920: ADD JAR failing with URL schemes other than file/ivy/hdfs 
(Jason Dere, reviewed by Hari Subramaniyan)

[sershe] HIVE-11823 : create a self-contained translation for SARG to be used 
by metastore (Sergey Shelukhin, reviewed by Prasanth Jayachandran)

[jdere] HIVE-11910: TestHCatLoaderEncryption should shutdown created MiniDFS 
instance (Jason Dere, reviewed by Ashutosh Chauhan)

[Szehon Ho] HIVE-11962 : Improve windowing_windowspec2.q tests to return 
consistent results (Aihua Xu via Szehon)

[Szehon Ho] HIVE-11903 : Add lock metrics to HS2 (Yongzhi Chen via Szehon)

[sershe] HIVE-11915 : BoneCP returns closed connections from the pool (Sergey 
Shelukhin, reviewed by Thejar M Nair)

[ekoifman] HIVE-11934 Transaction lock retry logic results in infinite 
loop(Eugene Koifman, reviewed by Ashutosh Chauhan)

[ekoifman] HIVE-11916 TxnHandler.getOpenTxnsInfo() and getOpenTxns() may 
produce inconsistent result (Eugene Koifman, reviewed by Ashutosh Chauhan)

[ekoifman] HIVE-11883 'transactional' table property for ACID should be case 
insensitive (Eugene Koifman, reviewed by Ashutosh Chauhan)

[jcamacho] HIVE-11445 : CBO: Calcite Operator To Hive Operator (Calcite Return 
Path) : groupby distinct does not work (Jesus Camacho Rodriguez, reviewed by 
Pengcheng Xiong)

--
[...truncated 324 lines...]
Aptest2/src/main/java/org/apache/hive/ptest/execution/context
A
ptest2/src/main/java/org/apache/hive/ptest/execution/context/ServiceNotAvailableException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/context/ExecutionContextProvider.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/context/FixedExecutionContextProvider.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/context/CloudComputeService.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/context/CreateHostsFailedException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/context/ExecutionContext.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/context/CloudExecutionContextProvider.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/TestParser.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/Host.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/ExecutionContextConfiguration.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/TestBatch.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/UnitTestBatch.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/QFileTestBatch.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/Context.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/TestConfiguration.java
A

Re: Please review

2015-10-01 Thread Thejas Nair

sorry about the delay. added comments to the patch.


On Wed, Sep 30, 2015 at 3:20 AM, Olaf Flebbe  wrote:
> Hi,
>
> may I ask someone to review  HIVE-11175 ?
>
> Cheers
>Olaf

[jira] [Created] (HIVE-12006) Enable Columnar Pushdown for RC/ORC File for HCatLoader

2015-10-01 Thread Daniel Dai (JIRA)

Daniel Dai created HIVE-12006:
-

 Summary: Enable Columnar Pushdown for RC/ORC File for HCatLoader
 Key: HIVE-12006
 URL: https://issues.apache.org/jira/browse/HIVE-12006
 Project: Hive
  Issue Type: Improvement
  Components: HCatalog
Affects Versions: 1.2.1
Reporter: Daniel Dai
Assignee: Daniel Dai
 Fix For: 1.3.0, 2.0.0


This initially enabled by HIVE-5193. However, HIVE-10752 reverted it since 
there is issue in original implementation.

We shall fix the issue an reenable it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12007) Hive LDAP Authenticator should allow just Domain without baseDN (for AD)

2015-10-01 Thread Naveen Gangam (JIRA)

Naveen Gangam created HIVE-12007:


 Summary: Hive LDAP Authenticator should allow just Domain without 
baseDN (for AD)
 Key: HIVE-12007
 URL: https://issues.apache.org/jira/browse/HIVE-12007
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Affects Versions: 1.1.0
Reporter: Naveen Gangam
Assignee: Naveen Gangam


When the baseDN is not configured but only the Domain has been set in 
hive-site.xml, LDAP Atn provider cannot locate the user in the directory. 
Authentication fails in such cases. This is a change from the prior 
implementation where the auth request succeeds based on being able to bind to 
the directory. This has been called out in the design doc in HIVE-7193. 

But we should allow this for now for backward compatibility.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

2015-10-01 Thread Zheng Shao

Congratulations Ashutosh!

Thanks Carl for your contribution and leadership over the last few years!

Zheng


On Wed, Sep 16, 2015 at 12:50 PM, Prasanth Jayachandran <
pjayachand...@hortonworks.com> wrote:

> Congratulations Ashutosh!
>
>
>
>
>
> On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang"  > wrote:
>
> Congratulations, Ashutosh!. Well-deserved.
>
> Thanks to Carl also for the hard work in the past few years!
>
> --Xuefu
>
> On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:
>
> > I am very happy to announce that Ashutosh Chauhan is taking over as the
> > new VP of the Apache Hive project. Ashutosh has been a longtime
> contributor
> > to Hive and has played a pivotal role in many of the major advances that
> > have been made over the past couple of years. Please join me in
> > congratulating Ashutosh on his new role!
> >
>

Re: Review Request 38871: HIVE-11972

2015-10-01 Thread j . prasanth . j


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38871/#review101246
---

Ship it!


Ship It!

- Prasanth_J


On Sept. 30, 2015, 1:10 a.m., Ashutosh Chauhan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38871/
> ---
> 
> (Updated Sept. 30, 2015, 1:10 a.m.)
> 
> 
> Review request for hive and Prasanth_J.
> 
> 
> Bugs: HIVE-11972
> https://issues.apache.org/jira/browse/HIVE-11972
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> [Refactor] Improve determination of dynamic partitioning columns in FileSink 
> Operator
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java 2604d5d 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java bcf85a4 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConstantPropagateProcFactory.java
>  5c6a6df 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java 02fbdfe 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java dda28b0 
>   ql/src/java/org/apache/hadoop/hive/ql/plan/DynamicPartitionCtx.java 24db7d0 
>   ql/src/test/org/apache/hadoop/hive/ql/exec/TestFileSinkOperator.java 
> c6ae030 
> 
> Diff: https://reviews.apache.org/r/38871/diff/
> 
> 
> Testing
> ---
> 
> Existing regression suite.
> 
> 
> Thanks,
> 
> Ashutosh Chauhan
> 
>

Re: Review Request 38663: HIVE-11878

2015-10-01 Thread Ratandeep Ratti


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38663/
---

(Updated Oct. 1, 2015, 6:24 p.m.)


Review request for hive.


Summary (updated)
-

HIVE-11878


Bugs: HIVE-11878
https://issues.apache.org/jira/browse/HIVE-11878


Repository: hive-git


Description (updated)
---

HIVE-11878


Diffs (updated)
-

  .reviewboardrc abc33f91a44b76573cbba334c33417307c63956f 
  conf/ivysettings.xml bda842a89bb07710fdcd7180a00833a7388ada8f 
  itests/custom-udfs/pom.xml PRE-CREATION 
  itests/custom-udfs/udf-classloader-udf1/pom.xml PRE-CREATION 
  
itests/custom-udfs/udf-classloader-udf1/src/main/java/hive/it/custom/udfs/UDF1.java
 PRE-CREATION 
  itests/custom-udfs/udf-classloader-udf2/pom.xml PRE-CREATION 
  
itests/custom-udfs/udf-classloader-udf2/src/main/java/hive/it/custom/udfs/UDF2.java
 PRE-CREATION 
  itests/custom-udfs/udf-classloader-util/pom.xml PRE-CREATION 
  
itests/custom-udfs/udf-classloader-util/src/main/java/hive/it/custom/udfs/Util.java
 PRE-CREATION 
  itests/pom.xml acce7131948edd5aeab34af6879d781daa12ba30 
  itests/qtest/pom.xml 74ca88f586b7ff9ddc38e8bc22a9445c85790c87 
  ql/src/java/org/apache/hadoop/hive/ql/exec/UDFClassLoader.java PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 
bcf85a471c421dd0de62a894fd6c90024dff5691 
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 
dc8c336c01921c8e4ae251f3627a80ce95a66182 
  ql/src/test/queries/clientpositive/udf_classloader.q PRE-CREATION 
  
ql/src/test/queries/clientpositive/udf_classloader_dynamic_dependency_resolution.q
 PRE-CREATION 
  ql/src/test/results/clientpositive/udf_classloader.q.out PRE-CREATION 
  
ql/src/test/results/clientpositive/udf_classloader_dynamic_dependency_resolution.q.out
 PRE-CREATION 

Diff: https://reviews.apache.org/r/38663/diff/


Testing
---


Thanks,

Ratandeep Ratti

Re: Review Request 38911: Hive streaming API uses incorrect logic to assign buckets to incoming records

2015-10-01 Thread Roshan Naik


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38911/
---

(Updated Oct. 1, 2015, 8:03 p.m.)


Review request for hive.


Changes
---

regen patch without using -w


Bugs: HIVE-11983
https://issues.apache.org/jira/browse/HIVE-11983


Repository: hive-git


Description
---

Hive streaming API uses incorrect logic to assign buckets to incoming records


Diffs (updated)
-

  hcatalog/streaming/pom.xml 6d03ce1 
  
hcatalog/streaming/src/java/org/apache/hive/hcatalog/streaming/AbstractRecordWriter.java
 c959222 
  
hcatalog/streaming/src/java/org/apache/hive/hcatalog/streaming/DelimitedInputWriter.java
 6dc69f0 
  
hcatalog/streaming/src/java/org/apache/hive/hcatalog/streaming/StrictJsonWriter.java
 6d6beb8 
  
hcatalog/streaming/src/test/org/apache/hive/hcatalog/streaming/TestStreaming.java
 c28d4aa 
  
serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorUtils.java
 00a6384 

Diff: https://reviews.apache.org/r/38911/diff/


Testing
---

Added UT, changed existing UTs


Thanks,

Roshan Naik

[jira] [Created] (HIVE-12009) Add IMetastoreClient.heartbeat(long[] lockIds)

2015-10-01 Thread Eugene Koifman (JIRA)

Eugene Koifman created HIVE-12009:
-

 Summary: Add IMetastoreClient.heartbeat(long[] lockIds)
 Key: HIVE-12009
 URL: https://issues.apache.org/jira/browse/HIVE-12009
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.3.0
Reporter: Eugene Koifman
Assignee: Eugene Koifman


Current API only allows heart beating 1 lock ID (external ID) at a time.
For multi statement txns we can have multiple locks per txn and should be able 
to do it in 1 cal.

Used from DbTxnManager.heartbeat()



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12010) Tests should use FileSystem based stats collection mechanism

2015-10-01 Thread Ashutosh Chauhan (JIRA)

Ashutosh Chauhan created HIVE-12010:
---

 Summary: Tests should use FileSystem based stats collection 
mechanism
 Key: HIVE-12010
 URL: https://issues.apache.org/jira/browse/HIVE-12010
 Project: Hive
  Issue Type: Task
  Components: Statistics
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan


Although fs based collection mechanism is default for last few releases, tests 
still use jdbc for stats collection.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

2015-10-01 Thread Sergey Shelukhin


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38783/
---

(Updated Oct. 1, 2015, 9:03 p.m.)


Review request for hive, Gunther Hagleitner and Siddharth Seth.


Repository: hive-git


Description
---

See JIRA


Diffs (updated)
-

  cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java 4b52578 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 568ebbe 
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java dc8c336 

Diff: https://reviews.apache.org/r/38783/diff/


Testing
---


Thanks,

Sergey Shelukhin

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

2015-10-01 Thread Sergey Shelukhin


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38783/
---

(Updated Oct. 1, 2015, 9:04 p.m.)


Review request for hive, Gunther Hagleitner and Siddharth Seth.


Repository: hive-git


Description
---

See JIRA


Diffs (updated)
-

  cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java 4b52578 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 568ebbe 
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java dc8c336 

Diff: https://reviews.apache.org/r/38783/diff/


Testing
---


Thanks,

Sergey Shelukhin

[jira] [Created] (HIVE-12008) Make last two tests added by HIVE-11384 pass when hive.in.test is false

2015-10-01 Thread Yongzhi Chen (JIRA)

Yongzhi Chen created HIVE-12008:
---

 Summary: Make last two tests added by HIVE-11384 pass when 
hive.in.test is false
 Key: HIVE-12008
 URL: https://issues.apache.org/jira/browse/HIVE-12008
 Project: Hive
  Issue Type: Bug
Reporter: Yongzhi Chen
Assignee: Yongzhi Chen


The last two qfile unit tests fail when hive.in.test is false. It may relate 
how we handle prunelist for select. When select include every column in a 
table, the prunelist for the select is empty. It may cause issues to calculate 
its parent's prunelist.. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

2015-10-01 Thread Sergey Shelukhin



> On Sept. 30, 2015, 10:25 p.m., Siddharth Seth wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java, line 
> > 154
> > 
> >
> > Minor: Second parameter needed? Is always null

Kept it for consistency with open(), to which it is passed in some places


- Sergey


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38783/#review101167
---


On Sept. 26, 2015, 1:36 a.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38783/
> ---
> 
> (Updated Sept. 26, 2015, 1:36 a.m.)
> 
> 
> Review request for hive, Gunther Hagleitner and Siddharth Seth.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> See JIRA
> 
> 
> Diffs
> -
> 
>   cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java d62fd5c 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 568ebbe 
>   ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 014941e 
> 
> Diff: https://reviews.apache.org/r/38783/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

Re: Precommit test result post failure

2015-10-01 Thread Szehon Ho

Hm.. I'll take a look.

On Thu, Oct 1, 2015 at 2:58 PM, Prasanth Jayachandran <
pjayachand...@hortonworks.com> wrote:

> For HIVE-11928, precommit test ran but when it tried to post back the test
> result to JIRA, it failed with the following exception
>
>
> ATTACHMENT ID: 12764451 - PreCommit-HIVE-TRUNK-Build
> 2015-10-01 13:16:51,702 ERROR JIRAService.postComment:176 Encountered
> error attempting to post comment to HIVE-11928 java.lang.RuntimeException:
> 403 Forbidden
> at
> org.apache.hive.ptest.execution.JIRAService.postComment(JIRAService.java:171)
> at
> org.apache.hive.ptest.execution.PTest.publishJiraComment(PTest.java:242)
> at org.apache.hive.ptest.execution.PTest.run(PTest.java:216)
> at
> org.apache.hive.ptest.api.server.TestExecutor.run(TestExecutor.java:120)
>
> Full logs at
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5485/consoleFull
>
> Has anyone seen this recently? Is this some temporary glitch?
>
> Thanks
> Prasanth
>

Re: Precommit test result post failure

2015-10-01 Thread Prasanth Jayachandran

No problem. Thanks for looking into this!

- Prasanth

> On Oct 1, 2015, at 5:16 PM, Szehon Ho  wrote:
> 
> Yea this happened before, I answered a captcha for the HiveQA, sorry it
> might have been when I was testing adding another JIRA report about
> test-coverage that I locked out the HiveQA.  Hopefully it works.
> 
> I'll go through the missed JIRA's and post the results to everyone.
> 
> On Thu, Oct 1, 2015 at 3:09 PM, Prasanth Jayachandran <
> pjayachand...@hortonworks.com> wrote:
> 
>> I am seeing this for other issues as well
>> 
>> HIVE-11786
>> HIVE-11684
>> HIVE-11976
>> HIVE-11973
>> HIVE-11995
>> 
>> - Prasanth
>> 
>>> On Oct 1, 2015, at 5:00 PM, Szehon Ho  wrote:
>>> 
>>> Hm.. I'll take a look.
>>> 
>>> On Thu, Oct 1, 2015 at 2:58 PM, Prasanth Jayachandran <
>>> pjayachand...@hortonworks.com> wrote:
>>> 
 For HIVE-11928, precommit test ran but when it tried to post back the
>> test
 result to JIRA, it failed with the following exception
 
 
 ATTACHMENT ID: 12764451 - PreCommit-HIVE-TRUNK-Build
 2015-10-01 13:16:51,702 ERROR JIRAService.postComment:176 Encountered
 error attempting to post comment to HIVE-11928
>> java.lang.RuntimeException:
 403 Forbidden
   at
 
>> org.apache.hive.ptest.execution.JIRAService.postComment(JIRAService.java:171)
   at
 org.apache.hive.ptest.execution.PTest.publishJiraComment(PTest.java:242)
   at org.apache.hive.ptest.execution.PTest.run(PTest.java:216)
   at
 org.apache.hive.ptest.api.server.TestExecutor.run(TestExecutor.java:120)
 
 Full logs at
 
>> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5485/consoleFull
 
 Has anyone seen this recently? Is this some temporary glitch?
 
 Thanks
 Prasanth
 
>> 
>>

[jira] [Created] (HIVE-12012) select query on json table with map type column fails

2015-10-01 Thread Jagruti Varia (JIRA)

Jagruti Varia created HIVE-12012:


 Summary: select query on json table with map type column fails
 Key: HIVE-12012
 URL: https://issues.apache.org/jira/browse/HIVE-12012
 Project: Hive
  Issue Type: Bug
Reporter: Jagruti Varia
Assignee: Jason Dere


select query on json table throws this error if table contains map type column:
{noformat}
Failed with exception 
java.io.IOException:org.apache.hadoop.hive.serde2.SerDeException: 
org.codehaus.jackson.JsonParseException: Current token (FIELD_NAME) not 
numeric, can not use numeric value accessors
 at [Source: java.io.ByteArrayInputStream@295f79b; line: 1, column: 26]
{noformat}

steps to reproduce the issue:
{noformat}
hive> create table c_complex(a array,b map) row format 
serde 'org.apache.hive.hcatalog.data.JsonSerDe';
OK
Time taken: 0.319 seconds
hive> insert into table c_complex select array('aaa'),map('aaa',1) from 
studenttab10k limit 2;
Query ID = hrt_qa_20150826183232_47deb33a-19c0-4d2b-a92f-726659eb9413
Total jobs = 1
Launching Job 1 out of 1


Status: Running (Executing on YARN cluster with App id 
application_1440603993714_0010)


VERTICES  STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED

Map 1 ..   SUCCEEDED  1  100   0   0
Reducer 2 ..   SUCCEEDED  1  100   0   0

VERTICES: 02/02  [==>>] 100%  ELAPSED TIME: 11.75 s

Loading data to table default.c_complex
Table default.c_complex stats: [numFiles=1, numRows=2, totalSize=56, 
rawDataSize=0]
OK
Time taken: 13.706 seconds
hive> select * from c_complex;
OK
Failed with exception 
java.io.IOException:org.apache.hadoop.hive.serde2.SerDeException: 
org.codehaus.jackson.JsonParseException: Current token (FIELD_NAME) not 
numeric, can not use numeric value accessors
 at [Source: java.io.ByteArrayInputStream@295f79b; line: 1, column: 26]
Time taken: 0.115 seconds
hive> select count(*) from c_complex;
OK
2
Time taken: 0.205 seconds, Fetched: 1 row(s)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 37778: HIVE-11634

2015-10-01 Thread Hari Sankar Sivarama Subramaniyan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37778/
---

(Updated Oct. 1, 2015, 11:42 p.m.)


Review request for hive, Ashutosh Chauhan, Jesús Camacho Rodríguez, and John 
Pullokkaran.


Repository: hive-git


Description
---

Support partition pruning for IN(STRUCT(partcol, nonpartcol..)...)


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java dffdb5c 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java 439f616 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/PartitionColumnsSeparator.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/PointLookupOptimizer.java 
d83636d 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcFactory.java 
825938a 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/OpProcFactory.java 
7262164 
  ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java 6a31689 
  ql/src/test/queries/clientpositive/pcs.q PRE-CREATION 
  ql/src/test/queries/clientpositive/pointlookup.q 1aef2ef 
  ql/src/test/queries/clientpositive/pointlookup2.q 31bebbb 
  ql/src/test/queries/clientpositive/pointlookup3.q 3daa94b 
  ql/src/test/results/clientpositive/dynpart_sort_optimization_acid.q.out 
eca29df 
  ql/src/test/results/clientpositive/pcs.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/pointlookup.q.out 7e19be4 
  ql/src/test/results/clientpositive/pointlookup2.q.out 55edd90 
  ql/src/test/results/clientpositive/pointlookup3.q.out 4cfb97e 

Diff: https://reviews.apache.org/r/37778/diff/


Testing
---

Local testing done. More unit tests coming in the next patch.


Thanks,

Hari Sankar Sivarama Subramaniyan

Re: Precommit test result post failure

2015-10-01 Thread Prasanth Jayachandran

I am seeing this for other issues as well

HIVE-11786
HIVE-11684
HIVE-11976
HIVE-11973
HIVE-11995

- Prasanth

> On Oct 1, 2015, at 5:00 PM, Szehon Ho  wrote:
> 
> Hm.. I'll take a look.
> 
> On Thu, Oct 1, 2015 at 2:58 PM, Prasanth Jayachandran <
> pjayachand...@hortonworks.com> wrote:
> 
>> For HIVE-11928, precommit test ran but when it tried to post back the test
>> result to JIRA, it failed with the following exception
>> 
>> 
>> ATTACHMENT ID: 12764451 - PreCommit-HIVE-TRUNK-Build
>> 2015-10-01 13:16:51,702 ERROR JIRAService.postComment:176 Encountered
>> error attempting to post comment to HIVE-11928 java.lang.RuntimeException:
>> 403 Forbidden
>>at
>> org.apache.hive.ptest.execution.JIRAService.postComment(JIRAService.java:171)
>>at
>> org.apache.hive.ptest.execution.PTest.publishJiraComment(PTest.java:242)
>>at org.apache.hive.ptest.execution.PTest.run(PTest.java:216)
>>at
>> org.apache.hive.ptest.api.server.TestExecutor.run(TestExecutor.java:120)
>> 
>> Full logs at
>> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5485/consoleFull
>> 
>> Has anyone seen this recently? Is this some temporary glitch?
>> 
>> Thanks
>> Prasanth
>>

[jira] [Created] (HIVE-12011) unable to create temporary table using CTAS if regular table with that name already exists

2015-10-01 Thread Pengcheng Xiong (JIRA)

Pengcheng Xiong created HIVE-12011:
--

 Summary: unable to create temporary table using CTAS if regular 
table with that name already exists
 Key: HIVE-12011
 URL: https://issues.apache.org/jira/browse/HIVE-12011
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong


CTAS temporary table query fails if regular table with the same name already 
exists. 
Steps to reproduce the issue:
{noformat}
hive> use dbtemptable;
OK
Time taken: 0.273 seconds
hive> create table a(i int);
OK
Time taken: 0.297 seconds
hive> create temporary table a(i int);
OK
Time taken: 0.165 seconds
hive> create table b(i int);
OK
Time taken: 0.212 seconds
hive> create temporary table b as select * from a;
FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: 
Table already exists: dbtemptable.b
hive> create table c(i int);
OK
Time taken: 0.264 seconds
hive> create temporary table b as select * from c;
FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: 
Table already exists: dbtemptable.b
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 37778: HIVE-11634

2015-10-01 Thread John Pullokkaran


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37778/#review101292
---



ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcFactory.java 
(line 372)


1. The check "children.size() < 2" is either unnecessary or we have a bug 
some where else.
2. We should also remove single col in clause where col is partition col


- John Pullokkaran


On Oct. 1, 2015, 11:42 p.m., Hari Sankar Sivarama Subramaniyan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37778/
> ---
> 
> (Updated Oct. 1, 2015, 11:42 p.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan, Jesús Camacho Rodríguez, and John 
> Pullokkaran.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Support partition pruning for IN(STRUCT(partcol, nonpartcol..)...)
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java dffdb5c 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java 439f616 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/PartitionColumnsSeparator.java
>  PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/PointLookupOptimizer.java 
> d83636d 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/pcr/PcrExprProcFactory.java 
> 825938a 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/OpProcFactory.java 
> 7262164 
>   ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java 6a31689 
>   ql/src/test/queries/clientpositive/pcs.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/pointlookup.q 1aef2ef 
>   ql/src/test/queries/clientpositive/pointlookup2.q 31bebbb 
>   ql/src/test/queries/clientpositive/pointlookup3.q 3daa94b 
>   ql/src/test/results/clientpositive/dynpart_sort_optimization_acid.q.out 
> eca29df 
>   ql/src/test/results/clientpositive/pcs.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/pointlookup.q.out 7e19be4 
>   ql/src/test/results/clientpositive/pointlookup2.q.out 55edd90 
>   ql/src/test/results/clientpositive/pointlookup3.q.out 4cfb97e 
> 
> Diff: https://reviews.apache.org/r/37778/diff/
> 
> 
> Testing
> ---
> 
> Local testing done. More unit tests coming in the next patch.
> 
> 
> Thanks,
> 
> Hari Sankar Sivarama Subramaniyan
> 
>

Precommit test result post failure

2015-10-01 Thread Prasanth Jayachandran

For HIVE-11928, precommit test ran but when it tried to post back the test 
result to JIRA, it failed with the following exception


ATTACHMENT ID: 12764451 - PreCommit-HIVE-TRUNK-Build
2015-10-01 13:16:51,702 ERROR JIRAService.postComment:176 Encountered error 
attempting to post comment to HIVE-11928 java.lang.RuntimeException: 403 
Forbidden
at 
org.apache.hive.ptest.execution.JIRAService.postComment(JIRAService.java:171)
at 
org.apache.hive.ptest.execution.PTest.publishJiraComment(PTest.java:242)
at org.apache.hive.ptest.execution.PTest.run(PTest.java:216)
at 
org.apache.hive.ptest.api.server.TestExecutor.run(TestExecutor.java:120)

Full logs at 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5485/consoleFull

Has anyone seen this recently? Is this some temporary glitch?

Thanks
Prasanth

Re: Precommit test result post failure

2015-10-01 Thread Szehon Ho

Yea this happened before, I answered a captcha for the HiveQA, sorry it
might have been when I was testing adding another JIRA report about
test-coverage that I locked out the HiveQA.  Hopefully it works.

I'll go through the missed JIRA's and post the results to everyone.

On Thu, Oct 1, 2015 at 3:09 PM, Prasanth Jayachandran <
pjayachand...@hortonworks.com> wrote:

> I am seeing this for other issues as well
>
> HIVE-11786
> HIVE-11684
> HIVE-11976
> HIVE-11973
> HIVE-11995
>
> - Prasanth
>
> > On Oct 1, 2015, at 5:00 PM, Szehon Ho  wrote:
> >
> > Hm.. I'll take a look.
> >
> > On Thu, Oct 1, 2015 at 2:58 PM, Prasanth Jayachandran <
> > pjayachand...@hortonworks.com> wrote:
> >
> >> For HIVE-11928, precommit test ran but when it tried to post back the
> test
> >> result to JIRA, it failed with the following exception
> >>
> >>
> >> ATTACHMENT ID: 12764451 - PreCommit-HIVE-TRUNK-Build
> >> 2015-10-01 13:16:51,702 ERROR JIRAService.postComment:176 Encountered
> >> error attempting to post comment to HIVE-11928
> java.lang.RuntimeException:
> >> 403 Forbidden
> >>at
> >>
> org.apache.hive.ptest.execution.JIRAService.postComment(JIRAService.java:171)
> >>at
> >> org.apache.hive.ptest.execution.PTest.publishJiraComment(PTest.java:242)
> >>at org.apache.hive.ptest.execution.PTest.run(PTest.java:216)
> >>at
> >> org.apache.hive.ptest.api.server.TestExecutor.run(TestExecutor.java:120)
> >>
> >> Full logs at
> >>
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/5485/consoleFull
> >>
> >> Has anyone seen this recently? Is this some temporary glitch?
> >>
> >> Thanks
> >> Prasanth
> >>
>
>

Review Request 38940: unable to create temporary table using CTAS if regular table with that name already exists

2015-10-01 Thread pengcheng xiong


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38940/
---

Review request for hive, Ashutosh Chauhan and John Pullokkaran.


Repository: hive-git


Description
---

CTAS temporary table query fails if regular table with the same name already 
exists. 
Steps to reproduce the issue:
{noformat}
hive> use dbtemptable;
OK
Time taken: 0.273 seconds
hive> create table a(i int);
OK
Time taken: 0.297 seconds
hive> create temporary table a(i int);
OK
Time taken: 0.165 seconds
hive> create table b(i int);
OK
Time taken: 0.212 seconds
hive> create temporary table b as select * from a;
FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: 
Table already exists: dbtemptable.b
hive> create table c(i int);
OK
Time taken: 0.264 seconds
hive> create temporary table b as select * from c;
FAILED: SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: 
Table already exists: dbtemptable.b
{noformat}


Diffs
-

  
ql/src/java/org/apache/hadoop/hive/ql/metadata/SessionHiveMetaStoreClient.java 
51ff262 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 4bec228 
  ql/src/test/queries/clientpositive/temp_table.q e587f3f 
  ql/src/test/results/clientpositive/spark/temp_table.q.out 65e256d 
  ql/src/test/results/clientpositive/temp_table.q.out e2987fe 
  ql/src/test/results/clientpositive/tez/temp_table.q.out 49f57c2 

Diff: https://reviews.apache.org/r/38940/diff/


Testing
---


Thanks,

pengcheng xiong

Review Request 38946: Need review the fix for HIVE-11973

2015-10-01 Thread Yongzhi Chen


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38946/
---

Review request for hive, Chao Sun, Chaoyu Tang, and Szehon Ho.


Repository: hive-git


Description
---

HIVE-11973: IN operator fails when the column type is DATE


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java 
218b2df3e6bf4d8094d01cf0c78934324a04f1b1 
  ql/src/test/queries/clientpositive/selectindate.q PRE-CREATION 
  ql/src/test/results/clientpositive/selectindate.q.out PRE-CREATION 

Diff: https://reviews.apache.org/r/38946/diff/


Testing
---

Add new qfile test for the issue and run pre-commit build


Thanks,

Yongzhi Chen

[jira] [Created] (HIVE-12014) re-enable most LLAP tests after merge

2015-10-01 Thread Sergey Shelukhin (JIRA)

Sergey Shelukhin created HIVE-12014:
---

 Summary: re-enable most LLAP tests after merge
 Key: HIVE-12014
 URL: https://issues.apache.org/jira/browse/HIVE-12014
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin


see HIVE-12013



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12013) LLAP: disable most llap tests before merge

2015-10-01 Thread Sergey Shelukhin (JIRA)

Sergey Shelukhin created HIVE-12013:
---

 Summary: LLAP: disable most llap tests before merge
 Key: HIVE-12013
 URL: https://issues.apache.org/jira/browse/HIVE-12013
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin


Tests cannot be parallelized before we merge, and tests cannot run fast enough 
(they did once, so I guess cannot always run fast enough) when they are not 
parallelized.
LLAP is off by default, we did see tests pass recently (with the exception of a 
few out file diffs), and some tests will still be run. 
We will disable most of the LLAP q tests for now, merge, enable paralllelism 
and re-enable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12015) LLAP: merge master into branch

2015-10-01 Thread Sergey Shelukhin (JIRA)

Sergey Shelukhin created HIVE-12015:
---

 Summary: LLAP: merge master into branch
 Key: HIVE-12015
 URL: https://issues.apache.org/jira/browse/HIVE-12015
 Project: Hive
  Issue Type: Sub-task
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin
 Fix For: llap






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12016) Update log4j2 version to 2.4

2015-10-01 Thread Prasanth Jayachandran (JIRA)

Prasanth Jayachandran created HIVE-12016:


 Summary: Update log4j2 version to 2.4
 Key: HIVE-12016
 URL: https://issues.apache.org/jira/browse/HIVE-12016
 Project: Hive
  Issue Type: Sub-task
Affects Versions: 2.0.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran


The latest 2.4 release of log4j2 brought back properties file based 
configuration. https://logging.apache.org/log4j/2.0/changes-report.html#a2.4

bump up the version number to 2.4. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: HIVE-TRUNK-JAVA8 #118

Re: Please review

[jira] [Created] (HIVE-12006) Enable Columnar Pushdown for RC/ORC File for HCatLoader

[jira] [Created] (HIVE-12007) Hive LDAP Authenticator should allow just Domain without baseDN (for AD)

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Re: Review Request 38871: HIVE-11972

Re: Review Request 38663: HIVE-11878

Re: Review Request 38911: Hive streaming API uses incorrect logic to assign buckets to incoming records

[jira] [Created] (HIVE-12009) Add IMetastoreClient.heartbeat(long[] lockIds)

[jira] [Created] (HIVE-12010) Tests should use FileSystem based stats collection mechanism

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

[jira] [Created] (HIVE-12008) Make last two tests added by HIVE-11384 pass when hive.in.test is false

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

Re: Precommit test result post failure

Re: Precommit test result post failure

[jira] [Created] (HIVE-12012) select query on json table with map type column fails

Re: Review Request 37778: HIVE-11634

Re: Precommit test result post failure

[jira] [Created] (HIVE-12011) unable to create temporary table using CTAS if regular table with that name already exists

Re: Review Request 37778: HIVE-11634

Precommit test result post failure

Re: Precommit test result post failure

Review Request 38940: unable to create temporary table using CTAS if regular table with that name already exists

Review Request 38946: Need review the fix for HIVE-11973

[jira] [Created] (HIVE-12014) re-enable most LLAP tests after merge

[jira] [Created] (HIVE-12013) LLAP: disable most llap tests before merge

[jira] [Created] (HIVE-12015) LLAP: merge master into branch

[jira] [Created] (HIVE-12016) Update log4j2 version to 2.4

29 matches

Site Navigation

Mail list logo

Footer information