date:20160107

[jira] [Created] (HIVE-12807) Thrift and DB Changes for HIVE-12352

2016-01-07 Thread Alan Gates (JIRA)

Alan Gates created HIVE-12807:
-

 Summary: Thrift and DB Changes for HIVE-12352
 Key: HIVE-12807
 URL: https://issues.apache.org/jira/browse/HIVE-12807
 Project: Hive
  Issue Type: Sub-task
  Components: Metastore
Affects Versions: 1.0.0
Reporter: Alan Gates
Assignee: Alan Gates


This ticket just covers the thrift and DB changes necessary for HIVE-12352



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12808) Logical PPD: Push filter clauses through PTF into TS

2016-01-07 Thread Gopal V (JIRA)

Gopal V created HIVE-12808:
--

 Summary: Logical PPD: Push filter clauses through PTF into TS
 Key: HIVE-12808
 URL: https://issues.apache.org/jira/browse/HIVE-12808
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer
Affects Versions: 1.2.1, 2.0.0
Reporter: Gopal V


Simplified repro case, with the slow query showing the push-down miss. 

And the manually rewritten query to indicate the expected one.

Part of the problem could be the window range not being split apart for PPD, 
but the FIL is not pushed down even if the rownum filter is removed.

{code}
create temporary table positions (regionid string, id bigint, deviceid string, 
ts string);

insert into positions values('1d6a0be1-6366-4692-9597-ebd5cd0f01d1', 
1422792010, '6c5d1a30-2331-448b-a726-a380d6b3a432', '2016-01-01'),
('1d6a0be1-6366-4692-9597-ebd5cd0f01d1', 1422792010, 
'6c5d1a30-2331-448b-a726-a380d6b3a432', '2016-01-01'),
('1d6a0be1-6366-4692-9597-ebd5cd0f01d1', 1422792010, 
'6c5d1a30-2331-448b-a726-a380d6b3a432', '2016-01-02'),
('1d6a0be1-6366-4692-9597-ebd5cd0f01d1', 1422792010, 
'6c5d1a30-2331-448b-a726-a380d6b3a432', '2016-01-02');


-- slow query

WITH t1 AS 
( 
 SELECT   *, 
  Row_number() over ( PARTITION BY regionid, id, deviceid ORDER 
BY ts DESC) AS rownos
 FROM positions ), 
latestposition as ( 
   SELECT * 
   FROM   t1 
   WHERE  rownos = 1) 
SELECT * 
FROM   latestposition 
WHERE  regionid='1d6a0be1-6366-4692-9597-ebd5cd0f01d1' 
ANDid=1422792010 
ANDdeviceid='6c5d1a30-2331-448b-a726-a380d6b3a432';

-- fast query

WITH t1 AS 
( 
 SELECT   *, 
  Row_number() over ( PARTITION BY regionid, id, deviceid ORDER 
BY ts DESC) AS rownos
 FROM positions 
 WHERE  regionid='1d6a0be1-6366-4692-9597-ebd5cd0f01d1' 
 ANDid=1422792010 
 ANDdeviceid='6c5d1a30-2331-448b-a726-a380d6b3a432'
),latestposition as ( 
   SELECT * 
   FROM   t1 
   WHERE  rownos = 1) 
SELECT * 
FROM   latestposition 
;
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: HiveQA fails due to full disk

2016-01-07 Thread Sergey Shelukhin

Thanks!

On 16/1/7, 11:24, "Szehon Ho"  wrote:

>Just cleaned up some space by deleting old build logs, hope it goes
>through
>now.
>
>On Thu, Jan 7, 2016 at 10:36 AM, Sergey Shelukhin 
>wrote:
>
>> Looks like lots of builds are failing with:
>> fatal: sha1 file '.git/objects/pack/tmp_pack_nm4WS4' write error: No
>>space
>> left on device
>>
>> The last one I see is
>> 
>>http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-H
>>IV
>> E-TRUNK-Build/6541/console; I had the same failure in some other JIRA.
>>
>>

Build failed in Jenkins: HIVE-TRUNK-JAVA8 #152

2016-01-07 Thread hiveqa

See 


Changes:

[sershe] HIVE-12717 : Enabled to accept quoting of all character backslash 
qooting mechanism to json_tuple UDTF (Cazen Lee, reviewed by Sergey Shelukhin)

[sershe] HIVE-6113 : Upgrade DataNucleus [was: Unable to instantiate 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient] (Oleksiy Sayankin, 
reviewed by Sergey Shelukhin)

[jdere] HIVE-12706: Incorrect output from from_utc_timestamp()/to_utc_timestamp 
when local timezone has DST (Jason Dere, reviewed by Ashutosh Chauhan)

[jdere] HIVE-12502: to_date UDF cannot accept NULLs of VOID type (Aaron Tokhy 
via Jason Dere)

[pxiong] HIVE-12782: update the golden files for some tests that fail 
(Pengcheng Xiong, reviewed by Ashutosh Chauhan)

[thejas] HIVE-12766 : TezTask does not close DagClient after execution (Thejas 
Nair, reviewed by Vikram Dixit, Gunther Hagleitner)

[sershe] HIVE-12597 : LLAP - allow using elevator without cache (Sergey 
Shelukhin, reviewed by Prasanth Jayachandran)

[pxiong] HIVE-12793: Address TestSparkCliDriver.testCliDriver_order2 failure 
due to HIVE-12782 (Pengcheng Xiong, reviewed by Ashutosh Chauhan)

[Sergio Pena] HIVE-12796: Switch to 32-bits containers for HMS upgrade tests.

--
[...truncated 310 lines...]
A
ptest2/src/test/java/org/apache/hive/ptest/execution/conf/TestQFileTestBatch.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/conf/TestTestConfiguration.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestPrepPhase.testExecute.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestPhase.testRsyncFromLocalToRemoteInstancesWithFailureOne.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestExecutionPhase.testFailingUnitTest.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestHostExecutor.testIsolatedFailsOnRsyncOne.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestPhase.testExecInstancesWithFailure.approved.txt
Aptest2/src/test/java/org/apache/hive/ptest/execution/ssh
A
ptest2/src/test/java/org/apache/hive/ptest/execution/ssh/TestSSHCommandExecutor.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/ssh/TestRSyncCommandExecutor.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestScripts.testBatch.approved.txt
Aptest2/src/test/java/org/apache/hive/ptest/execution/AbstractTestPhase.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestExecutionPhase.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestExecutionPhase.testPassingQFileTest.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/MockSSHCommandExecutor.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/MockRSyncCommandExecutor.java
Aptest2/src/test/java/org/apache/hive/ptest/execution/TestReportParser.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestReportingPhase.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestExecutionPhase.testFailingQFile.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/MockLocalCommandFactory.java
Aptest2/src/test/java/org/apache/hive/ptest/execution/TestHostExecutor.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestHostExecutor.testIsolatedFailsOnExec.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestExecutionPhase.testPassingUnitTest.approved.txt
Aptest2/src/test/java/org/apache/hive/ptest/execution/TestJIRAService.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestReportingPhase.testExecute.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestHostExecutor.testShutdownBeforeExec.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestScripts.testPrepGit.approved.txt
Aptest2/src/test/java/org/apache/hive/ptest/execution/ExtendedAssert.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestPhase.testRsyncFromLocalToRemoteInstancesWithFailureUnknown.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestHostExecutor.testParallelFailsOnExec.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestPhase.testExecHostsWithFailure.approved.txt
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestCleanupPhase.testExecute.approved.txt
Aptest2/src/test/java/org/apache/hive/ptest/execution/TestPrepPhase.java
Aptest2/src/test/java/org/apache/hive/ptest/execution/TestScripts.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestHostExecutor.testIsolatedFailsOnRsyncUnknown.approved.txt
Aptest2/src/test/java/org/apache/hive/ptest/execution/TestLocalCommand.java
A
ptest2/src/test/java/org/apache/hive/ptest/execution/TestHostExecutor.testBasic.approved.txt
A

[jira] [Created] (HIVE-12809) Vectorization: fast-path for coalesce if input.noNulls = true

2016-01-07 Thread Gopal V (JIRA)

Gopal V created HIVE-12809:
--

 Summary: Vectorization: fast-path for coalesce if input.noNulls = 
true
 Key: HIVE-12809
 URL: https://issues.apache.org/jira/browse/HIVE-12809
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.0.0, 2.1.0
Reporter: Gopal V
Assignee: Gopal V


Coalesce can skip processing a column, if all the input columns are non-null.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 41928: HIVE-12777: Add capability to restore session

2016-01-07 Thread Rajat Khandelwal


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41928/
---

(Updated Jan. 8, 2016, 12:22 p.m.)


Review request for hive.


Bugs: HIVE-12777
https://issues.apache.org/jira/browse/HIVE-12777


Repository: hive-git


Description
---

Extensions using Hive session handles should be able to restore the hive 
session from the handle. 

Apache Lens depends on a fork of hive and that fork has such a capability. 

Relevant commit: 
https://github.com/InMobi/hive/commit/931fe9116161a18952c082c14223ad6745fefe00#diff-0acb35f7cab7492f522b0c40ce3ce1be


Diffs (updated)
-

  
itests/hive-unit/src/test/java/org/apache/hive/service/cli/TestEmbeddedThriftBinaryCLIService.java
 de66d9efb1cace9d32174e3020920d5e4002dc85 
  service/if/TCLIService.thrift baf583fb3ecd4a0ab248540ffb5db57100028968 
  service/src/java/org/apache/hive/service/cli/CLIService.java 
adc98098437b2d0429dd2af40d8eaae323fbf3f0 
  service/src/java/org/apache/hive/service/cli/CLIServiceClient.java 
3155c238ff688bfea16b0aaeea950599bb659b5b 
  service/src/java/org/apache/hive/service/cli/EmbeddedCLIServiceClient.java 
9cad5be198c063115a8e90c67b1c2fd910ca8bc6 
  service/src/java/org/apache/hive/service/cli/ICLIService.java 
c9cc1f4da56f1cd10f6348ea2b9e17e203b87664 
  service/src/java/org/apache/hive/service/cli/SessionHandle.java 
52e0ad4834d8b44d5038bb5c1a851eb702cd38ca 
  service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 
50c912ee606bce73f447fba69ce0f57d8c7fc6c9 
  service/src/java/org/apache/hive/service/cli/session/SessionManager.java 
637cdca3bcea9d320f397de032fd78d59ce6afef 
  
service/src/java/org/apache/hive/service/cli/thrift/RetryingThriftCLIServiceClient.java
 529eaa45d29d22e0e80ea2c08a27b84f2909eda3 
  service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
8434965e87366e86d27685c5ca70ee904446bae9 
  
service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java 
1af45398b895cd7616c5627d318422e14b81e734 
  service/src/test/org/apache/hive/service/cli/CLIServiceTest.java 
e78181a15993d99f1cab5a061c08bb21823d2171 

Diff: https://reviews.apache.org/r/41928/diff/


Testing
---


Thanks,

Rajat Khandelwal

Re: Review Request 41928: HIVE-12777: Add capability to restore session

2016-01-07 Thread Rajat Khandelwal



> On Jan. 7, 2016, 10:17 a.m., Amareshwari Sriramadasu wrote:
> > service/src/test/org/apache/hive/service/cli/CLIServiceTest.java, line 91
> > 
> >
> > Restoring a closed session? I dont think this should be allowed.
> > 
> > The test should wrt service restart and restore session.
> 
> Rajat Khandelwal wrote:
> This test class is abstract, the functionality can't be tested here. Can 
> you suggest another class where I can add such a test?

Added an abstract `restart` method in the abstract test class. The restore test 
uses that. Hope that is enough.


- Rajat


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41928/#review113180
---


On Jan. 8, 2016, 12:22 p.m., Rajat Khandelwal wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41928/
> ---
> 
> (Updated Jan. 8, 2016, 12:22 p.m.)
> 
> 
> Review request for hive.
> 
> 
> Bugs: HIVE-12777
> https://issues.apache.org/jira/browse/HIVE-12777
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Extensions using Hive session handles should be able to restore the hive 
> session from the handle. 
> 
> Apache Lens depends on a fork of hive and that fork has such a capability. 
> 
> Relevant commit: 
> https://github.com/InMobi/hive/commit/931fe9116161a18952c082c14223ad6745fefe00#diff-0acb35f7cab7492f522b0c40ce3ce1be
> 
> 
> Diffs
> -
> 
>   
> itests/hive-unit/src/test/java/org/apache/hive/service/cli/TestEmbeddedThriftBinaryCLIService.java
>  de66d9efb1cace9d32174e3020920d5e4002dc85 
>   service/if/TCLIService.thrift baf583fb3ecd4a0ab248540ffb5db57100028968 
>   service/src/java/org/apache/hive/service/cli/CLIService.java 
> adc98098437b2d0429dd2af40d8eaae323fbf3f0 
>   service/src/java/org/apache/hive/service/cli/CLIServiceClient.java 
> 3155c238ff688bfea16b0aaeea950599bb659b5b 
>   service/src/java/org/apache/hive/service/cli/EmbeddedCLIServiceClient.java 
> 9cad5be198c063115a8e90c67b1c2fd910ca8bc6 
>   service/src/java/org/apache/hive/service/cli/ICLIService.java 
> c9cc1f4da56f1cd10f6348ea2b9e17e203b87664 
>   service/src/java/org/apache/hive/service/cli/SessionHandle.java 
> 52e0ad4834d8b44d5038bb5c1a851eb702cd38ca 
>   service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 
> 50c912ee606bce73f447fba69ce0f57d8c7fc6c9 
>   service/src/java/org/apache/hive/service/cli/session/SessionManager.java 
> 637cdca3bcea9d320f397de032fd78d59ce6afef 
>   
> service/src/java/org/apache/hive/service/cli/thrift/RetryingThriftCLIServiceClient.java
>  529eaa45d29d22e0e80ea2c08a27b84f2909eda3 
>   service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
> 8434965e87366e86d27685c5ca70ee904446bae9 
>   
> service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java
>  1af45398b895cd7616c5627d318422e14b81e734 
>   service/src/test/org/apache/hive/service/cli/CLIServiceTest.java 
> e78181a15993d99f1cab5a061c08bb21823d2171 
> 
> Diff: https://reviews.apache.org/r/41928/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Rajat Khandelwal
> 
>

Re: Review Request 40867: HIVE-11527 - bypass HiveServer2 thrift interface for query results

2016-01-07 Thread Takanobu Asanuma


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40867/
---

(Updated 1月 8, 2016, 7:18 a.m.)


Review request for hive.


Changes
---

two addtinal updates for bypass
1. handle complex type such as array, struct and map.
2. handle Statement#setFetchSize.


Repository: hive-git


Description
---

This is a WIP patch for HIVE-11527

* I added a new configuration whose name is 
hive.server2.webhdfs.bypass.enabled. The default is false. When this value is 
true, clients use the bypass.

* I still have not considered security such as Kerberos and SSL at present.

* I have not implement Statement#setFetchSize for bypass yet.


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 479fa46 
  jdbc/src/java/org/apache/hive/jdbc/HiveQueryResultSet.java 245c6a3 
  jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java 3f9024a 
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java 29e6315 
  ql/src/java/org/apache/hadoop/hive/ql/exec/FetchTask.java 1634143 
  service/if/TCLIService.thrift baf583f 
  service/src/gen/thrift/gen-cpp/TCLIService_types.h b078c99 
  service/src/gen/thrift/gen-cpp/TCLIService_types.cpp b852379 
  
service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TColumnDesc.java
 b01fadb 
  
service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TExecuteStatementResp.java
 0b9aa0f 
  
service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TProtocolVersion.java
 c936ada 
  service/src/gen/thrift/gen-py/TCLIService/ttypes.py ef5f5f5 
  service/src/gen/thrift/gen-rb/t_c_l_i_service_types.rb f004ec4 
  service/src/java/org/apache/hive/service/cli/CLIService.java adc9809 
  service/src/java/org/apache/hive/service/cli/ColumnDescriptor.java f0bbf14 
  service/src/java/org/apache/hive/service/cli/operation/Operation.java d2b3f9c 
  service/src/java/org/apache/hive/service/cli/operation/OperationManager.java 
92135cd 
  service/src/java/org/apache/hive/service/cli/operation/SQLOperation.java 
2eaab4a 
  service/src/java/org/apache/hive/service/cli/session/HiveSession.java 4f4e92d 
  service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 
50c912e 
  service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
8434965 

Diff: https://reviews.apache.org/r/40867/diff/


Testing
---

I have tested few simple queries and they worked well. But I think there are 
some problems for some queries. I'm going to test more queries and fix bugs. 
I'm also going to add unit tests.


Thanks,

Takanobu Asanuma

[jira] [Created] (HIVE-12800) HiveFilterSetOpTransposeRule might be executed over non deterministic filter predicates

2016-01-07 Thread Jesus Camacho Rodriguez (JIRA)

Jesus Camacho Rodriguez created HIVE-12800:
--

 Summary: HiveFilterSetOpTransposeRule might be executed over non 
deterministic filter predicates
 Key: HIVE-12800
 URL: https://issues.apache.org/jira/browse/HIVE-12800
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.0.0, 2.1.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12801) document HIVE-11500 (metadata cache in HBase metastore)

2016-01-07 Thread Sergey Shelukhin (JIRA)

Sergey Shelukhin created HIVE-12801:
---

 Summary: document HIVE-11500 (metadata cache in HBase metastore)
 Key: HIVE-12801
 URL: https://issues.apache.org/jira/browse/HIVE-12801
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: HiveQA fails due to full disk

2016-01-07 Thread Szehon Ho

Just cleaned up some space by deleting old build logs, hope it goes through
now.

On Thu, Jan 7, 2016 at 10:36 AM, Sergey Shelukhin 
wrote:

> Looks like lots of builds are failing with:
> fatal: sha1 file '.git/objects/pack/tmp_pack_nm4WS4' write error: No space
> left on device
>
> The last one I see is
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIV
> E-TRUNK-Build/6541/console; I had the same failure in some other JIRA.
>
>

[jira] [Created] (HIVE-12802) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver.vector_join_filters.q failure

2016-01-07 Thread Hari Sankar Sivarama Subramaniyan (JIRA)

Hari Sankar Sivarama Subramaniyan created HIVE-12802:


 Summary: CBO: Calcite Operator To Hive Operator (Calcite Return 
Path): MiniTezCliDriver.vector_join_filters.q failure
 Key: HIVE-12802
 URL: https://issues.apache.org/jira/browse/HIVE-12802
 Project: Hive
  Issue Type: Bug
  Components: CBO
Reporter: Hari Sankar Sivarama Subramaniyan
Assignee: Hari Sankar Sivarama Subramaniyan


Discovered as part of running :
mvn test -Dtest=TestMiniTezCliDriver -Dqfile_regex=vector.* 
-Dhive.cbo.returnpath.hiveop=true -Dtest.output.overwrite=true

{code}
2016-01-07T11:16:06,198 ERROR [657fd759-7643-467b-9bd0-17cb4958cb69 main[]]: 
parse.CalcitePlanner (CalcitePlanner.java:genOPTree(309)) - CBO failed, 
skipping CBO.
java.lang.IndexOutOfBoundsException: index (10) must be less than size (6)
at 
com.google.common.base.Preconditions.checkElementIndex(Preconditions.java:305) 
~[guava-14.0.1.jar:?]
at 
com.google.common.base.Preconditions.checkElementIndex(Preconditions.java:284) 
~[guava-14.0.1.jar:?]
at 
com.google.common.collect.RegularImmutableList.get(RegularImmutableList.java:81)
 ~[guava-14.0.1.jar:?]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.ExprNodeConverter.visitInputRef(ExprNodeConverter.java:109)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.ExprNodeConverter.visitInputRef(ExprNodeConverter.java:79)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at org.apache.calcite.rex.RexInputRef.accept(RexInputRef.java:112) 
~[calcite-core-1.5.0.jar:1.5.0]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.ExprNodeConverter.visitCall(ExprNodeConverter.java:128)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.ExprNodeConverter.visitCall(ExprNodeConverter.java:79)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at org.apache.calcite.rex.RexCall.accept(RexCall.java:107) 
~[calcite-core-1.5.0.jar:1.5.0]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.convertToExprNode(HiveOpConverter.java:1153)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.translateJoin(HiveOpConverter.java:381)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.visit(HiveOpConverter.java:313)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.dispatch(HiveOpConverter.java:164)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.visit(HiveOpConverter.java:268)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.dispatch(HiveOpConverter.java:162)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.visit(HiveOpConverter.java:397)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.dispatch(HiveOpConverter.java:181)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.convert(HiveOpConverter.java:154)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedHiveOPDag(CalcitePlanner.java:688)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:266)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10094)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:231)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:237)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:471) 
[hive-exec-2.1.0-SNAPSHOT.jar:?]
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 41297: HIVE-12590

2016-01-07 Thread John Pullokkaran


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41297/#review113337
---

Ship it!


Ship It!

- John Pullokkaran


On Jan. 7, 2016, 9:17 p.m., Ashutosh Chauhan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41297/
> ---
> 
> (Updated Jan. 7, 2016, 9:17 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Bugs: HIVE-12590
> https://issues.apache.org/jira/browse/HIVE-12590
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Repeated UDAFs with literals can produce incorrect result
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/ASTNode.java b96e2eb 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/RowResolver.java 891b1f7 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java ab9271f 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java 
> 9d8b352 
>   ql/src/test/queries/clientpositive/groupby_duplicate_key.q 7f38efe 
>   ql/src/test/results/clientpositive/case_sensitivity.q.out a5b14e8 
>   ql/src/test/results/clientpositive/groupby_duplicate_key.q.out fc95f41 
>   
> ql/src/test/results/clientpositive/tez/schema_evol_orc_acid_mapwork_table.q.out
>  0317a99 
>   
> ql/src/test/results/clientpositive/tez/schema_evol_orc_acidvec_mapwork_table.q.out
>  3edaff0 
> 
> Diff: https://reviews.apache.org/r/41297/diff/
> 
> 
> Testing
> ---
> 
> Added new test
> 
> 
> Thanks,
> 
> Ashutosh Chauhan
> 
>

Re: Review Request 41297: HIVE-12590

2016-01-07 Thread John Pullokkaran


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41297/#review113329
---



ql/src/java/org/apache/hadoop/hive/ql/parse/ASTNode.java (line 245)


May be use a local var to store the str value; this way we could avoid 
duplicating logic at 2 places ?


- John Pullokkaran


On Jan. 7, 2016, 9:17 p.m., Ashutosh Chauhan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41297/
> ---
> 
> (Updated Jan. 7, 2016, 9:17 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Bugs: HIVE-12590
> https://issues.apache.org/jira/browse/HIVE-12590
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Repeated UDAFs with literals can produce incorrect result
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/ASTNode.java b96e2eb 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/RowResolver.java 891b1f7 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java ab9271f 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java 
> 9d8b352 
>   ql/src/test/queries/clientpositive/groupby_duplicate_key.q 7f38efe 
>   ql/src/test/results/clientpositive/case_sensitivity.q.out a5b14e8 
>   ql/src/test/results/clientpositive/groupby_duplicate_key.q.out fc95f41 
>   
> ql/src/test/results/clientpositive/tez/schema_evol_orc_acid_mapwork_table.q.out
>  0317a99 
>   
> ql/src/test/results/clientpositive/tez/schema_evol_orc_acidvec_mapwork_table.q.out
>  3edaff0 
> 
> Diff: https://reviews.apache.org/r/41297/diff/
> 
> 
> Testing
> ---
> 
> Added new test
> 
> 
> Thanks,
> 
> Ashutosh Chauhan
> 
>

Re: Review Request 41984: HIVE-12762: Common join on parquet tables returns incorrect result when hive.optimize.index.filter set to true

2016-01-07 Thread Sergio Pena


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41984/#review113327
---

Ship it!


Ship It!

- Sergio Pena


On Jan. 6, 2016, 4:52 p.m., Aihua Xu wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41984/
> ---
> 
> (Updated Jan. 6, 2016, 4:52 p.m.)
> 
> 
> Review request for hive, Sergio Pena and Xuefu Zhang.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-12762: Common join on parquet tables returns incorrect result when 
> hive.optimize.index.filter set to true
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 
> 9a7d990baaabfde8e564f00bb1fcfe30cd16dc90 
>   ql/src/java/org/apache/hadoop/hive/ql/io/parquet/ProjectionPusher.java 
> 017676bec2163f04fb95f43224a4f8743fa49f55 
>   ql/src/test/queries/clientpositive/parquet_join2.q PRE-CREATION 
>   ql/src/test/results/clientpositive/parquet_join2.q.out PRE-CREATION 
>   storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/ExpressionTree.java 
> 577d95d1a15a54c2804349b3e5e68d83b72df664 
>   
> storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgumentImpl.java
>  eeff131cbc14d7ef554517109612ae7d891f8003 
> 
> Diff: https://reviews.apache.org/r/41984/diff/
> 
> 
> Testing
> ---
> 
> We have two issues: 1. We are filtering the parquet columns based on the last 
> filter condition in the query. So if the query contains multiple instances of 
> the same table, e.g., join on the same table with different filter 
> conditions, then we could get incorrect result; 2. rewriteLeaves 
> implementation in SearchArgumentImpl is not accurate since the different 
> leaves could be sharing the same object. The current implementation could 
> change the leave index multiple times to an incorrect value.
> 
> The patch will merge all the filter conditions (create OR expression on all 
> the filters) so that the columns which will be used during operator won't be 
> filtered during earlier splitting stage. rewriteLeaves is reimplemented to 
> get all the unique leaves first and replace in place.
> 
> 
> Thanks,
> 
> Aihua Xu
> 
>

[jira] [Created] (HIVE-12804) if JAVA_HOME is not set, LLapServiceGen should fail

2016-01-07 Thread Sergey Shelukhin (JIRA)

Sergey Shelukhin created HIVE-12804:
---

 Summary: if JAVA_HOME is not set, LLapServiceGen should fail
 Key: HIVE-12804
 URL: https://issues.apache.org/jira/browse/HIVE-12804
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin


Right now, a bogus value results, probably coming from a python None, probably 
from this line:
{noformat}
"java_home" : os.getenv("JAVA_HOME"),
{noformat}
{noformat}
$ echo $JAVA_HOME

$ grep java_home llap-slider-07Jan2016/appConfig.json 
"java_home": "None",
{noformat}





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 41297: HIVE-12590

2016-01-07 Thread Ashutosh Chauhan


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41297/
---

(Updated Jan. 7, 2016, 9:17 p.m.)


Review request for hive and John Pullokkaran.


Bugs: HIVE-12590
https://issues.apache.org/jira/browse/HIVE-12590


Repository: hive-git


Description
---

Repeated UDAFs with literals can produce incorrect result


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/parse/ASTNode.java b96e2eb 
  ql/src/java/org/apache/hadoop/hive/ql/parse/RowResolver.java 891b1f7 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java ab9271f 
  ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java 9d8b352 
  ql/src/test/queries/clientpositive/groupby_duplicate_key.q 7f38efe 
  ql/src/test/results/clientpositive/case_sensitivity.q.out a5b14e8 
  ql/src/test/results/clientpositive/groupby_duplicate_key.q.out fc95f41 
  
ql/src/test/results/clientpositive/tez/schema_evol_orc_acid_mapwork_table.q.out 
0317a99 
  
ql/src/test/results/clientpositive/tez/schema_evol_orc_acidvec_mapwork_table.q.out
 3edaff0 

Diff: https://reviews.apache.org/r/41297/diff/


Testing
---

Added new test


Thanks,

Ashutosh Chauhan

[jira] [Created] (HIVE-12803) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver count.q failure

2016-01-07 Thread Hari Sankar Sivarama Subramaniyan (JIRA)

Hari Sankar Sivarama Subramaniyan created HIVE-12803:


 Summary: CBO: Calcite Operator To Hive Operator (Calcite Return 
Path): MiniTezCliDriver count.q failure
 Key: HIVE-12803
 URL: https://issues.apache.org/jira/browse/HIVE-12803
 Project: Hive
  Issue Type: Sub-task
Reporter: Hari Sankar Sivarama Subramaniyan
Assignee: Hari Sankar Sivarama Subramaniyan


{code}
select a, count(distinct b), count(distinct c), sum(d) from abcd group by a;
{code}

Set hive.cbo.returnpath.hiveop=true;

{code}
java.lang.IndexOutOfBoundsException: Index: 5, Size: 5
at java.util.ArrayList.rangeCheck(ArrayList.java:635) ~[?:1.7.0_79]
at java.util.ArrayList.get(ArrayList.java:411) ~[?:1.7.0_79]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveGBOpConvUtil.genReduceSideGB1NoMapGB(HiveGBOpConvUtil.java:1060)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveGBOpConvUtil.genNoMapSideGBNoSkew(HiveGBOpConvUtil.java:473)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveGBOpConvUtil.translateGB(HiveGBOpConvUtil.java:304)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.visit(HiveOpConverter.java:398)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.dispatch(HiveOpConverter.java:181)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.optimizer.calcite.translator.HiveOpConverter.convert(HiveOpConverter.java:154)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedHiveOPDag(CalcitePlanner.java:688)
 ~[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:266)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10094)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:231)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:237)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:74)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:237)
 [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:471) 
[hive-exec-2.1.0-SNAPSHOT.jar:?]
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:311) 
[hive-exec-2.1.0-SNAPSHOT.jar:?]
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1149) 
[hive-exec-2.1.0-SNAPSHOT.jar:?]
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1237) 
[hive-exec-2.1.0-SNAPSHOT.jar:?]
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12805) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver skewjoin.q failure

2016-01-07 Thread Hari Sankar Sivarama Subramaniyan (JIRA)

Hari Sankar Sivarama Subramaniyan created HIVE-12805:


 Summary: CBO: Calcite Operator To Hive Operator (Calcite Return 
Path): MiniTezCliDriver skewjoin.q failure
 Key: HIVE-12805
 URL: https://issues.apache.org/jira/browse/HIVE-12805
 Project: Hive
  Issue Type: Sub-task
Reporter: Hari Sankar Sivarama Subramaniyan
Assignee: Hari Sankar Sivarama Subramaniyan


Set hive.cbo.returnpath.hiveop=true
{code}
FROM T1 a FULL OUTER JOIN T2 c ON c.key+1=a.key SELECT /*+ STREAMTABLE(a) */ 
sum(hash(a.key)), sum(hash(a.val)), sum(hash(c.key))
{code}

The stack trace:
{code}
java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
at java.util.ArrayList.rangeCheck(ArrayList.java:635)
at java.util.ArrayList.get(ArrayList.java:411)
at 
org.apache.hadoop.hive.ql.ppd.SyntheticJoinPredicate$JoinSynthetic.process(SyntheticJoinPredicate.java:183)
at 
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
at 
org.apache.hadoop.hive.ql.lib.PreOrderOnceWalker.walk(PreOrderOnceWalker.java:43)
at 
org.apache.hadoop.hive.ql.lib.PreOrderOnceWalker.walk(PreOrderOnceWalker.java:54)
at 
org.apache.hadoop.hive.ql.lib.PreOrderOnceWalker.walk(PreOrderOnceWalker.java:54)
at 
org.apache.hadoop.hive.ql.lib.PreOrderOnceWalker.walk(PreOrderOnceWalker.java:54)
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:120)
at 
org.apache.hadoop.hive.ql.ppd.SyntheticJoinPredicate.transform(SyntheticJoinPredicate.java:100)
at 
org.apache.hadoop.hive.ql.optimizer.Optimizer.optimize(Optimizer.java:236)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10170)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:231)
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:237)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:471)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12806) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver vector_auto_smb_mapjoin_14.q failure

2016-01-07 Thread Hari Sankar Sivarama Subramaniyan (JIRA)

Hari Sankar Sivarama Subramaniyan created HIVE-12806:


 Summary: CBO: Calcite Operator To Hive Operator (Calcite Return 
Path): MiniTezCliDriver vector_auto_smb_mapjoin_14.q failure
 Key: HIVE-12806
 URL: https://issues.apache.org/jira/browse/HIVE-12806
 Project: Hive
  Issue Type: Sub-task
Reporter: Hari Sankar Sivarama Subramaniyan


Step to reproduce:
mvn test -Dtest=TestMiniTezCliDriver -Dqfile=vector_auto_smb_mapjoin_14.q 
-Dhive.cbo.returnpath.hiveop=true -Dtest.output.overwrite=true

Query :
{code}
select count(*) from (
  select a.key as key, a.value as val1, b.value as val2 from tbl1 a join tbl2 b 
on a.key = b.key
) subq1
{code}

Stack trace :
{code}
2016-01-07T14:08:04,803 ERROR [da534038-d792-4d16-86e9-87b9f971adda main[]]: 
SessionState (SessionState.java:printError(1010)) - Vertex failed, 
vertexName=Map 1, vertexId=vertex_1452204324051_0001_33_00, diagnostics=[Vertex 
vertex_1452204324051_0001_33_00 [Map 1] k\
illed/failed due to:AM_USERCODE_FAILURE, Exception in VertexManager, 
vertex:vertex_1452204324051_0001_33_00 [Map 1], java.lang.RuntimeException: 
java.lang.RuntimeException: Failed to load plan: null: 
java.lang.IllegalArgumentException: java.net.URISyntaxException: \
Relative path in absolute URI: subq1:amerge.xml
at 
org.apache.hadoop.hive.ql.exec.tez.CustomPartitionVertex.onRootVertexInitialized(CustomPartitionVertex.java:314)
at 
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEventRootInputInitialized.invoke(VertexManager.java:624)
at 
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:645)
at 
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:640)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at 
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:640)
at 
org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:629)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Failed to load plan: null: 
java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path 
in absolute URI: subq1:amerge.xml
at 
org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:451)
at 
org.apache.hadoop.hive.ql.exec.Utilities.getMergeWork(Utilities.java:339)
at 
org.apache.hadoop.hive.ql.exec.tez.SplitGrouper.populateMapWork(SplitGrouper.java:260)
at 
org.apache.hadoop.hive.ql.exec.tez.SplitGrouper.generateGroupedSplits(SplitGrouper.java:172)
at 
org.apache.hadoop.hive.ql.exec.tez.CustomPartitionVertex.onRootVertexInitialized(CustomPartitionVertex.java:277)
... 12 more
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: 
Relative path in absolute URI: subq1:amerge.xml
at org.apache.hadoop.fs.Path.initialize(Path.java:206)
at org.apache.hadoop.fs.Path.(Path.java:172)
at org.apache.hadoop.fs.Path.(Path.java:94)
at 
org.apache.hadoop.hive.ql.exec.Utilities.getPlanPath(Utilities.java:588)
at 
org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:387)
... 16 more
Caused by: java.net.URISyntaxException: Relative path in absolute URI: 
subq1:amerge.xml
at java.net.URI.checkPath(URI.java:1804)
at java.net.URI.(URI.java:752)
at org.apache.hadoop.fs.Path.initialize(Path.java:203)
... 20 more
]
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12807) Thrift and DB Changes for HIVE-12352

[jira] [Created] (HIVE-12808) Logical PPD: Push filter clauses through PTF into TS

Re: HiveQA fails due to full disk

Build failed in Jenkins: HIVE-TRUNK-JAVA8 #152

[jira] [Created] (HIVE-12809) Vectorization: fast-path for coalesce if input.noNulls = true

Re: Review Request 41928: HIVE-12777: Add capability to restore session

Re: Review Request 41928: HIVE-12777: Add capability to restore session

Re: Review Request 40867: HIVE-11527 - bypass HiveServer2 thrift interface for query results

[jira] [Created] (HIVE-12800) HiveFilterSetOpTransposeRule might be executed over non deterministic filter predicates

[jira] [Created] (HIVE-12801) document HIVE-11500 (metadata cache in HBase metastore)

Re: HiveQA fails due to full disk

[jira] [Created] (HIVE-12802) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver.vector_join_filters.q failure

Re: Review Request 41297: HIVE-12590

Re: Review Request 41297: HIVE-12590

Re: Review Request 41984: HIVE-12762: Common join on parquet tables returns incorrect result when hive.optimize.index.filter set to true

[jira] [Created] (HIVE-12804) if JAVA_HOME is not set, LLapServiceGen should fail

Re: Review Request 41297: HIVE-12590

[jira] [Created] (HIVE-12803) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver count.q failure

[jira] [Created] (HIVE-12805) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver skewjoin.q failure

[jira] [Created] (HIVE-12806) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver vector_auto_smb_mapjoin_14.q failure

20 matches

Site Navigation

Mail list logo

Footer information