[jira] [Created] (HIVE-11665) ORC StringDictionaryReader should not used Chunked buffers

2015-08-26 Thread Gopal V (JIRA)
Gopal V created HIVE-11665:
--

 Summary: ORC StringDictionaryReader should not used Chunked buffers
 Key: HIVE-11665
 URL: https://issues.apache.org/jira/browse/HIVE-11665
 Project: Hive
  Issue Type: Improvement
  Components: File Formats
Affects Versions: 1.3.0, 2.0.0
Reporter: Gopal V
Assignee: Prasanth Jayachandran


ORC String Dictionary Reader is slow due to the chunking of the input stream.

{code}
 private void readDictionaryStream(InStream in) throws IOException {
  if (in != null) { // Guard against empty dictionary stream.
if (in.available() > 0) {
  dictionaryBuffer = new DynamicByteArray(64, in.available());
  dictionaryBuffer.readAll(in);
  // Since its start of strip invalidate the cache.
  dictionaryBufferInBytesCache = null;
}
in.close();
  } else {
dictionaryBuffer = null;
  }
}
{code}

The fact that the data is chunked offers no advantage for the read-path where 
there is no grow() operation for memory savings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11664) Make tez container logs work with new log4j2 changes

2015-08-26 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-11664:


 Summary: Make tez container logs work with new log4j2 changes
 Key: HIVE-11664
 URL: https://issues.apache.org/jira/browse/HIVE-11664
 Project: Hive
  Issue Type: Sub-task
Reporter: Prasanth Jayachandran


MiniTezCliDriver should log container logs to syslog file. With new log4j2 
changes this file is not created anymore. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11663) Auto load/unload custom udf function for hive cli and hiveserver2

2015-08-26 Thread liuzongquan (JIRA)
liuzongquan created HIVE-11663:
--

 Summary: Auto load/unload custom udf function for hive cli and 
hiveserver2
 Key: HIVE-11663
 URL: https://issues.apache.org/jira/browse/HIVE-11663
 Project: Hive
  Issue Type: Improvement
  Components: CLI, Configuration
Affects Versions: 1.2.1, 1.1.1, 1.0.1, 1.0.0, 0.14.0
Reporter: liuzongquan
Assignee: liuzongquan






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11662) DP cannot be applied to external table which contains part-spec like directory

2015-08-26 Thread Navis (JIRA)
Navis created HIVE-11662:


 Summary: DP cannot be applied to external table which contains 
part-spec like directory
 Key: HIVE-11662
 URL: https://issues.apache.org/jira/browse/HIVE-11662
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Navis
Assignee: Navis
Priority: Trivial


Some users want to use part-spec like directory name in their partitioned table 
locations, something like,
{noformat}
/something/warehouse/some_key=some_value
{noformat}

DP calculates additional partitions from full path, and makes exception 
something like,
{noformat}
Failed with exception Partition spec {some_key=some_value, part_key=part_value} 
contains non-partition columns
FAILED: Execution Error, return code 1 from 
org.apache.hadoop.hive.ql.exec.MoveTask
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11661) LLAP: update some out files

2015-08-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11661:
---

 Summary: LLAP: update some out files
 Key: HIVE-11661
 URL: https://issues.apache.org/jira/browse/HIVE-11661
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11660) LLAP: TestTaskExecutorService is flaky again

2015-08-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11660:
---

 Summary: LLAP: TestTaskExecutorService is flaky again
 Key: HIVE-11660
 URL: https://issues.apache.org/jira/browse/HIVE-11660
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Siddharth Seth


{noformat}
java.lang.Exception: test timed out after 1 milliseconds
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at 
org.apache.hadoop.hive.llap.daemon.impl.TestTaskExecutorService$TaskExecutorServiceForTest$InternalCompletionListenerForTest.awaitCompletion(TestTaskExecutorService.java:244)
at 
org.apache.hadoop.hive.llap.daemon.impl.TestTaskExecutorService$TaskExecutorServiceForTest$InternalCompletionListenerForTest.access$000(TestTaskExecutorService.java:208)
at 
org.apache.hadoop.hive.llap.daemon.impl.TestTaskExecutorService.testWaitQueuePreemption(TestTaskExecutorService.java:168)
{noformat}

Cannot repro locally. See HIVE-11642



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 37706: HIVE-11593 Add aes_encrypt and aes_decrypt UDFs

2015-08-26 Thread Alexander Pivovarov

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37706/
---

(Updated Aug. 27, 2015, 1:53 a.m.)


Review request for hive and Jason Dere.


Changes
---

move Cipher.getInstance to initialize


Bugs: HIVE-11593
https://issues.apache.org/jira/browse/HIVE-11593


Repository: hive-git


Description
---

HIVE-11593 Add aes_encrypt and aes_decrypt UDFs


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java 
4c1c53eff84f7e855fcd344aba16012fc1b31d1a 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAesBase.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAesDecrypt.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAesEncrypt.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFParamUtils.java 
cdbc6eae96c850ed46806e79c6f661c0f406d0e8 
  
ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFAesDecrypt.java 
PRE-CREATION 
  
ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFAesEncrypt.java 
PRE-CREATION 
  ql/src/test/queries/clientpositive/udf_aes_decrypt.q PRE-CREATION 
  ql/src/test/queries/clientpositive/udf_aes_encrypt.q PRE-CREATION 
  ql/src/test/results/clientpositive/show_functions.q.out 
540079bc8787547cafe747f5855f41f5a829177c 
  ql/src/test/results/clientpositive/udf_aes_decrypt.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/udf_aes_encrypt.q.out PRE-CREATION 

Diff: https://reviews.apache.org/r/37706/diff/


Testing
---


Thanks,

Alexander Pivovarov



Re: Problem with decimal data type value search

2015-08-26 Thread Jason Dere
If your numeric literal value is getting converted to double (and failing the 
equality test), you can try using id = 102014051502220923580957BD. Adding 
"BD" to the end of the literal value causes it to be parsed as a Decimal 
literal value rather than the default double value.


From: Selina Zhang 
Sent: Wednesday, August 26, 2015 12:03 PM
To: dev@hive.apache.org
Subject: Re: Problem with decimal data type value search

The root cause could be Double.toString() or 
FloatingDecimal.toJavaFormatString() uses scientific notations if double is 
less than 10^-3 or greater than 10^7. It definitely is a bug. :)
Selina


 On Wednesday, August 26, 2015 8:24 AM, Mayur Saparia  
wrote:




 On Wed, 26 Aug 2015 13:45:42 +0530  wrote 


Hello Experts,I have been using Hive 0.13 , where I have a column of type 
decimal(30,0) e.g Value: 102014051502220923580957 ,
The above value is stored properly and even displayed properly , the problem 
arises when I try to search with this number.
When I query the table as follows:
select * from test where id=102014051502220923580957;


It returns zero rows, when I tried to trace the problem I found that it 
converts the number to "ppd.OpProcFactory:  (id = 1.020140515022209E27)" (This 
is from logs while executing the query from HUE). Also to specify that I am 
using MapR Hadoop Distribution.
Can somebody please let me know what is the issue.


Thanks & regards,
Mayur Saparia.









[jira] [Created] (HIVE-11659) Make VectorizedHashKeyWrapper use the fast StringExpr

2015-08-26 Thread Gopal V (JIRA)
Gopal V created HIVE-11659:
--

 Summary: Make VectorizedHashKeyWrapper use the fast StringExpr 
 Key: HIVE-11659
 URL: https://issues.apache.org/jira/browse/HIVE-11659
 Project: Hive
  Issue Type: Improvement
  Components: Vectorization
Affects Versions: 1.3.0, 2.0.0
Reporter: Gopal V
Assignee: Gopal V


VectorHashKeyWrapper::equals() provides a faster path than the simple compare 
operator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11658) Load data file format validation does not work with directories

2015-08-26 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-11658:


 Summary: Load data file format validation does not work with 
directories
 Key: HIVE-11658
 URL: https://issues.apache.org/jira/browse/HIVE-11658
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.3.0, 2.0.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran


HIVE-8 added file format validation to load statement for ORC tables. It 
does not work when the path is a directory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11657) HIVE-2573 introduces some issues

2015-08-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11657:
---

 Summary: HIVE-2573 introduces some issues
 Key: HIVE-11657
 URL: https://issues.apache.org/jira/browse/HIVE-11657
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Priority: Critical


HIVE-2573 introduced static reload functions call.
It has a few problems:
1) When metastore client is initialized using an externally supplied config, it 
still gets called during static init using the main service config. In my case, 
even though I have uris in the supplied config to connect to remote MS, the 
static call creates objectstore, which is undesirable.
2) It breaks compat - old metastores do not support this call so new clients 
will fail



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 37778: HIVE-11634

2015-08-26 Thread Hari Sankar Sivarama Subramaniyan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37778/
---

(Updated Aug. 26, 2015, 8:22 p.m.)


Review request for hive, Ashutosh Chauhan, Jesús Camacho Rodríguez, and John 
Pullokkaran.


Changes
---

Added unit tests + some minor improvements over the previous patch to support 
struct field expression containing only partition columns, virtual columns or 
constants.


Repository: hive-git


Description
---

Support partition pruning for IN(STRUCT(partcol, nonpartcol..)...)


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java 14f362f 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/PartitionColumnsSeparator.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/OpProcFactory.java 
7262164 
  ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java 6a31689 
  ql/src/test/queries/clientpositive/pcs.q PRE-CREATION 
  ql/src/test/results/clientpositive/pcs.q.out PRE-CREATION 

Diff: https://reviews.apache.org/r/37778/diff/


Testing
---

Local testing done. More unit tests coming in the next patch.


Thanks,

Hari Sankar Sivarama Subramaniyan



Review Request 37810: HIVE-10021 "Alter index rebuild" statements submitted through HiveServer2 fail when Sentry is enabled

2015-08-26 Thread Aihua Xu

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37810/
---

Review request for hive.


Repository: hive-git


Description
---

HIVE-10021 "Alter index rebuild" statements submitted through HiveServer2 fail 
when Sentry is enabled


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/Context.java 
ca0d487b8195da7c848a8212a5b869620ee857af 
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java 
4030075dc5393b60bff25c50a700ccffdb1720bc 
  ql/src/java/org/apache/hadoop/hive/ql/index/AbstractIndexHandler.java 
1d27306ef1a644e4ad37a73f6f9eeed92cf79a5a 
  ql/src/java/org/apache/hadoop/hive/ql/index/AggregateIndexHandler.java 
e67996d3fba94e9ff33078f4bf7fd97141103138 
  ql/src/java/org/apache/hadoop/hive/ql/index/bitmap/BitmapIndexHandler.java 
b076933b7bd6611cd4b678441cd1cc2b0e16786b 
  ql/src/java/org/apache/hadoop/hive/ql/index/compact/CompactIndexHandler.java 
1dbe230917564d5c17c198a898d4de7b52adab3b 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/IndexUtils.java 
92cae67e9111d42b36594cf44a174fb9f0812a7a 
  ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 
9f8c756bed3811f04ec1dc8625f89724faab99ff 

Diff: https://reviews.apache.org/r/37810/diff/


Testing
---


Thanks,

Aihua Xu



Re: Problem with decimal data type value search

2015-08-26 Thread Selina Zhang
The root cause could be Double.toString() or 
FloatingDecimal.toJavaFormatString() uses scientific notations if double is 
less than 10^-3 or greater than 10^7. It definitely is a bug. :)
Selina 


 On Wednesday, August 26, 2015 8:24 AM, Mayur Saparia  
wrote:
   

 

 On Wed, 26 Aug 2015 13:45:42 +0530  wrote  


Hello Experts,I have been using Hive 0.13 , where I have a column of type 
decimal(30,0) e.g Value: 102014051502220923580957 ,
The above value is stored properly and even displayed properly , the problem 
arises when I try to search with this number.
When I query the table as follows:
select * from test where id=102014051502220923580957;


It returns zero rows, when I tried to trace the problem I found that it 
converts the number to "ppd.OpProcFactory:  (id = 1.020140515022209E27)" (This 
is from logs while executing the query from HUE). Also to specify that I am 
using MapR Hadoop Distribution.
Can somebody please let me know what is the issue.


Thanks & regards,
Mayur Saparia.








  

Testing in the HBase metastore branch

2015-08-26 Thread Alan Gates
I have a set of tests I run before a commit in the HBase metastore 
branch since we don't have automated testing on that branch right now.  
I realized I haven't shared those with others.  They are:


in metastore:
TestHBaseStore, TestHBaseStoreCached, TestHBaseUtils, 
TestSharedStorageDescriptor, TestHBaseFilterPlanUtil, 
TestHBaseAggregateStatsCache, TestSharedStorageDescriptor.java


in itest/hive-unit:
TestHBaseStoreIntegration, TestHBaseImport, 
TestStorageDescriptorSharing, TestHBaseMetastoreSql, 
TestHBaseAggrStatsCacheIntegration, TestHBaseSchemaTool


Alan.


[jira] [Created] (HIVE-11656) LLAP: merge master into branch

2015-08-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11656:
---

 Summary: LLAP: merge master into branch
 Key: HIVE-11656
 URL: https://issues.apache.org/jira/browse/HIVE-11656
 Project: Hive
  Issue Type: Sub-task
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin
 Fix For: llap






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11655) clean build on the branch appears to be broken

2015-08-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-11655:
---

 Summary: clean build on the branch appears to be broken
 Key: HIVE-11655
 URL: https://issues.apache.org/jira/browse/HIVE-11655
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 37706: HIVE-11593 Add aes_encrypt and aes_decrypt UDFs

2015-08-26 Thread Jason Dere

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37706/#review96378
---



ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAesBase.java (line 
57)


Can you move this initialization during initialize()? I believe all builtin 
UDFs are instantiated during static initialzation. A failure here means Hive 
will fail to start up, whereas failing during initialize() would simply cause a 
query using this UDF to fail.


- Jason Dere


On Aug. 24, 2015, 5:22 a.m., Alexander Pivovarov wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37706/
> ---
> 
> (Updated Aug. 24, 2015, 5:22 a.m.)
> 
> 
> Review request for hive and Jason Dere.
> 
> 
> Bugs: HIVE-11593
> https://issues.apache.org/jira/browse/HIVE-11593
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-11593 Add aes_encrypt and aes_decrypt UDFs
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java 
> 4c1c53eff84f7e855fcd344aba16012fc1b31d1a 
>   ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAesBase.java 
> PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAesDecrypt.java 
> PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFAesEncrypt.java 
> PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFParamUtils.java 
> cdbc6eae96c850ed46806e79c6f661c0f406d0e8 
>   
> ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFAesDecrypt.java
>  PRE-CREATION 
>   
> ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFAesEncrypt.java
>  PRE-CREATION 
>   ql/src/test/queries/clientpositive/udf_aes_decrypt.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/udf_aes_encrypt.q PRE-CREATION 
>   ql/src/test/results/clientpositive/show_functions.q.out 
> 540079bc8787547cafe747f5855f41f5a829177c 
>   ql/src/test/results/clientpositive/udf_aes_decrypt.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/udf_aes_encrypt.q.out PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/37706/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Alexander Pivovarov
> 
>



[jira] [Created] (HIVE-11654) After latest merge, HBase metastore tests failing

2015-08-26 Thread Alan Gates (JIRA)
Alan Gates created HIVE-11654:
-

 Summary: After latest merge, HBase metastore tests failing
 Key: HIVE-11654
 URL: https://issues.apache.org/jira/browse/HIVE-11654
 Project: Hive
  Issue Type: Bug
  Components: HBase Metastore
Reporter: Alan Gates
Assignee: Alan Gates
Priority: Blocker


After the latest merge from trunk a number of the HBase unit tests are failing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Problem with decimal data type value search

2015-08-26 Thread Mayur Saparia


 On Wed, 26 Aug 2015 13:45:42 +0530  wrote  


Hello Experts,I have been using Hive 0.13 , where I have a column of type 
decimal(30,0) e.g Value: 102014051502220923580957 ,
The above value is stored properly and even displayed properly , the problem 
arises when I try to search with this number.
When I query the table as follows:
select * from test where id=102014051502220923580957;


It returns zero rows, when I tried to trace the problem I found that it 
converts the number to "ppd.OpProcFactory:  (id = 1.020140515022209E27)" (This 
is from logs while executing the query from HUE). Also to specify that I am 
using MapR Hadoop Distribution.
Can somebody please let me know what is the issue.


Thanks & regards,
Mayur Saparia.








[jira] [Created] (HIVE-11653) Beeline asks for password even when connecting with Kerberos

2015-08-26 Thread JIRA
Loïc C. Chanel created HIVE-11653:
-

 Summary: Beeline asks for password even when connecting with 
Kerberos
 Key: HIVE-11653
 URL: https://issues.apache.org/jira/browse/HIVE-11653
 Project: Hive
  Issue Type: Bug
  Components: Beeline
Affects Versions: 0.14.0
 Environment: Kerberos and Hive
Reporter: Loïc C. Chanel


When connecting to HiveServer via Beeline, Beeline asks for a password even if 
Kerberos is enabled and there is a ticket in cache (kinit have been 
successfully executed, as klist shows the ticket is in cache).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11652) Avoid expensive call to removeAll in DefaultGraphWalker

2015-08-26 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-11652:
--

 Summary: Avoid expensive call to removeAll in DefaultGraphWalker
 Key: HIVE-11652
 URL: https://issues.apache.org/jira/browse/HIVE-11652
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer, Physical Optimizer
Affects Versions: 1.3.0, 2.0.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez


When the plan is too large, the removeAll call in DefaultGraphWalker (line 140) 
will take very long as it will have to go through the list looking for each of 
the nodes. We try to get rid of this call by rewriting the logic in the walker.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11651) Index creation is failing from beeline when execution engine is set to Tez

2015-08-26 Thread Venkata Srinivasa Rao Kolla (JIRA)
Venkata Srinivasa Rao Kolla  created HIVE-11651:
---

 Summary: Index creation is failing from beeline when execution 
engine is set to Tez
 Key: HIVE-11651
 URL: https://issues.apache.org/jira/browse/HIVE-11651
 Project: Hive
  Issue Type: Bug
  Components: Beeline, Hive, Tez
Reporter: Venkata Srinivasa Rao Kolla 


In Hive, with execution engine is set to Tez and when we tried to rebuild index 
on a table (which is not empty) using beeline, index creation is not happening. 
It is not throwing any error too on to console. But in the corresponding tez 
job logs we found below error:

2015-08-24 18:08:43,999 WARN [AMShutdownThread] 
org.apache.tez.dag.history.recovery.RecoveryService: Error when closing summary 
stream 
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException):
 No lease on 
/tmp/hive-alti-test-01/_tez_session_dir/573df26e-4a22-4bf5-ad5c-a0d72cdacec6/application_1439396922313_1732/recovery/1/application_1439396922313_1732.summary:
 File does not exist. Holder DFSClient_NONMAPREDUCE_-117450461_1 does not have 
any open files. at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2956)
 at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFileInternal(FSNamesystem.java:3027)
 at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFile(FSNamesystem.java:3007)
 at 
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.complete(NameNodeRpcServer.java:641)
 at 
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.complete(ClientNamenodeProtocolServerSideTranslatorPB.java:484)
 at 
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
 at 
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
 at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928) at 
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013) at 
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009) at 
java.security.AccessController.doPrivileged(Native Method) at 
javax.security.auth.Subject.doAs(Subject.java:415) at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
 at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)

Below are the set of commands we have used: CREATE TABLE table02(column1 
String, column2 string, column3 int, column4 string) ROW FORMAT DELIMITED 
FIELDS TERMINATED BY ','; LOAD DATA LOCAL INPATH 'posts_us' OVERWRITE INTO 
TABLE table02; CREATE INDEX table02_index ON TABLE table02 (column3) AS 
'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler' WITH DEFERRED 
REBUILD; ALTER INDEX table02_index ON table02 REBUILD;

Does any one seen this problem?

Regards, Srinivas.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-11650) Create LLAP Monitor Daemon and launch scripts

2015-08-26 Thread Kai Sasaki (JIRA)
Kai Sasaki created HIVE-11650:
-

 Summary: Create LLAP Monitor Daemon and launch scripts
 Key: HIVE-11650
 URL: https://issues.apache.org/jira/browse/HIVE-11650
 Project: Hive
  Issue Type: Sub-task
Affects Versions: llap
Reporter: Kai Sasaki
Assignee: Kai Sasaki


This JIRA for creating LLAP Monitor Daemon class and related launching scripts 
for slider package.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)