[jira] [Created] (HIVE-28085) YarnQueueHelper fails to access HTTPS enabled YARN WebService

2024-02-21 Thread Prabhu Joseph (Jira) 
Prabhu Joseph created HIVE-28085:


 Summary: YarnQueueHelper fails to access HTTPS enabled YARN 
WebService
 Key: HIVE-28085
 URL: https://issues.apache.org/jira/browse/HIVE-28085
 Project: Hive
  Issue Type: Bug
Affects Versions: 4.0.0-alpha-1
Reporter: Prabhu Joseph


YarnQueueHelper fails to access HTTPS enabled YARN WebService with below error.
{code:java}
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable 
to find valid certification path to requested target
at 
sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:148)
 ~[?:1.8.0_402]
at 
sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:129)
 ~[?:1.8.0_402]
at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280) 
~[?:1.8.0_402]
at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:451) 
~[?:1.8.0_402]
at 
sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:323) 
~[?:1.8.0_402]
at sun.security.validator.Validator.validate(Validator.java:271) 
~[?:1.8.0_402]
at 
sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:315) 
~[?:1.8.0_402]
at 
sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:223)
 ~[?:1.8.0_402]
at 
sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:129)
 ~[?:1.8.0_402]
at 
sun.security.ssl.CertificateMessage$T13CertificateConsumer.checkServerCerts(CertificateMessage.java:1340)
 ~[?:1.8.0_402]
at 
sun.security.ssl.CertificateMessage$T13CertificateConsumer.onConsumeCertificate(CertificateMessage.java:1231)
 ~[?:1.8.0_402]
at 
sun.security.ssl.CertificateMessage$T13CertificateConsumer.consume(CertificateMessage.java:1174)
 ~[?:1.8.0_402]
at sun.security.ssl.SSLHandshake.consume(SSLHandshake.java:377) 
~[?:1.8.0_402]
at 
sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:444) 
~[?:1.8.0_402]
at 
sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:422) 
~[?:1.8.0_402]
at 
sun.security.ssl.TransportContext.dispatch(TransportContext.java:182) 
~[?:1.8.0_402]
at sun.security.ssl.SSLTransport.decode(SSLTransport.java:152) 
~[?:1.8.0_402]
at sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1401) 
~[?:1.8.0_402]
at 
sun.security.ssl.SSLSocketImpl.readHandshakeRecord(SSLSocketImpl.java:1309) 
~[?:1.8.0_402]
at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:440) 
~[?:1.8.0_402]
at 
sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:559) 
~[?:1.8.0_402]
at 
sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:197)
 ~[?:1.8.0_402]
at 
sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1572)
 ~[?:1.8.0_402]
at 
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1500)
 ~[?:1.8.0_402]
at 
java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) 
~[?:1.8.0_402]
at 
sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:352)
 ~[?:1.8.0_402]
at 
org.apache.hadoop.hive.ql.exec.tez.YarnQueueHelper.checkQueueAccessFromSingleRm(YarnQueueHelper.java:155)
 ~[hive-exec-3.1.3-amzn-8.jar:3.1.3-amzn-8] {code}
The fix (HIVE-23062) has corrected the URL but has not used the SSLFactory to 
setup the HTTPURlConnection.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Assigned] (HIVE-24864) Hive Plugin (exec hook) to log application timeline data to ATSv2

2021-03-09 Thread Prabhu Joseph (Jira) 


 [ 
https://issues.apache.org/jira/browse/HIVE-24864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph reassigned HIVE-24864:



> Hive Plugin (exec hook) to log application timeline data to ATSv2
> -
>
> Key: HIVE-24864
> URL: https://issues.apache.org/jira/browse/HIVE-24864
> Project: Hive
>  Issue Type: New Feature
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
>
> Currently HiveServer2 has ATSHook 
> (https://issues.apache.org/jira/browse/HIVE-7076) to log query + plan 
> information to ATSV1.5. Similar hook is needed for ATSv2. 
> ATS1.5 has lot of scalability issues which will be improved by ATSv2.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (HIVE-12024) javaXML serialization fails to serialize ReduceWork

2018-04-01 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-12024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-12024:
-
Description: 
Running the following query 
{code:title=Query}
hive> set hive.plan.serialization.format=javaXML;
hive> select count(*) from alltypes_orc where ts1 between '1969-12-31' and 
'1970-12-31';
{code}
{code:title=Exception}
2015-10-02 14:12:39,958 INFO  [main]: log.PerfLogger 
(PerfLogger.java:PerfLogBegin(121)) - 
2015-10-02 14:12:39,959 INFO  [main]: log.PerfLogger 
(PerfLogger.java:PerfLogBegin(121)) - 
2015-10-02 14:12:39,959 INFO  [main]: log.PerfLogger 
(PerfLogger.java:PerfLogBegin(121)) - 
2015-10-02 14:12:39,959 INFO  [main]: exec.Utilities 
(Utilities.java:serializePlan(942)) - Serializing ReduceWork via javaXML
2015-10-02 14:12:40,088 WARN  [main]: exec.Utilities 
(Utilities.java:exceptionThrown(1037)) - java.lang.InstantiationException: 
org.apache.hadoop.hive.ql.plan.OpTraits
at java.lang.Class.newInstance(Class.java:359)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at sun.reflect.misc.Trampoline.invoke(MethodUtil.java:75)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at sun.reflect.misc.MethodUtil.invoke(MethodUtil.java:279)
at java.beans.Statement.invokeInternal(Statement.java:292)
at java.beans.Statement.access$000(Statement.java:58)
at java.beans.Statement$2.run(Statement.java:185)
at java.security.AccessController.doPrivileged(Native Method)
at java.beans.Statement.invoke(Statement.java:182)
at java.beans.Expression.getValue(Expression.java:153)
at java.beans.Encoder.getValue(Encoder.java:105)
at java.beans.Encoder.get(Encoder.java:252)
at 
java.beans.PersistenceDelegate.writeObject(PersistenceDelegate.java:112)
at java.beans.Encoder.writeObject(Encoder.java:74)
at java.beans.XMLEncoder.writeObject(XMLEncoder.java:327)
at java.beans.Encoder.writeExpression(Encoder.java:330)
at java.beans.XMLEncoder.writeExpression(XMLEncoder.java:454)
at 
java.beans.PersistenceDelegate.writeObject(PersistenceDelegate.java:115)
at java.beans.Encoder.writeObject(Encoder.java:74)
at java.beans.XMLEncoder.writeObject(XMLEncoder.java:327)
at java.beans.Encoder.writeExpression(Encoder.java:330)
at java.beans.XMLEncoder.writeExpression(XMLEncoder.java:454)
at 
java.beans.DefaultPersistenceDelegate.doProperty(DefaultPersistenceDelegate.java:194)
at 
java.beans.DefaultPersistenceDelegate.initBean(DefaultPersistenceDelegate.java:253)
at 
java.beans.DefaultPersistenceDelegate.initialize(DefaultPersistenceDelegate.java:400)
at 
java.beans.PersistenceDelegate.writeObject(PersistenceDelegate.java:118)
at java.beans.Encoder.writeObject(Encoder.java:74)
at java.beans.XMLEncoder.writeObject(XMLEncoder.java:327)
at java.beans.Encoder.writeExpression(Encoder.java:330)
at java.beans.XMLEncoder.writeExpression(XMLEncoder.java:454)
at 
java.beans.PersistenceDelegate.writeObject(PersistenceDelegate.java:115)
at java.beans.Encoder.writeObject(Encoder.java:74)
at java.beans.XMLEncoder.writeObject(XMLEncoder.java:327)
at java.beans.Encoder.writeExpression(Encoder.java:330)
at java.beans.XMLEncoder.writeExpression(XMLEncoder.java:454)
at 
java.beans.DefaultPersistenceDelegate.doProperty(DefaultPersistenceDelegate.java:194)
at 
java.beans.DefaultPersistenceDelegate.initBean(DefaultPersistenceDelegate.java:253)
at 
java.beans.DefaultPersistenceDelegate.initialize(DefaultPersistenceDelegate.java:400)
at 
java.beans.PersistenceDelegate.writeObject(PersistenceDelegate.java:118)
at java.beans.Encoder.writeObject(Encoder.java:74)
at java.beans.XMLEncoder.writeObject(XMLEncoder.java:327)
at java.beans.Encoder.writeExpression(Encoder.java:330)
at java.beans.XMLEncoder.writeExpression(XMLEncoder.java:454)
at 
java.beans.PersistenceDelegate.writeObject(PersistenceDelegate.java:115)
at java.beans.Encoder.writeObject(Encoder.java:74)
at java.beans.XMLEncoder.writeObject(XMLEncoder.java:327)
at java.beans.Encoder.writeObject1(Encoder.java:258)
at java.beans.Encoder.cloneStatement(Encoder.java:271)
at java.beans.Encoder.writeStatement(Encoder.java:301)
at

[jira] [Resolved] (HIVE-18440) CombineHiveInputFormat fails with IllegalArgumentException when the path is empty

2018-01-11 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph resolved HIVE-18440.
--
Resolution: Duplicate

> CombineHiveInputFormat fails with IllegalArgumentException when the path is 
> empty
> -
>
> Key: HIVE-18440
> URL: https://issues.apache.org/jira/browse/HIVE-18440
> Project: Hive
>  Issue Type: Bug
>  Components: File Formats
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>
> Hive query failed with IllegalArgumentException when the number of paths is 
> zero. We create the fixedThreadPool with same value as number of paths and it 
> should be greater than zero.
> {code}
> 2018-01-05 00:32:55,724 [INFO] [InputInitializer {Map 14} #0] 
> |io.CombineHiveInputFormat|: Total number of paths: 0, launching 0 threads to 
> check non-combinable ones.
> 2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
> |impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
> initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
> org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
> java.lang.IllegalArgumentException
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
> at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
> at 
> com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
> at 
> com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
> at 
> com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
> at 
> com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
> at 
> java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
> at java.util.concurrent.FutureTask.setException(FutureTask.java:251)
> at java.util.concurrent.FutureTask.run(FutureTask.java:271)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1307)
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1195)
> at 
> java.util.concurrent.Executors.newFixedThreadPool(Executors.java:89)
> at 
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:519)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateOldSplits(MRInputHelpers.java:447)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(MRInputHelpers.java:299)
> at 
> org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:122)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:273)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:266)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:266)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-18440) CombineHiveInputFormat fails with IllegalArgumentException when the path is empty

2018-01-11 Thread Prabhu Joseph (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-18440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16322050#comment-16322050
 ] 

Prabhu Joseph commented on HIVE-18440:
--

The issue is fixed as part of HIVE-9152. Closing this.

> CombineHiveInputFormat fails with IllegalArgumentException when the path is 
> empty
> -
>
> Key: HIVE-18440
> URL: https://issues.apache.org/jira/browse/HIVE-18440
> Project: Hive
>  Issue Type: Bug
>  Components: File Formats
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>
> Hive query failed with IllegalArgumentException when the number of paths is 
> zero. We create the fixedThreadPool with same value as number of paths and it 
> should be greater than zero.
> {code}
> 2018-01-05 00:32:55,724 [INFO] [InputInitializer {Map 14} #0] 
> |io.CombineHiveInputFormat|: Total number of paths: 0, launching 0 threads to 
> check non-combinable ones.
> 2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
> |impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
> initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
> org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
> java.lang.IllegalArgumentException
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
> at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
> at 
> com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
> at 
> com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
> at 
> com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
> at 
> com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
> at 
> java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
> at java.util.concurrent.FutureTask.setException(FutureTask.java:251)
> at java.util.concurrent.FutureTask.run(FutureTask.java:271)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1307)
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1195)
> at 
> java.util.concurrent.Executors.newFixedThreadPool(Executors.java:89)
> at 
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:519)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateOldSplits(MRInputHelpers.java:447)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(MRInputHelpers.java:299)
> at 
> org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:122)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:273)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:266)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:266)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (HIVE-18440) CombineHiveInputFormat fails with IllegalArgumentException when the path is empty

2018-01-10 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph reassigned HIVE-18440:


Assignee: Prabhu Joseph

> CombineHiveInputFormat fails with IllegalArgumentException when the path is 
> empty
> -
>
> Key: HIVE-18440
> URL: https://issues.apache.org/jira/browse/HIVE-18440
> Project: Hive
>  Issue Type: Bug
>  Components: File Formats
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>
> Hive query failed with IllegalArgumentException when the number of paths is 
> zero. We create the fixedThreadPool with same value as number of paths and it 
> should be greater than zero.
> {code}
> 2018-01-05 00:32:55,724 [INFO] [InputInitializer {Map 14} #0] 
> |io.CombineHiveInputFormat|: Total number of paths: 0, launching 0 threads to 
> check non-combinable ones.
> 2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
> |impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
> initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
> org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
> java.lang.IllegalArgumentException
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
> at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
> at 
> com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
> at 
> com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
> at 
> com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
> at 
> com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
> at 
> java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
> at java.util.concurrent.FutureTask.setException(FutureTask.java:251)
> at java.util.concurrent.FutureTask.run(FutureTask.java:271)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1307)
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1195)
> at 
> java.util.concurrent.Executors.newFixedThreadPool(Executors.java:89)
> at 
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:519)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateOldSplits(MRInputHelpers.java:447)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(MRInputHelpers.java:299)
> at 
> org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:122)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:273)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:266)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:266)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HIVE-18440) CombineHiveInputFormat fails with IllegalArgumentException when the path is empty

2018-01-10 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-18440:
-
Component/s: File Formats

> CombineHiveInputFormat fails with IllegalArgumentException when the path is 
> empty
> -
>
> Key: HIVE-18440
> URL: https://issues.apache.org/jira/browse/HIVE-18440
> Project: Hive
>  Issue Type: Bug
>  Components: File Formats
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>
> Hive query failed with IllegalArgumentException when the number of paths is 
> zero. We create the fixedThreadPool with same value as number of paths and it 
> should greater than zero.
> {code}
> 2018-01-05 00:32:55,724 [INFO] [InputInitializer {Map 14} #0] 
> |io.CombineHiveInputFormat|: Total number of paths: 0, launching 0 threads to 
> check non-combinable ones.
> 2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
> |impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
> initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
> org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
> java.lang.IllegalArgumentException
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
> at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
> at 
> com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
> at 
> com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
> at 
> com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
> at 
> com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
> at 
> java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
> at java.util.concurrent.FutureTask.setException(FutureTask.java:251)
> at java.util.concurrent.FutureTask.run(FutureTask.java:271)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1307)
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1195)
> at 
> java.util.concurrent.Executors.newFixedThreadPool(Executors.java:89)
> at 
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:519)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateOldSplits(MRInputHelpers.java:447)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(MRInputHelpers.java:299)
> at 
> org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:122)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:273)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:266)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:266)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HIVE-18440) CombineHiveInputFormat fails with IllegalArgumentException when the path is empty

2018-01-10 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-18440:
-
Description: 
Hive query failed with IllegalArgumentException when the number of paths is 
zero. We create the fixedThreadPool with same value as number of paths and it 
should be greater than zero.

{code}

2018-01-05 00:32:55,724 [INFO] [InputInitializer {Map 14} #0] 
|io.CombineHiveInputFormat|: Total number of paths: 0, launching 0 threads to 
check non-combinable ones.

2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
|impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
java.lang.IllegalArgumentException
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
at 
com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
at 
com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
at 
com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
at 
com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
at java.util.concurrent.FutureTask.setException(FutureTask.java:251)
at java.util.concurrent.FutureTask.run(FutureTask.java:271)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at 
java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1307)
at 
java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1195)
at java.util.concurrent.Executors.newFixedThreadPool(Executors.java:89)
at 
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:519)
at 
org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateOldSplits(MRInputHelpers.java:447)
at 
org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(MRInputHelpers.java:299)
at 
org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:122)
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:273)
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:266)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:266)
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
{code}




  was:
Hive query failed with IllegalArgumentException when the number of paths is 
zero. We create the fixedThreadPool with same value as number of paths and it 
should greater than zero.

{code}

2018-01-05 00:32:55,724 [INFO] [InputInitializer {Map 14} #0] 
|io.CombineHiveInputFormat|: Total number of paths: 0, launching 0 threads to 
check non-combinable ones.

2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
|impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
java.lang.IllegalArgumentException
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
at 
com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
at 
com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
at 
com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
at 
com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
at

[jira] [Updated] (HIVE-18440) CombineHiveInputFormat fails with IllegalArgumentException when the path is empty

2018-01-10 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-18440:
-
Description: 
Hive query failed with IllegalArgumentException when the number of paths is 
zero. We create the fixedThreadPool with same value as number of paths and it 
should greater than zero.

{code}

2018-01-05 00:32:55,724 [INFO] [InputInitializer {Map 14} #0] 
|io.CombineHiveInputFormat|: Total number of paths: 0, launching 0 threads to 
check non-combinable ones.

2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
|impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
java.lang.IllegalArgumentException
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
at 
com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
at 
com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
at 
com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
at 
com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
at java.util.concurrent.FutureTask.setException(FutureTask.java:251)
at java.util.concurrent.FutureTask.run(FutureTask.java:271)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at 
java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1307)
at 
java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1195)
at java.util.concurrent.Executors.newFixedThreadPool(Executors.java:89)
at 
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:519)
at 
org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateOldSplits(MRInputHelpers.java:447)
at 
org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(MRInputHelpers.java:299)
at 
org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:122)
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:273)
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:266)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:266)
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
{code}




  was:
Hive query failed with IllegalArgumentException when the number of paths is 
zero. We create the fixedThreadPool with same value as number of paths and it 
should greater than zero.

{code}
2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
|impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
java.lang.IllegalArgumentException
at 
org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
at 
com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
at 
com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
at 
com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
at 
com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
at java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
at java.util.concurrent.FutureTask.setException(FutureTask.java:251)
at java.util.concurrent.FutureTask.run(FutureTask.java:271)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

[jira] [Updated] (HIVE-18440) CombineHiveInputFormat fails with IllegalArgumentException when the path is empty

2018-01-10 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-18440:
-
Affects Version/s: 1.2.1

> CombineHiveInputFormat fails with IllegalArgumentException when the path is 
> empty
> -
>
> Key: HIVE-18440
> URL: https://issues.apache.org/jira/browse/HIVE-18440
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>
> Hive query failed with IllegalArgumentException when the number of paths is 
> zero. We create the fixedThreadPool with same value as number of paths and it 
> should greater than zero.
> {code}
> 2018-01-05 00:32:55,724 [INFO] [InputInitializer {Map 14} #0] 
> |io.CombineHiveInputFormat|: Total number of paths: 0, launching 0 threads to 
> check non-combinable ones.
> 2018-01-05 00:32:55,745 [ERROR] [Dispatcher thread {Central}] 
> |impl.VertexImpl|: Vertex Input: share_of_shelf_kpi_values_int_01_001 
> initializer failed, vertex=vertex_1512053476937_11160_1_01 [Map 14]
> org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
> java.lang.IllegalArgumentException
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallback.onFailure(RootInputInitializerManager.java:319)
> at com.google.common.util.concurrent.Futures$4.run(Futures.java:1140)
> at 
> com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:293)
> at 
> com.google.common.util.concurrent.ExecutionList$RunnableExecutorPair.execute(ExecutionList.java:150)
> at 
> com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:135)
> at 
> com.google.common.util.concurrent.ListenableFutureTask.done(ListenableFutureTask.java:91)
> at 
> java.util.concurrent.FutureTask.finishCompletion(FutureTask.java:384)
> at java.util.concurrent.FutureTask.setException(FutureTask.java:251)
> at java.util.concurrent.FutureTask.run(FutureTask.java:271)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1307)
> at 
> java.util.concurrent.ThreadPoolExecutor.(ThreadPoolExecutor.java:1195)
> at 
> java.util.concurrent.Executors.newFixedThreadPool(Executors.java:89)
> at 
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:519)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateOldSplits(MRInputHelpers.java:447)
> at 
> org.apache.tez.mapreduce.hadoop.MRInputHelpers.generateInputSplitsToMem(MRInputHelpers.java:299)
> at 
> org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.initialize(MRInputAMSplitGenerator.java:122)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:273)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:266)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:266)
> at 
> org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:253)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-09 Thread Prabhu Joseph (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319768#comment-16319768
 ] 

Prabhu Joseph commented on HIVE-18353:
--

Thanks [~thejas] and [~ekoifman] for the review.

> CompactorMR should call jobclient.close() to trigger cleanup
> 
>
> Key: HIVE-18353
> URL: https://issues.apache.org/jira/browse/HIVE-18353
> Project: Hive
>  Issue Type: Bug
>  Components: Hive, Transactions
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
> Fix For: 3.0.0
>
> Attachments: HIVE-18353.1.patch, HIVE-18353.2.patch, HIVE-18353.patch
>
>
> HiveMetastore process is leaking TrustStore reloader threads when running 
> compaction as JobClient close is not called from CompactorMR - MAPREDUCE-6618 
> and MAPREDUCE-6621 
> {code}
> "Truststore reloader thread" #2814 daemon prio=1 os_prio=0 
> tid=0x00cdc800 nid=0x2f05a waiting on condition [0x7fdaef403000]
>java.lang.Thread.State: TIMED_WAITING (sleeping)
> at java.lang.Thread.sleep(Native Method)
> at 
> org.apache.hadoop.security.ssl.ReloadingX509TrustManager.run(ReloadingX509TrustManager.java:194)
> at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-04 Thread Prabhu Joseph (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312583#comment-16312583
 ] 

Prabhu Joseph commented on HIVE-18353:
--

[~thejas] [~ekoifman] Can you review this when you get time. The failing test 
cases looks not related.

> CompactorMR should call jobclient.close() to trigger cleanup
> 
>
> Key: HIVE-18353
> URL: https://issues.apache.org/jira/browse/HIVE-18353
> Project: Hive
>  Issue Type: Bug
>  Components: Hive, Transactions
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
> Attachments: HIVE-18353.1.patch, HIVE-18353.2.patch, HIVE-18353.patch
>
>
> HiveMetastore process is leaking TrustStore reloader threads when running 
> compaction as JobClient close is not called from CompactorMR - MAPREDUCE-6618 
> and MAPREDUCE-6621 
> {code}
> "Truststore reloader thread" #2814 daemon prio=1 os_prio=0 
> tid=0x00cdc800 nid=0x2f05a waiting on condition [0x7fdaef403000]
>java.lang.Thread.State: TIMED_WAITING (sleeping)
> at java.lang.Thread.sleep(Native Method)
> at 
> org.apache.hadoop.security.ssl.ReloadingX509TrustManager.run(ReloadingX509TrustManager.java:194)
> at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-03 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-18353:
-
Attachment: HIVE-18353.2.patch

> CompactorMR should call jobclient.close() to trigger cleanup
> 
>
> Key: HIVE-18353
> URL: https://issues.apache.org/jira/browse/HIVE-18353
> Project: Hive
>  Issue Type: Bug
>  Components: Hive, Transactions
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
> Attachments: HIVE-18353.1.patch, HIVE-18353.2.patch, HIVE-18353.patch
>
>
> HiveMetastore process is leaking TrustStore reloader threads when running 
> compaction as JobClient close is not called from CompactorMR - MAPREDUCE-6618 
> and MAPREDUCE-6621 
> {code}
> "Truststore reloader thread" #2814 daemon prio=1 os_prio=0 
> tid=0x00cdc800 nid=0x2f05a waiting on condition [0x7fdaef403000]
>java.lang.Thread.State: TIMED_WAITING (sleeping)
> at java.lang.Thread.sleep(Native Method)
> at 
> org.apache.hadoop.security.ssl.ReloadingX509TrustManager.run(ReloadingX509TrustManager.java:194)
> at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-03 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-18353:
-
Attachment: HIVE-18353.1.patch

> CompactorMR should call jobclient.close() to trigger cleanup
> 
>
> Key: HIVE-18353
> URL: https://issues.apache.org/jira/browse/HIVE-18353
> Project: Hive
>  Issue Type: Bug
>  Components: Hive, Transactions
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
> Attachments: HIVE-18353.1.patch, HIVE-18353.patch
>
>
> HiveMetastore process is leaking TrustStore reloader threads when running 
> compaction as JobClient close is not called from CompactorMR - MAPREDUCE-6618 
> and MAPREDUCE-6621 
> {code}
> "Truststore reloader thread" #2814 daemon prio=1 os_prio=0 
> tid=0x00cdc800 nid=0x2f05a waiting on condition [0x7fdaef403000]
>java.lang.Thread.State: TIMED_WAITING (sleeping)
> at java.lang.Thread.sleep(Native Method)
> at 
> org.apache.hadoop.security.ssl.ReloadingX509TrustManager.run(ReloadingX509TrustManager.java:194)
> at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-03 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-18353:
-
Status: Patch Available  (was: Open)

> CompactorMR should call jobclient.close() to trigger cleanup
> 
>
> Key: HIVE-18353
> URL: https://issues.apache.org/jira/browse/HIVE-18353
> Project: Hive
>  Issue Type: Bug
>  Components: Hive, Transactions
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
> Attachments: HIVE-18353.patch
>
>
> HiveMetastore process is leaking TrustStore reloader threads when running 
> compaction as JobClient close is not called from CompactorMR - MAPREDUCE-6618 
> and MAPREDUCE-6621 
> {code}
> "Truststore reloader thread" #2814 daemon prio=1 os_prio=0 
> tid=0x00cdc800 nid=0x2f05a waiting on condition [0x7fdaef403000]
>java.lang.Thread.State: TIMED_WAITING (sleeping)
> at java.lang.Thread.sleep(Native Method)
> at 
> org.apache.hadoop.security.ssl.ReloadingX509TrustManager.run(ReloadingX509TrustManager.java:194)
> at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-03 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph updated HIVE-18353:
-
Attachment: HIVE-18353.patch

> CompactorMR should call jobclient.close() to trigger cleanup
> 
>
> Key: HIVE-18353
> URL: https://issues.apache.org/jira/browse/HIVE-18353
> Project: Hive
>  Issue Type: Bug
>  Components: Hive, Transactions
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
> Attachments: HIVE-18353.patch
>
>
> HiveMetastore process is leaking TrustStore reloader threads when running 
> compaction as JobClient close is not called from CompactorMR - MAPREDUCE-6618 
> and MAPREDUCE-6621 
> {code}
> "Truststore reloader thread" #2814 daemon prio=1 os_prio=0 
> tid=0x00cdc800 nid=0x2f05a waiting on condition [0x7fdaef403000]
>java.lang.Thread.State: TIMED_WAITING (sleeping)
> at java.lang.Thread.sleep(Native Method)
> at 
> org.apache.hadoop.security.ssl.ReloadingX509TrustManager.run(ReloadingX509TrustManager.java:194)
> at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (HIVE-18353) CompactorMR should call jobclient.close() to trigger cleanup

2018-01-02 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph reassigned HIVE-18353:



> CompactorMR should call jobclient.close() to trigger cleanup
> 
>
> Key: HIVE-18353
> URL: https://issues.apache.org/jira/browse/HIVE-18353
> Project: Hive
>  Issue Type: Bug
>  Components: Hive
>Affects Versions: 1.2.1
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>
> HiveMetastore process is leaking TrustStore reloader threads when running 
> compaction as JobClient close is not called from CompactorMR - MAPREDUCE-6618 
> and MAPREDUCE-6621 
> {code}
> "Truststore reloader thread" #2814 daemon prio=1 os_prio=0 
> tid=0x00cdc800 nid=0x2f05a waiting on condition [0x7fdaef403000]
>java.lang.Thread.State: TIMED_WAITING (sleeping)
> at java.lang.Thread.sleep(Native Method)
> at 
> org.apache.hadoop.security.ssl.ReloadingX509TrustManager.run(ReloadingX509TrustManager.java:194)
> at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (HIVE-16185) TEZ_CLIENT_HOME is set wrongly

2017-10-19 Thread Prabhu Joseph (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HIVE-16185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prabhu Joseph reassigned HIVE-16185:


Assignee: Prabhu Joseph

> TEZ_CLIENT_HOME is set wrongly 
> ---
>
> Key: HIVE-16185
> URL: https://issues.apache.org/jira/browse/HIVE-16185
> Project: Hive
>  Issue Type: Bug
>  Components: HCatalog
>Affects Versions: 2.1.0
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>
> TEZ_CLIENT_HOME is hardcoded with user directory instead of ${USER} in test 
> env.sh
> https://github.com/apache/hive/blob/branch-2.1/hcatalog/src/test/e2e/templeton/deployers/env.sh#L58



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)