[
https://issues.apache.org/jira/browse/HIVE-18959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
slim bouguerra updated HIVE-18959:
----------------------------------
Description:
The current Druid-Kerberos-Http client is using an external single threaded
pool to handle retry auth calls (eg when a cookie expire or other transient
auth issues).
First, this is not buying us anything since all the Druid Task is executed as
one synchronous task.
Second, this can cause a major issue if an exception occurs that leads to
shutting down the LLAP main thread with an exception like:
{code} org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon: Thread
Thread[KerberosHttpClient... threw an Exception. Shutting down now...{code}
Thus to fix this we should avoid using an external thread pool and handle
retrying in a synchronous way.
was:
The current Druid-Kerberos-Http client is using an external single threaded
pool to handle retry auth calls (eg when a cookie expire or other transient
auth issues).
First, this is not buying us anything since all the Druid Task is executed as
one synchronous task.
Second, this can cause a major issue if an exception occurs that leads to
shutting down the LLAP main thread with excpetion like {code}
org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon: Thread
Thread[KerberosHttpClient... threw an Exception. Shutting down now...{code}
Thus to fix this we should avoid using an external thread pool and handle
retrying in a synchronous way.
> Avoid creating extra pool of threads within LLAP
> ------------------------------------------------
>
> Key: HIVE-18959
> URL: https://issues.apache.org/jira/browse/HIVE-18959
> Project: Hive
> Issue Type: Task
> Components: Druid integration
> Environment: Kerberos Cluster
> Reporter: slim bouguerra
> Assignee: slim bouguerra
> Priority: Major
> Fix For: 3.0.0
>
>
> The current Druid-Kerberos-Http client is using an external single threaded
> pool to handle retry auth calls (eg when a cookie expire or other transient
> auth issues).
> First, this is not buying us anything since all the Druid Task is executed as
> one synchronous task.
> Second, this can cause a major issue if an exception occurs that leads to
> shutting down the LLAP main thread with an exception like:
> {code} org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon: Thread
> Thread[KerberosHttpClient... threw an Exception. Shutting down now...{code}
> Thus to fix this we should avoid using an external thread pool and handle
> retrying in a synchronous way.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
