[
https://issues.apache.org/jira/browse/DRILL-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Timothy Farkas updated DRILL-6326:
----------------------------------
Description:
The PartitionDecorator uses the DrillbitContext.getExecutor() threadpool for
threads that send batches to downstream partitions. This threadpool is the same
threadpool that is used for DataTunnel connections. This shared threadpool
could cause a deadlock in the event where the number of partitions is greater
than or equal to the max number of threads in the shared threadpool.
A fix for this would be to have a separate thread pool for partition senders. A
similar strategy is used for avoiding deadlocks in the scanners (there is a
dedicated scanner thread pool).
was:The PartitionDecorator uses the DrillbitContext.getExecutor() threadpool
for threads that send batches to downstream partitions. This threadpool is the
same threadpool that is used for DataTunnel connections. This shared threadpool
could cause a deadlock in the event where the number of partitions is greater
than or equal to the max number of threads in the shared threadpool.
> Possible Deadlock in Partition Decorator Due To Shared ThreadPool With
> DataTunnel
> ---------------------------------------------------------------------------------
>
> Key: DRILL-6326
> URL: https://issues.apache.org/jira/browse/DRILL-6326
> Project: Apache Drill
> Issue Type: Bug
> Reporter: Timothy Farkas
> Assignee: Timothy Farkas
> Priority: Major
>
> The PartitionDecorator uses the DrillbitContext.getExecutor() threadpool for
> threads that send batches to downstream partitions. This threadpool is the
> same threadpool that is used for DataTunnel connections. This shared
> threadpool could cause a deadlock in the event where the number of partitions
> is greater than or equal to the max number of threads in the shared
> threadpool.
> A fix for this would be to have a separate thread pool for partition senders.
> A similar strategy is used for avoiding deadlocks in the scanners (there is a
> dedicated scanner thread pool).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
