[ 
https://issues.apache.org/jira/browse/DRILL-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Timothy Farkas updated DRILL-6326:
----------------------------------
    Description: 
The PartitionDecorator uses the DrillbitContext.getExecutor() threadpool for 
threads that send batches to downstream partitions. This threadpool is the same 
threadpool that is used for DataTunnel connections. This shared threadpool 
could cause a deadlock in the event where the number of partitions is greater 
than or equal to the max number of threads in the shared threadpool.

A fix for this would be to have a separate thread pool for partition senders. A 
similar strategy is used for avoiding deadlocks in the scanners (there is a 
dedicated scanner thread pool).

  was:The PartitionDecorator uses the DrillbitContext.getExecutor() threadpool 
for threads that send batches to downstream partitions. This threadpool is the 
same threadpool that is used for DataTunnel connections. This shared threadpool 
could cause a deadlock in the event where the number of partitions is greater 
than or equal to the max number of threads in the shared threadpool.


> Possible Deadlock in Partition Decorator Due To Shared ThreadPool With 
> DataTunnel
> ---------------------------------------------------------------------------------
>
>                 Key: DRILL-6326
>                 URL: https://issues.apache.org/jira/browse/DRILL-6326
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Timothy Farkas
>            Assignee: Timothy Farkas
>            Priority: Major
>
> The PartitionDecorator uses the DrillbitContext.getExecutor() threadpool for 
> threads that send batches to downstream partitions. This threadpool is the 
> same threadpool that is used for DataTunnel connections. This shared 
> threadpool could cause a deadlock in the event where the number of partitions 
> is greater than or equal to the max number of threads in the shared 
> threadpool.
> A fix for this would be to have a separate thread pool for partition senders. 
> A similar strategy is used for avoiding deadlocks in the scanners (there is a 
> dedicated scanner thread pool).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to