simha03 opened a new issue, #19904:
URL: https://github.com/apache/druid/issues/19904

   We have using druid 37 and we are facing issue with threadpool not closing 
for MSQ as its not releasing the threads on task exit. we are exhausting the 
native threads due to this threads leak. once the threads hit the ulimit value 
it doesnt allow any new threads creation until we restart the indexer service. 
The issue is more visible in indexer as MSQ  runs on same jvm unlike middle 
manager where each MSQ will fork different JVM.
   
   ```
   [root@xxxxx ~]# ls /proc/32589/task | wc -l
   254,869
   [root@xxxxx ~]#
   ```
   
   Looks the issue was identified and fixed : dedicated ephemeral storage 
loading pool for tasks- #19658
   #19658 
   I could see the backporting is done only to druid 38. Can we backport to 
druid 37 as its is a major break on druid stability running MSQ running on 
indexers ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to