keith-turner opened a new issue, #5524:
URL: https://github.com/apache/accumulo/issues/5524

   **Is your feature request related to a problem? Please describe.**
   
   The property `manager.rename.threadpool.size` is used to control the number 
of threads used for renaming files for bulk import.  The implementation will 
create a thread pool of this size per bulk import operation.  If there are F 
fate threads and this property is R, then can create up to F*R threads in the 
worst case.  Eventually too many threads will start to cause problems.   Also 
since the thread pools are per bulk import, can not easily track metrics on the 
thread pools.
   
   
   **Describe the solution you'd like**
   
   A single thread pool in the manager that all bulk imports use would offer 
two advantages.
   
    * More predictable control over resources
    * Ability to track metrics related to the rename pool
   
   This single thread pool could hang off of server context.
   
   **Additional context**
   
   Changing the implementation behind this property could negatively impact 
current systems w/ current settings for this property as they would all of a 
sudden have less threads for this work in some cases.  So not sure where this 
change should land if its done.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@accumulo.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to