milleruntime opened a new issue #1620: URL: https://github.com/apache/accumulo/issues/1620
The implementation of VolumeManager may be negating some of the work done in other areas of code where we are using threadpools and futures to improve calls to the Namenode. I think this is only noticeable during the Bulk import processes (old and new) when we are calling [VolumeManager.rename()](https://github.com/apache/accumulo/blob/dd4a488a9077cdd5e90cbff89fbcf7e9147381a7/server/base/src/main/java/org/apache/accumulo/server/fs/VolumeManagerImpl.java#L282) when moving the files. @ivakegg and I recently saw a lot of threads waiting on a single rename during a Bulk import in 1.9. It is possible the way that we are reusing the hadoop FileSystem in the VolumeManager code in 1.9 is causing this. It is also possible that this was fixed with the refactor done in #1553 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
