Jason Lowe created HADOOP-10048: ----------------------------------- Summary: LocalDirAllocator should avoid holding locks while accessing the filesystem Key: HADOOP-10048 URL: https://issues.apache.org/jira/browse/HADOOP-10048 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.3.0 Reporter: Jason Lowe
As noted in MAPREDUCE-5584 and HADOOP-7016, LocalDirAllocator can be a bottleneck for multithreaded setups like the ShuffleHandler. We should consider moving to a lockless design or minimizing the critical sections to a very small amount of time that does not involve I/O operations. -- This message was sent by Atlassian JIRA (v6.1#6144)