Re: Release plans for Hadoop 2.10.0

Hi Wei-Chiu, Just got a chance to pull the jstack on a datanode that's showing high ReadBlockOpAvgTime and I found a few different scenarios: Lot of DataXceiver threads in the following state for a while java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method)

Re: Release plans for Hadoop 2.10.0

Hi Wei-Chiu, I came across HDFS-14476 when searching if anyone else is seeing the same issues as us. I didn't see it merged and so assumed there are other fixes done around what you mention in there. HDFS-11187 is already applied to 2.9.1 and we are on 2.9.2 and so it might not be impacting us th

Re: Release plans for Hadoop 2.10.0

or maybe https://issues.apache.org/jira/browse/HDFS-14476 I reverted this fix and I've not looked at it further. But take a look. It's disappointing to me that none of the active Hadoop contributors seem to understand DirectoryScanner well enough. or HDFS-11187

Re: Release plans for Hadoop 2.10.0

Thanks for the quick response Jonathan. Honestly, I am not sure if 2.10.0 will fix my issue but it looks similar to https://issues.apache.org/jira/browse/HDFS-14536 which is not fixed yet so we will probably not see the benefit. We need to either dig more into the logs and jstack and create a JIR

Re: Release plans for Hadoop 2.10.0

Hey Viral, yes. We're working on a 2.10.0 release, I'm the release manager for that. I can't comment on the particular issue you're seeing, but I plan to start the release process for 2.10.0 early next week, then 2.10.0 will be released shortly after that (assuming all goes well). Thanks, Jonathan