Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

2017-10-30 Thread Jitendra Pandey
Hi Konstantin, Thank you for taking out time to review ozone. I appreciate your comments and questions. > There are two main limitations in HDFS > a) The throughput of Namespace operations. Which is limited by the >number of RPCs the NameNode can handle > b) The number of objects (files + b

Cutting branch-2.9

2017-10-30 Thread Subru Krishnan
We want to give heads up that we are going to cut branch-2.9 tomorrow morning. We are down to 3 blockers and they all are close to being committed (thanks everyone): https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.9+Release There are 4 other non-blocker JIRAs that are targeted for 2.9

[VOTE] Merge yarn-native-services branch into trunk

2017-10-30 Thread Jian He
Hi All, I would like to restart the vote for merging yarn-native-services to trunk. Since last vote, we have been working on several issues in documentation, DNS, CLI modifications etc. We believe now the feature is in a much better shape. Some back ground: At a high level, the following are the

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-10-30 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/574/ [Oct 29, 2017 11:44:16 PM] (yufei) YARN-6747. TestFSAppStarvation.testPreemptionEnable fails [Oct 30, 2017 1:54:33 AM] (templedf) YARN-7374. Improve performance of DRF comparisons for resource types in

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-10-30 Thread Jian He
Few more things: This is the document for trying a non-docker service on YARN. https://github.com/apache/hadoop/blob/yarn-native-services/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/yarn-service/QuickStart.md And the document for a docker based service https://github.com/ap

Re: Cutting branch-2.9

2017-10-30 Thread Junping Du
Hi Subru and Arun, Thanks for moving forward with 2.9 release. Is the first cut of 2.9 release supposed to be a stable version or just an alpha version? If it is supposed to be a stable version, we should run jdiff test and check for API compatibility before releasing out. Please let me kno

Re: Cutting branch-2.9

2017-10-30 Thread Arun Suresh
Hello Jumping Thanks for chiming in.. Appreciate the offer to help. I did run jdiff on branch-2 today.. did not find any red flags. Will post the report here shortly for review. Cheers -Arun On Oct 30, 2017 4:44 PM, "Junping Du" wrote: > Hi Subru and Arun, > Thanks for moving forward with

Re: Hadoop Compatability Guide, Part Deux: Developer Docs

2017-10-30 Thread Daniel Templeton
We've now gone a couple of rounds of reviews on HADOOP-14876, and a patch is posted for HADOOP-14875.  Feedback is very welcome.  Please take a look. Daniel On 10/14/17 8:46 AM, Daniel Templeton wrote: I just posted a first patch for HADOOP-14876 that adds downstream developer docs based on t