Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

+1 (non-binding) All the testing I've done are below: Testing all the download links: OK Checked MD5 checksums of all download files : Start from bin tar with cluster mode via docker container: OK Execute basic command via `hadoop fs`: OK Execute Word Count job: OK ‌ 2017-11-15 5:34

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

Hi Arpit, I agree the timing is not great here, but extending it to meaningfully avoid the holidays would mean extending it an extra week (e.g. to the 29th). We've been coordinating with ASF PR for that Tuesday, so I'd really, really like to get the RC out before then. In terms of downstream

Re: [DISCUSS] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

Update: We worked on the review comments and additional JIRAs above mentioned. >1. After the feedbacks from Andrew, Eddy, Xiao in JIRA reviews, we planned to take up the support for recursive API support. HDFS-12291 We provided the recursive API

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/44/ [Nov 16, 2017 5:12:52 PM] (sunilg) YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if [Nov 16, 2017 7:12:01 PM] (rkanter) HADOOP-14982. Clients using FailoverOnNetworkExceptionRetry

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

Thanks for the all of the work it took to finally get htere. +1 (binding) Built from source and stood up a pseudo cluster with 4 NMs Tested the following: o Cross queue preemption o Restarting the RM preserves work o User limits are honored during In-queue preemption o Priorities are honored

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

Wrapping up the vote with my +1. Deployed RC3 on a federated YARN cluster with 6 sub-clusters: - ran multiple sample jobs - enabled opportunistic containers and submitted more samples - configured HDFS federation and reran jobs. With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

Hi Andrew, Thank you for your hard work in getting us to this step. This is our first major GA release in many years. I feel a 5-day vote window ending over the weekend before thanksgiving may not provide sufficient time to evaluate this RC especially for downstream components. Would you

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

Thanks Arun and Subru for the hard work on this release. +1 (binding) Built from source and stood up a pseudo cluster with 4 NMs Tested the following: o User limits are honored during In-queue preemption o Priorities are honored during In-queue preemption o Can kill applications from the

[jira] [Created] (HDFS-12837) Intermittent failure TestReencryptionWithKMS#testReencryptionKMSDown

Surendra Singh Lilhore created HDFS-12837: - Summary: Intermittent failure TestReencryptionWithKMS#testReencryptionKMSDown Key: HDFS-12837 URL: https://issues.apache.org/jira/browse/HDFS-12837

[jira] [Created] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

Chao Sun created HDFS-12836: --- Summary: startTxId could be greater than endTxId when tailing in-progress edit log Key: HDFS-12836 URL: https://issues.apache.org/jira/browse/HDFS-12836 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

Thanks for the spot, normally create-release spits those out. I uploaded asc and mds for the release artifacts. Best, Andrew On Thu, Nov 16, 2017 at 11:33 PM, Akira Ajisaka wrote: > Hi Andrew, > > Signatures are missing. Would you upload them? > > Thanks, > Akira > > > On

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

Thanks for putting this release together! +1 (binding) - Verified signatures and digests - Successfully built from source including native - Deployed to single-node cluster and ran some test jobs Jason On Mon, Nov 13, 2017 at 6:10 PM, Arun Suresh wrote: > Hi Folks, > >

[jira] [Created] (HDFS-12835) RBF: Fix Javadoc parameter errors

Wei Yan created HDFS-12835: -- Summary: RBF: Fix Javadoc parameter errors Key: HDFS-12835 URL: https://issues.apache.org/jira/browse/HDFS-12835 Project: Hadoop HDFS Issue Type: Sub-task

Re: [DISCUSS] Apache Hadoop 2.7.5 Release Plan

Hi Konstantin, Thanks for initiating the release effort. I am marking HDFS-12641 as a blocker for Hadoop 2.7.5 because during our internal testing for CDH we found a regression in HDFS-11445 that was fixed by HDFS-11755 (technically not a real

[jira] [Created] (HDFS-12834) DFSZKFailoverController on error exits with 0 error code

Zbigniew Kostrzewa created HDFS-12834: - Summary: DFSZKFailoverController on error exits with 0 error code Key: HDFS-12834 URL: https://issues.apache.org/jira/browse/HDFS-12834 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (binding) * Built from source * Set up a 4 node cluster with RM HA enabled * Performed some basic HDFS commands * Ran a bunch of pi & sleep jobs - with and without opportunistic containers * Performed some basic RM failover testing. Cheers -Arun On Thu, Nov 16, 2017 at 11:12 PM, Akira

[jira] [Resolved] (HDFS-12820) Decommissioned datanode is counted in service cause datanode allcating failure

[ https://issues.apache.org/jira/browse/HDFS-12820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-12820. Resolution: Duplicate Thanks for reporting the issue, [~xiegang112]. Hadoop 2.4.0 is an old

[jira] [Created] (HDFS-12833) In Distcp, Delete option not having the proper usage message.

Harshakiran Reddy created HDFS-12833: Summary: In Distcp, Delete option not having the proper usage message. Key: HDFS-12833 URL: https://issues.apache.org/jira/browse/HDFS-12833 Project: Hadoop

[jira] [Created] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

DENG FEI created HDFS-12832: --- Summary: INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit Key: HDFS-12832 URL: https://issues.apache.org/jira/browse/HDFS-12832 Project:

[jira] [Created] (HDFS-12831) HDFS throws FileNotFoundException on getFileBlockLocations(path-to-directory)

Steve Loughran created HDFS-12831: - Summary: HDFS throws FileNotFoundException on getFileBlockLocations(path-to-directory) Key: HDFS-12831 URL: https://issues.apache.org/jira/browse/HDFS-12831

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/43/ [Nov 15, 2017 6:33:48 PM] (jlowe) YARN-7361. Improve the docker container runtime documentation. [Nov 16, 2017 12:45:06 AM] (xiao) HADOOP-15023. ValueQueue should also validate (int) (lowWatermark *