[jira] [Created] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky

Wei-Chiu Chuang created HDFS-9565: - Summary: TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky Key: HDFS-9565 URL: https://issues.apache.org/jira/browse/HDFS-9565 Project:

Hadoop-Hdfs-trunk - Build # 2633 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2633/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7622 lines...] [INFO] --- maven-antrun-plugin:1.7:run

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag. Are we still doing that? What are the RC0.1 and RC1 tags doing then? +Vinod > On Dec 16, 2015, at 2:13 AM, Junping Du wrote: > > Thanks Akira for notice this. I don't think we can remove these

[jira] [Resolved] (HDFS-3356) When dfs.block.size is configured to 0 the block which is created in rbw is never deleted

[ https://issues.apache.org/jira/browse/HDFS-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-3356. -- Resolution: Won't Fix This is not an issue since we now have minimum block size enforcement. > When

[jira] [Created] (HDFS-9563) DiskBalancer: Refactor Plan Command

Xiaobing Zhou created HDFS-9563: --- Summary: DiskBalancer: Refactor Plan Command Key: HDFS-9563 URL: https://issues.apache.org/jira/browse/HDFS-9563 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9564) DiskBalancer: Refactor Execute Command

Xiaobing Zhou created HDFS-9564: --- Summary: DiskBalancer: Refactor Execute Command Key: HDFS-9564 URL: https://issues.apache.org/jira/browse/HDFS-9564 Project: Hadoop HDFS Issue Type: Sub-task

Hadoop-Hdfs-trunk-Java8 - Build # 699 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/699/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7001 lines...] [INFO] Executing tasks main:

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding) - verified checksums - built Spark and Tez with -Dhadoop.version=2.6.3. About Tez, ran tests and all of them passed. Thanks, - Tsuyoshi On Thu, Dec 17, 2015 at 1:30 AM, Sangjin Lee wrote: > +1 (non-binding) > > - downloaded source and binary and verified the

[jira] [Resolved] (HDFS-9568) Support NFSv4 interface to HDFS

[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-9568. -- Resolution: Duplicate > Support NFSv4 interface to HDFS > --- > >

[jira] [Created] (HDFS-9567) LlapServiceDriver can fail if only the packaged logger config is present

Sergey Shelukhin created HDFS-9567: -- Summary: LlapServiceDriver can fail if only the packaged logger config is present Key: HDFS-9567 URL: https://issues.apache.org/jira/browse/HDFS-9567 Project:

[jira] [Resolved] (HDFS-9567) LlapServiceDriver can fail if only the packaged logger config is present

[ https://issues.apache.org/jira/browse/HDFS-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HDFS-9567. Resolution: Invalid Wrong project > LlapServiceDriver can fail if only the packaged logger

[jira] [Created] (HDFS-9568) Support NFSv4 interface to HDFS

John Zhuge created HDFS-9568: Summary: Support NFSv4 interface to HDFS Key: HDFS-9568 URL: https://issues.apache.org/jira/browse/HDFS-9568 Project: Hadoop HDFS Issue Type: New Feature

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding) for the RC except for my question below about the tag. I checked 2.6.3-RC0, based on my check-list: - Signatures and message digests all are good in general. - The top level full LICENSE, NOTICE and README for the source artifacts are good - CHANGES.txt for common, hdfs and mapped

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding) - Verified signatures and digests- Successfully built from source with native code support- Deployed to a single-node cluster and ran some test jobs Jason From: Junping Du To: Hadoop Common ; "hdfs-dev@hadoop.apache.org"

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (non-binding) 1. Download the pre-built tar and check the validity 2. Configure and start a pseudo-distributed cluster 3. Run example grep MapReduce job locally 4. Operate the HDFS copying files from/to local directory 5. Check execution logs All good. Thanks. L > On Dec 11, 2015, at 4:16

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

The last of the blockers went in late last week. Re-spinning the RC now. Thanks +Vinod > On Nov 13, 2015, at 10:26 AM, Vinod Kumar Vavilapalli > wrote: > > Thanks for reporting this Jason! > > Everyone, I am canceling this RC given the feedback, we will go again after >

Hadoop-Hdfs-trunk-Java8 - Build # 700 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/700/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10481 lines...] [INFO] ---

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #700

See Changes: [junping_du] YARN-4452. NPE when submit Unmanaged application. Contributed by [cnauroth] HDFS-9557. Reduce object allocation in PB conversion. Contributed by [sseth] YARN-4207. Add a non-judgemental YARN app

[jira] [Created] (HDFS-9566) Remove expensive getStorages method

Daryn Sharp created HDFS-9566: - Summary: Remove expensive getStorages method Key: HDFS-9566 URL: https://issues.apache.org/jira/browse/HDFS-9566 Project: Hadoop HDFS Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

Seeing as this came up very late, I am leaning towards dropping this off from 2.7.2. That said, I don’t see any reason why this shouldn’t be in 2.8.0 and 2.7.3. Set the target-versions accordingly on JIRA. If you agree, appreciate backport help to those branches. Thanks +Vinod > On Dec 15,

[jira] [Resolved] (HDFS-9551) Random VolumeChoosingPolicy

[ https://issues.apache.org/jira/browse/HDFS-9551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-9551. --- Resolution: Won't Fix Based on discussion here, I don't want to add the maintenance burden of a new

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding), Build and deploy the cluster from source code. Ran a few example jobs and passed successfully. Xuan Gong > On Dec 16, 2015, at 4:07 PM, Arpit Agarwal wrote: > > +1 (binding) > > - Verified signatures for source and binary distributions > - Built jars

Build failed in Jenkins: Hadoop-Hdfs-trunk #2635

See Changes: [wangda] YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil [wangda] YARN-4225. Add preemption status to yarn queue -status for capacity [wangda] YARN-4416. Deadlock due to synchronised get

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding) - Verified signatures for source and binary distributions - Built jars from source with java 1.7.0_79 - Deployed single-node pseudo-cluster - Ran example map reduce jobs - Ran hdfs admin commands, verified NN web UI shows expected usages On 12/11/15, 4:16 PM, "Junping Du"

TestDirectoryScanner.testThrottle() Failures

Would someone please review and commit HDFS-9300 so that the testThrottle() test will stop failing. It's a 2-line patch. Thanks, Daniel

Hadoop-Hdfs-trunk-Java8 - Build # 701 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/701/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7029 lines...] [INFO] ---

Hadoop-Hdfs-trunk - Build # 2634 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2634/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6357 lines...] [INFO] --- maven-antrun-plugin:1.7:run

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

Hey Vinod, Yes. We are voting for RC0 tag and all related build bits are related to RC0 only. Shall we do something special to RC0.1 or RC1 tag (they are just duplicated with RC0, pointing to the same commit as I mentioned below)? I guess no as we will have final tag for this

Build failed in Jenkins: Hadoop-Hdfs-trunk #2634

See Changes: [junping_du] YARN-4452. NPE when submit Unmanaged application. Contributed by [cnauroth] HDFS-9557. Reduce object allocation in PB conversion. Contributed by [sseth] YARN-4207. Add a non-judgemental YARN app completion

Re: TestDirectoryScanner.testThrottle() Failures

Done On Wed, Dec 16, 2015 at 4:17 PM, Daniel Templeton wrote: > Would someone please review and commit HDFS-9300 so that the > testThrottle() test will stop failing. It's a 2-line patch. > > Thanks, > Daniel >

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1, binding Did a build and test with slider with the build set to -Dhadoop.version=2.6.3 this does a D/L and test from the staging repo. All artifacts were located, and the tests completed > On 12 Dec 2015, at 00:16, Junping Du wrote: > > > Hi all developers in

RE: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (non-binding) -- Downloaded both source and binary tarballs successfully. --Set up a pseudo-distributed cluster and Distributed HA Cluster --Ran Several jobs Slive,Terasort and pi. --All are working fine. Thanks & Regards Brahma Reddy Battula From:

[jira] [Created] (HDFS-9559) Add haadmin command to get HA state of all the namenodes

Surendra Singh Lilhore created HDFS-9559: Summary: Add haadmin command to get HA state of all the namenodes Key: HDFS-9559 URL: https://issues.apache.org/jira/browse/HDFS-9559 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

> On 16 Dec 2015, at 06:41, Akira AJISAKA wrote: > > Thanks Junping for starting release process. > I noticed there are duplicated tags: > > * release-2.6.3-RC0 > * release-2.6.3-RC0.1 > * release-2.6.3-RC1 > > Could you remove RC0.1 and RC1? > > Regards, > Akira

[jira] [Created] (HDFS-9560) Fair AvailableSpaceVolumeChoosingPolicy

BELUGA BEHR created HDFS-9560: - Summary: Fair AvailableSpaceVolumeChoosingPolicy Key: HDFS-9560 URL: https://issues.apache.org/jira/browse/HDFS-9560 Project: Hadoop HDFS Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (non-binding) - downloaded source and binary and verified the signatures (although I didn't connect with Junping via web of trust) - started a pseudo-distributed cluster and ran test jobs - browsed the RM and NN UI - looked through the daemon logs Thanks Junping. Sangjin On Wed, Dec 16,

[jira] [Created] (HDFS-9561) PIpieline recovery near the end of a block may fail

Kihwal Lee created HDFS-9561: Summary: PIpieline recovery near the end of a block may fail Key: HDFS-9561 URL: https://issues.apache.org/jira/browse/HDFS-9561 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-1595) DFSClient may incorrectly detect datanode failure

[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-1595. -- Resolution: Duplicate Fix Version/s: HDFS-9178 > DFSClient may incorrectly detect datanode

[jira] [Resolved] (HDFS-8011) standby nn can't started

[ https://issues.apache.org/jira/browse/HDFS-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-8011. -- Resolution: Cannot Reproduce It is very likely fixed in the later releases when we fixed similar issues.

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

Thanks Akira for notice this. I don't think we can remove these tags as they should be immutable as branches. I created these duplicated tags as after I cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize I could still push to original tag by forcefully. The best thing I

Build failed in Jenkins: Hadoop-Hdfs-trunk #2632

See Changes: [zxu] Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE -- [...truncated 6179 lines...] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.739 sec -

Hadoop-Hdfs-trunk - Build # 2632 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2632/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6372 lines...] [INFO] --- maven-antrun-plugin:1.7:run