[jira] [Created] (HDFS-9468) DfsAdmin command set dataXceiver count for datanode

Lin Yiqun created HDFS-9468: --- Summary: DfsAdmin command set dataXceiver count for datanode Key: HDFS-9468 URL: https://issues.apache.org/jira/browse/HDFS-9468 Project: Hadoop HDFS Issue Type: Impro

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #641

See Changes: [cos] HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, -- [...truncated 7037 lines...] Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen T

Hadoop-Hdfs-trunk-Java8 - Build # 641 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/641/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7230 lines...] [INFO] Executing tasks main: [mk

Hadoop-Hdfs-trunk - Build # 2578 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2578/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8033 lines...] [INFO] Executing tasks main: [mkdir]

Build failed in Jenkins: Hadoop-Hdfs-trunk #2578

See Changes: [cos] HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, -- [...truncated 7840 lines...] Running org.apache.hadoop.hdfs.web.TestWebHdfsTokens Tests run: 11, Fa

Build failed in Jenkins: Hadoop-Hdfs-trunk #2579

See Changes: [aajisaka] MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job [aajisaka] Fix indents in the 2.8.0 section of MapReduce CHANGES.txt. -- [...truncated 6163 lines...] Tests

Hadoop-Hdfs-trunk - Build # 2579 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2579/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6356 lines...] [INFO] Executing tasks main: [mkdir]

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

> On 25 Nov 2015, at 02:48, Konstantin Boudnik wrote: > > Vinod, hopefully it isn't too late for a quick fix to be included into 2.7.2 > (sorry for jumping too late on this train). The JIRA in question is > HADOOP-12415 and I have committed it to trunk and branch-2 already. > > Please let me kn

[ANNOUNCE] CFP open for ApacheCon North America 2016

Community growth starts by talking with those interested in your project. ApacheCon North America is coming, are you? We are delighted to announce that the Call For Presentations (CFP) is now open for ApacheCon North America. You can submit your proposed sessions at http://events.linuxfoundation.o

Re: continuing releases on Apache Hadoop 2.6.x

Given there is a critical security fix (HADOOP-12577) coming, I think we should move faster on releasing 2.6.3. I would propose to freeze nominating new fixes to 2.6.3 unless they are critical enough as blocker. We can nominate more fixes later in 2.6.4. Thoughts? Thanks, Junping _

Re: continuing releases on Apache Hadoop 2.6.x

If the speed and clarity are important for the security release, then I would argue for a single-fix release (2.6.2 + HADOOP-12577 only). The verification of the RC and the associated release process would be so much faster. We would need to do a little bit of special branch creation etc., but it

Re: [DISCUSS] Looking to a 2.8.0 release

This is the current state from the feedback I gathered. - Support priorities across applications within the same queue YARN-1963 — Can push as an alpha / beta feature per Sunil - YARN-1197 Support changing resources of an allocated container: — Can push as an alpha/beta feature per Wangda

Re: [DISCUSS] Looking to a 2.8.0 release

There are 40 odd incompatible changes in 3.x: https://issues.apache.org/jira/issues/?jql=project%20in%20%28HADOOP%2C%20YARN%2C%20HDFS%2C%20MAPREDUCE%29%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%203.0.0%20AND%20fixVersion%20not%20in%20%282.6.2%2C%202.6.3%2C%202.7.1%2C%202.7.2%2C%202

[jira] [Created] (HDFS-9469) DiskBalancer : Add Planner

Anu Engineer created HDFS-9469: -- Summary: DiskBalancer : Add Planner Key: HDFS-9469 URL: https://issues.apache.org/jira/browse/HDFS-9469 Project: Hadoop HDFS Issue Type: Sub-task Comp

Re: [DISCUSS] Looking to a 2.8.0 release

I think we’ve converged at a high level w.r.t 2.8. And as I just sent out an email, I updated the Roadmap wiki reflecting the same: https://wiki.apache.org/hadoop/Roadmap I plan to create a 2.8 branch EOD today. The goal for all of us should be to restrict improvements & fixes to only (a) the

Re: [DISCUSS] Looking to a 2.8.0 release

Hi Vinod, Thanks for driving this. Can you add YARN-2573 which includes the work done to integrate ReservationSystem with the RM failover mechanism to your list. This can be reviewed and committed (branch-2) also about a month back. Cheers, Subru On Wed, Nov 25, 2015 at 11:37 AM, Vinod Kumar Vav

Re: [DISCUSS] Looking to a 2.8.0 release

Hey Vinod, I'm fine with the idea of alpha/beta marking in the abstract, but had a question: do we define these terms in our compatibility policy or elsewhere? I think it's commonly understood among us developers (alpha means not fully tested and API unstable, beta means it's not fully tested but

Re: continuing releases on Apache Hadoop 2.6.x

Thanks Sangjin for comments. This is also an option that I thought before. However, a single-fix release sounds a little overkill, especially after looking at the release scope of Apache commons-collections 3.3.2 (https://commons.apache.org/proper/commons-collections/release_3_2_2.html) which a

Re: [DISCUSS] Looking to a 2.8.0 release

Hi Vinod, The HDFS-8155 work is complete in branch-2 already, so feel free to include it in the roadmap. For those watching the thread that aren't familiar with HDFS-8155, I want to call out that it was a client-side change only. The WebHDFS client is capable of obtaining OAuth2 tokens and passi

Re: [DISCUSS] Looking to a 2.8.0 release

Okay, tx for this clarification Chris! I dug more into this and now realized the actual scope of this. Given the the limited nature of this feature (non-Namenode etc) and the WIP nature of the larger umbrella HADOOP-11744, we will ship the feature but I’ll stop calling this out as a notable feat

Build failed in Jenkins: Hadoop-Hdfs-trunk #2580

See Changes: [yzhang] HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via [ozawa] MAPREDUCE-6555. TestMRAppMaster fails on trunk. (Junping Du via ozawa) [ozawa] YARN-4380. [aajisaka] HADOOP-12598. Add XML name

Hadoop-Hdfs-trunk - Build # 2580 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2580/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8681 lines...] [INFO] Executed tasks [INFO] [INFO] --- m

Re: [DISCUSS] Looking to a 2.8.0 release

Tx for your comments, Andrew! I did talk about it in a few discussions in the past related to this but yes, we never codified the feature-level alpha/beta tags. Part of the reason why I never pushed for such a codification is that (a) it is a subjective decision that the feature contributors us

Re: [DISCUSS] Looking to a 2.8.0 release

+1. Thanks, Vinod. --Chris Nauroth On 11/25/15, 1:45 PM, "Vinod Kumar Vavilapalli" wrote: >Okay, tx for this clarification Chris! I dug more into this and now >realized the actual scope of this. Given the the limited nature of this >feature (non-Namenode etc) and the WIP nature of the large

Re: [DISCUSS] Looking to a 2.8.0 release

SGTM, thanks Vinod! LMK if you need reviews on any of that. Regarding the release checklist, another item I'd add is updating the release notes in the project documentation, we've forgotten in the past. On Wed, Nov 25, 2015 at 2:01 PM, Vinod Kumar Vavilapalli wrote: > Tx for your comments, Andr

[jira] [Created] (HDFS-9470) EncryptionZone on rootDir missing after NNrestart

Xiao Chen created HDFS-9470: --- Summary: EncryptionZone on rootDir missing after NNrestart Key: HDFS-9470 URL: https://issues.apache.org/jira/browse/HDFS-9470 Project: Hadoop HDFS Issue Type: Bug

Re: [DISCUSS] Looking to a 2.8.0 release

> On Nov 25, 2015, at 11:23 AM, Vinod Kumar Vavilapalli > wrote: > > There are 40 odd incompatible changes in 3.x: > https://issues.apache.org/jira/issues/?jql=project%20in%20%28HADOOP%2C%20YARN%2C%20HDFS%2C%20MAPREDUCE%29%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%203.0.0%20AND

Hadoop-Hdfs-trunk-Java8 - Build # 644 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/644/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7658 lines...] main: [mkdir] Created dir: /home

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #644

See Changes: [junping_du] Tests in mapreduce-client-app are writing outside of target. Contributed [wheat9] HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after [wheat9] HDFS-9451. Clean up depreated umasks a

[Release thread] 2.8.0 release activities

Forking threads now in order to track all things related to the release. Creating the branch now. Thanks +Vinod > On Nov 25, 2015, at 11:37 AM, Vinod Kumar Vavilapalli > wrote: > > I think we’ve converged at a high level w.r.t 2.8. And as I just sent out an > email, I updated the Roadmap wi

Re: [Release thread] 2.8.0 release activities

Branch-2.8 is created. As mentioned before, the goal on branch-2.8 is to put improvements / fixes to existing features with a goal of converging on an alpha release soon. Thanks +Vinod > On Nov 25, 2015, at 5:30 PM, Vinod Kumar Vavilapalli > wrote: > > Forking threads now in order to track

Hadoop-Hdfs-trunk - Build # 2581 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2581/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6369 lines...] [INFO] Executed tasks [INFO] [INFO] --- m

Build failed in Jenkins: Hadoop-Hdfs-trunk #2581

See Changes: [junping_du] Tests in mapreduce-client-app are writing outside of target. Contributed [wheat9] HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after [wheat9] HDFS-9451. Clean up depreated umasks and re

Hadoop-Hdfs-trunk-Java8 - Build # 645 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/645/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6173 lines...] main: [mkdir] Created dir: /home

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #645

See Changes: [shv] HDFS-9407. TestFileTruncate should not use fixed NN port. Contributed by [jing9] HDFS-9467. Fix data race accessing writeLockHeldTimeStamp in [rkanter] MAPREDUCE-6549. multibyte delimiters with LineRecordRead