[ANNOUNCE] CFP open for ApacheCon North America 2016

Community growth starts by talking with those interested in your project. ApacheCon North America is coming, are you? We are delighted to announce that the Call For Presentations (CFP) is now open for ApacheCon North America. You can submit your proposed sessions at

Build failed in Jenkins: Hadoop-Common-trunk #2044

See Changes: [yzhang] HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via [ozawa] MAPREDUCE-6555. TestMRAppMaster fails on trunk. (Junping Du via ozawa) [ozawa] YARN-4380.

Build failed in Jenkins: Hadoop-common-trunk-Java8 #746

See Changes: [yzhang] HDFS-9438. TestPipelinesFailover assumes Linux ifconfig. (John Zhuge via [ozawa] MAPREDUCE-6555. TestMRAppMaster fails on trunk. (Junping Du via ozawa) [ozawa] YARN-4380. [aajisaka] HADOOP-12598. Add

Re: [DISCUSS] Looking to a 2.8.0 release

This is the current state from the feedback I gathered. - Support priorities across applications within the same queue YARN-1963 — Can push as an alpha / beta feature per Sunil - YARN-1197 Support changing resources of an allocated container: — Can push as an alpha/beta feature per

[jira] [Created] (HADOOP-12603) TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail

Wei-Chiu Chuang created HADOOP-12603: Summary: TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail Key: HADOOP-12603 URL: https://issues.apache.org/jira/browse/HADOOP-12603

Build failed in Jenkins: Hadoop-common-trunk-Java8 #749

See Changes: [wheat9] HDFS-9451. Clean up depreated umasks and related unit tests. Contributed [xyao] HDFS-8512. WebHDFS : GETFILESTATUS should return LocatedBlock with [shv] HDFS-9407. TestFileTruncate should not use fixed

[jira] [Created] (HADOOP-12602) TestMetricsSystemImpl#testQSize occasionally fail

Wei-Chiu Chuang created HADOOP-12602: Summary: TestMetricsSystemImpl#testQSize occasionally fail Key: HADOOP-12602 URL: https://issues.apache.org/jira/browse/HADOOP-12602 Project: Hadoop Common

Re: [DISCUSS] Looking to a 2.8.0 release

> On Nov 25, 2015, at 11:23 AM, Vinod Kumar Vavilapalli > wrote: > > There are 40 odd incompatible changes in 3.x: >

[Release thread] 2.8.0 release activities

Forking threads now in order to track all things related to the release. Creating the branch now. Thanks +Vinod > On Nov 25, 2015, at 11:37 AM, Vinod Kumar Vavilapalli > wrote: > > I think we’ve converged at a high level w.r.t 2.8. And as I just sent out an > email, I

Disable some of the Hudson integration comments on JIRA

Hi all, Right now we get something like 7 comments from Hudson whenever a change is committed. Would anyone object if I turned off 6 of them? We have variations like: Hadoop-trunk-Commit Hadoop-Hdfs-trunk-Java8 Hadoop-Yarn-trunk ...etc I propose leaving notifications on for just

Build failed in Jenkins: Hadoop-Common-trunk #2049

See Changes: [rkanter] MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause [rkanter] MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user [vinodkv] Adding release 2.8.0 to CHANGES.txt

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #750

See

Re: [Release thread] 2.8.0 release activities

Branch-2.8 is created. As mentioned before, the goal on branch-2.8 is to put improvements / fixes to existing features with a goal of converging on an alpha release soon. Thanks +Vinod > On Nov 25, 2015, at 5:30 PM, Vinod Kumar Vavilapalli > wrote: > > Forking threads

[jira] [Created] (HADOOP-12599) Add RM Delegation Token DtFetcher Implementation for DtUtil

Matthew Paduano created HADOOP-12599: Summary: Add RM Delegation Token DtFetcher Implementation for DtUtil Key: HADOOP-12599 URL: https://issues.apache.org/jira/browse/HADOOP-12599 Project:

Re: [DISCUSS] Looking to a 2.8.0 release

Hi Vinod, Thanks for driving this. Can you add YARN-2573 which includes the work done to integrate ReservationSystem with the RM failover mechanism to your list. This can be reviewed and committed (branch-2) also about a month back. Cheers, Subru On Wed, Nov 25, 2015 at 11:37 AM, Vinod Kumar

Re: [DISCUSS] Looking to a 2.8.0 release

Hey Vinod, I'm fine with the idea of alpha/beta marking in the abstract, but had a question: do we define these terms in our compatibility policy or elsewhere? I think it's commonly understood among us developers (alpha means not fully tested and API unstable, beta means it's not fully tested but

Re: [DISCUSS] Looking to a 2.8.0 release

Regarding interface visibility/stability, I'm aware of 2 relevant JIRAs right now. HADOOP-10776 proposes to mark Public some of the security plumbing like the FileSystem delegation token methods, UserGroupInformation, Token and Credentials. At this point, I think we are only fooling ourselves

Re: [DISCUSS] Looking to a 2.8.0 release

I think we’ve converged at a high level w.r.t 2.8. And as I just sent out an email, I updated the Roadmap wiki reflecting the same: https://wiki.apache.org/hadoop/Roadmap I plan to create a 2.8 branch EOD today. The goal for all of us should be to restrict improvements & fixes to only (a) the

[jira] [Created] (HADOOP-12600) FileContext should be annotated as a Stable interface.

Chris Nauroth created HADOOP-12600: -- Summary: FileContext should be annotated as a Stable interface. Key: HADOOP-12600 URL: https://issues.apache.org/jira/browse/HADOOP-12600 Project: Hadoop Common

Re: continuing releases on Apache Hadoop 2.6.x

Given there is a critical security fix (HADOOP-12577) coming, I think we should move faster on releasing 2.6.3. I would propose to freeze nominating new fixes to 2.6.3 unless they are critical enough as blocker. We can nominate more fixes later in 2.6.4. Thoughts? Thanks, Junping

Build failed in Jenkins: Hadoop-Common-trunk #2045

See Changes: [aajisaka] HADOOP-12598. Add XML namespace declarations for some hadoop/tools [yzhang] HDFS-6694. Addendum. Update CHANGES.txt for cherry-picking to 2.8. [junping_du] Tests in mapreduce-client-app are writing outside

Build failed in Jenkins: Hadoop-common-trunk-Java8 #747

See Changes: [junping_du] Tests in mapreduce-client-app are writing outside of target. Contributed -- [...truncated 5781 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0,

Build failed in Jenkins: Hadoop-common-trunk-Java8 #748

See Changes: [wheat9] HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after -- [...truncated 5793 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option

Re: [DISCUSS] Looking to a 2.8.0 release

Okay, tx for this clarification Chris! I dug more into this and now realized the actual scope of this. Given the the limited nature of this feature (non-Namenode etc) and the WIP nature of the larger umbrella HADOOP-11744, we will ship the feature but I’ll stop calling this out as a notable

Re: [DISCUSS] Looking to a 2.8.0 release

Tx for your comments, Andrew! I did talk about it in a few discussions in the past related to this but yes, we never codified the feature-level alpha/beta tags. Part of the reason why I never pushed for such a codification is that (a) it is a subjective decision that the feature contributors

Re: [DISCUSS] Looking to a 2.8.0 release

+1. Thanks, Vinod. --Chris Nauroth On 11/25/15, 1:45 PM, "Vinod Kumar Vavilapalli" wrote: >Okay, tx for this clarification Chris! I dug more into this and now >realized the actual scope of this. Given the the limited nature of this >feature (non-Namenode etc) and the

Re: [DISCUSS] Looking to a 2.8.0 release

SGTM, thanks Vinod! LMK if you need reviews on any of that. Regarding the release checklist, another item I'd add is updating the release notes in the project documentation, we've forgotten in the past. On Wed, Nov 25, 2015 at 2:01 PM, Vinod Kumar Vavilapalli wrote: > Tx

[jira] [Resolved] (HADOOP-12601) findbugs highlights problem with FsPermission

[ https://issues.apache.org/jira/browse/HADOOP-12601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HADOOP-12601. - Resolution: Duplicate Fixed in HDFS-9451. > findbugs highlights problem with FsPermission >

Re: [DISCUSS] Looking to a 2.8.0 release

Hi Vinod, The HDFS-8155 work is complete in branch-2 already, so feel free to include it in the roadmap. For those watching the thread that aren't familiar with HDFS-8155, I want to call out that it was a client-side change only. The WebHDFS client is capable of obtaining OAuth2 tokens and

[jira] [Created] (HADOOP-12601) findbugs highlights problem with FsPermission

Steve Loughran created HADOOP-12601: --- Summary: findbugs highlights problem with FsPermission Key: HADOOP-12601 URL: https://issues.apache.org/jira/browse/HADOOP-12601 Project: Hadoop Common

Build failed in Jenkins: Hadoop-Common-trunk #2046

See Changes: [wheat9] HDFS-9459. hadoop-hdfs-native-client fails test build on Windows after -- [...truncated 5386 lines...] Running org.apache.hadoop.util.TestLineReader Tests run: 1,

Jenkins build is back to normal : Hadoop-Common-trunk #2047

See

Re: [DISCUSS] Looking to a 2.8.0 release

Haohui, It’ll help to document this whole line of discussion about hdfs jar change and its impact/non-impact for existing users so there is less confusion. Thanks +Vinod > On Nov 11, 2015, at 3:26 PM, Haohui Mai wrote: > > bq. If and only if they take the Hadoop class

Re: [DISCUSS] Looking to a 2.8.0 release

Steve, > There's a lot of stuff in 2.8; I note that I'd like to see the s3a perf > improvements & openstack fixes in there: for which I need reviewers. I don't > have the spare time to do this myself. If you think they are useful, it helps to file tickets (or point out existing tickets),

Re: Disable some of the Hudson integration comments on JIRA

I think that's a good idea. Thanks for the proposal Andrew. --- Zhe Zhang On Wed, Nov 25, 2015 at 5:41 PM, Andrew Wang wrote: > Hi all, > > Right now we get something like 7 comments from Hudson whenever a change is > committed. Would anyone object if I turned off 6

Build failed in Jenkins: Hadoop-Common-trunk #2043

See Changes: [aajisaka] MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job [aajisaka] Fix indents in the 2.8.0 section of MapReduce CHANGES.txt. -- [...truncated 5402 lines...]

Build failed in Jenkins: Hadoop-common-trunk-Java8 #745

See Changes: [aajisaka] MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job [aajisaka] Fix indents in the 2.8.0 section of MapReduce CHANGES.txt. -- [...truncated 3901

Re: Disable some of the Hudson integration comments on JIRA

Yes, thats good idea. -Vinay On Thu, Nov 26, 2015 at 10:29 AM, Zhe Zhang wrote: > I think that's a good idea. Thanks for the proposal Andrew. > > --- > Zhe Zhang > > On Wed, Nov 25, 2015 at 5:41 PM, Andrew Wang > wrote: > > > Hi all, > > > >

Build failed in Jenkins: Hadoop-common-trunk-Java8 #751

See Changes: [vinayakumarb] HDFS-9426. Rollingupgrade finalization is not backward compatible -- [...truncated 5787 lines...] Running org.apache.hadoop.util.TestVersionUtil Tests run:

Jenkins build is back to normal : Hadoop-Common-trunk #2050

See