[VOTE] Release Apache Hadoop 2.6.4 RC0

Hi community folks, I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next maintenance release to follow up 2.6.3.) according to email thread of release plan 2.6.4 [1]. Below is details of this release candidate: The RC is available for validation at:

[jira] [Resolved] (HADOOP-12715) TestValueQueue#testgetAtMostPolicyALL fails intermittently

[ https://issues.apache.org/jira/browse/HADOOP-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HADOOP-12715. - Resolution: Fixed Fix Version/s: (was: 2.6.4) > TestValueQu

[jira] [Reopened] (HADOOP-12715) TestValueQueue#testgetAtMostPolicyALL fails intermittently

[ https://issues.apache.org/jira/browse/HADOOP-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HADOOP-12715: - > TestValueQueue#testgetAtMostPolicyALL fails intermitten

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

I give my binding +1 on 2.7.2-RC2 with following check: - All new commits (155) since 2.7.1 are included in commit log and CHANGES.txt which equally to JIRA marked as fixed in 2.7.2. - Signatures and message digests all are looks good, build get successfully from the source tar ball with JDK

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

In addition, all new fixes backport from 2.6.3 doesn't listed in 2.7.2 entry of CHANGES.txt but keep listed as 2.6.3. I think this is fine no matter we have multiple entries to track the same commit or a single entry to track the earliest commit. The only thing matter is the commits in release

Re: [UPDATE] New ASF git policy on force-pushes / Tags / Stale branches

There are also several stale branches for YARN-2928 that we should consolidate: remotes/origin/YARN-2928 remotes/origin/YARN-2928-new remotes/origin/YARN-2928-old remotes/origin/YARN-2928-old-2015-11-09 remotes/origin/YARN-2928-rebase remotes/origin/feature-YARN-2928 (the latest one)

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

shape now.​ Thanks, Junping​ From: Vinod Kumar Vavilapalli <vino...@apache.org> Sent: Wednesday, January 13, 2016 11:15 PM To: Junping Du Cc: mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org; common-dev@hadoop.apache.org; hdfs-...@hadoop.apac

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

unds good to me. > > > "any fix in 2.x.y to be there in all 2.b.c releases (while b>=x) that > get out after 2.x.y release date" > > +1 > > > I would prefer this rule only applies on critical/blocker fixes, but not > applies on minor/trivial issues. >

[DISCUSSION] Release Plan for Apache Hadoop 2.6.4

[1] Tickets fixed in 2.6.4: http://s.apache.org/vJB [2] Tickets targets for 2.6.4: http://s.apache.org/JpE From: Junping Du Sent: Thursday, December 17, 2015 1:36 PM To: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org Cc: hdfs-...@hadoop.apache

[jira] [Created] (HADOOP-12690) Consolidate access of sun.misc.Unsafe

Junping Du created HADOOP-12690: --- Summary: Consolidate access of sun.misc.Unsafe Key: HADOOP-12690 URL: https://issues.apache.org/jira/browse/HADOOP-12690 Project: Hadoop Common Issue Type

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

rivial issues. Just 2 cents. Thanks, Junping From: Vinod Kumar Vavilapalli <vino...@apache.org> Sent: Thursday, December 24, 2015 12:47 AM To: Junping Du Cc: mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org; common-dev@hadoop.apache.org; hdfs-..

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

Checked 2.7.2-RC1 tag which match exactly with 2.7.2 branch. Downloaded the release bit and deploy a single node cluster which works fine with running some example jobs. Built from src and check signatures, all looks good. Checked release note which has 138 commits (HADOOP:22, HDFS:42,

Re: Highlighting communication on releases

Thanks Karthik to bring up the topic. Comparing with small enhancement on email distribution for release/branch news, I think a more important thing is to make our community (contributor & committer) to be more aware on ongoing releases/branches. I can see two improvements could be helpful

[RESULT] [VOTE] Release Apache Hadoop 2.6.3 RC0

shows expected usages > > > > On 12/11/15, 4:16 PM, "Junping Du" <j...@hortonworks.com> wrote: > >> >> Hi all developers in hadoop community, >> I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next >> maintenance release t

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

hdfs-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0 So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag. Are we still doing that? What are the RC0.1 and RC1 tags doing then? +Vinod > On Dec 16, 2015, at 2:13 AM, Junping Du <j...@hortonwork

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

single node cluster setup and verified few MR jobs), >>>> submission of Unmanaged AM is getting the RM down. YARN-4452 has >>>> already been raised and i am working on it. Will provide the patch for >>>> the trunk and the 2.6.3 version asap >>>> >>>> Regards, >&

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

permission error. Could you check the permission to access the files? > Forbidden > You don't have permission to access > /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz on this server. Thanks, - Tsuyoshi On Sat, Dec 12, 2015 at 9:16 AM, Junping Du <j...@hortonworks.com<

Fw: ApacheCon NA 2015 Travel Assistance Applications now open!

FYI. Thanks, From: lewis john mcgibbney Sent: Tuesday, December 08, 2015 4:15 AM Cc: travel-assista...@apache.org Subject: ApacheCon NA 2015 Travel Assistance Applications now open! Hi pmcs@, The Travel Assistance Committee (TAC)

Release plan for Apache Hadoop 2.6.3

forward open tickets [2].​ Thanks, Junping [1] 2.6.3 Fixed Tickets: http://s.apache.org/Ylq [2] 2.6.3 Tickets: http://s.apache.org/9A7 From: Junping Du Sent: Tuesday, December 01, 2015 12:26 PM To: Vinod Kumar Vavilapalli Cc: Sangjin Lee; mapreduce

Re: continuing releases on Apache Hadoop 2.6.x

xu via jlowe) 7K Thanks, Junping From: Vinod Kumar Vavilapalli <vino...@apache.org> Sent: Monday, November 30, 2015 9:23 PM To: Junping Du Cc: Sangjin Lee; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org; Hadoop Common; hdfs-...@hadoop.a

Re: continuing releases on Apache Hadoop 2.6.x

lready have in would > like to see their work out there. > > On Fri, Nov 20, 2015 at 7:51 AM, Junping Du <j...@hortonworks.com> wrote: > > > +1. Early Dec sounds too early for 2.6.3 release given we only have 18 > > patches since recently release 2.6.2. > >

Re: continuing releases on Apache Hadoop 2.6.x

+1. Early Dec sounds too early for 2.6.3 release given we only have 18 patches since recently release 2.6.2. We should nominate more fixes and wait a while for the feedback on 2.6.2. Thanks, Junping From: Vinod Vavilapalli Sent:

Re: continuing releases on Apache Hadoop 2.6.x

Thanks Chris Trezzo for volunteer on helping 2.6.3 release. I think Sangjin was asking for a committer to serve as release manager for 2.6.3 according to Apache rules: http://www.apache.org/dev/release-publishing.html. I would like to serve as that role to work closely with you and Sangjin on

Re: [VOTE] Release Apache Hadoop 2.6.1 RC1

+1 (binding) with: - Download and verify signatures. - Build and deploy a single node cluster. - Run some example jobs (PI, etc.) on deployed cluster. Thanks, Junping From: Rohith Sharma K S Sent: Monday, September 21, 2015

Re: Planning Hadoop 2.6.1 release

I would like to nominate YARN-3832 as 2.6.1 candidate which is critical and I also saw it happened recently on a 2.6.0 cluster. Hope this is not too late. Thanks, Junping From: Rich Haase rha...@pandora.com Sent: Thursday, August 06, 2015 1:52 AM To:

[jira] [Resolved] (HADOOP-12283) CLONE - Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1

[ https://issues.apache.org/jira/browse/HADOOP-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HADOOP-12283. - Resolution: Duplicate Assignee: (was: Junping Du) CLONE - Backport Network Topology

[jira] [Reopened] (HADOOP-8151) Error handling in snappy decompressor throws invalid exceptions

[ https://issues.apache.org/jira/browse/HADOOP-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HADOOP-8151: Error handling in snappy decompressor throws invalid exceptions

[jira] [Resolved] (HADOOP-8151) Error handling in snappy decompressor throws invalid exceptions

[ https://issues.apache.org/jira/browse/HADOOP-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HADOOP-8151. Resolution: Fixed Fix Version/s: 2.8.0 Commit patch to branch-2. Error handling in snappy

[jira] [Resolved] (HADOOP-12033) Reducer task failure with java.lang.NoClassDefFoundError: Ljava/lang/InternalError at org.apache.hadoop.io.compress.snappy.SnappyDecompressor.decompressBytesDirect

[ https://issues.apache.org/jira/browse/HADOOP-12033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HADOOP-12033. - Resolution: Duplicate Thanks Zhihai Xu for confirmation on this. Already commit/merge HADOOP

[jira] [Created] (HADOOP-11962) Sasl message with MD5 challenge text shouldn't be LOG as debug level.

Junping Du created HADOOP-11962: --- Summary: Sasl message with MD5 challenge text shouldn't be LOG as debug level. Key: HADOOP-11962 URL: https://issues.apache.org/jira/browse/HADOOP-11962 Project

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

+1. (Non-binding) - Download and verify the checksum on src and binary locally. - Deploy a single node cluster and play with simple MR jobs, i.e. PI, Terasort, etc. All looks fine for now. Thanks, Junping From: Vinod Kumar Vavilapalli vino...@apache.org

Re: A 2.7.1 release to follow up 2.7.0

+1 (non-binding). The plan sounds reasonable. We should make our release train more fast-moving, and predictable - it could benefit our community and ecosystem in many aspects. Thanks, Junping From: Arpit Agarwal aagar...@hortonworks.com Sent: Thursday,

[jira] [Resolved] (HADOOP-10512) Document usage of node-group layer topology

[ https://issues.apache.org/jira/browse/HADOOP-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HADOOP-10512. - Resolution: Duplicate Assignee: (was: Junping Du) Document usage of node-group layer

Re: Looking to a Hadoop 3 release

Thanks all for good discussions here. +1 on supporting Java 8 ASAP. In addition, I agree that we should separating this effort with cutting down Hadoop 3. IMO, Hadoop is still very cool today, and we should only consider Hadoop 3 until we have revolutionary feature (like YARN for 2.0) which

[jira] [Created] (HADOOP-11274) ConcurrentModificationException in Configuration Copy Constructor

Junping Du created HADOOP-11274: --- Summary: ConcurrentModificationException in Configuration Copy Constructor Key: HADOOP-11274 URL: https://issues.apache.org/jira/browse/HADOOP-11274 Project: Hadoop

[jira] [Created] (HADOOP-11177) Reduce tar ball size for MR over distributed cache

Junping Du created HADOOP-11177: --- Summary: Reduce tar ball size for MR over distributed cache Key: HADOOP-11177 URL: https://issues.apache.org/jira/browse/HADOOP-11177 Project: Hadoop Common

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

+1. Non-binding. Thanks, Junping On Fri, Jun 20, 2014 at 10:54 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I'd like to propose we change our by-laws to reduce our voting periods on new releases from 7 days to 5. Currently, it just takes too long to turn around releases;

[jira] [Created] (HADOOP-10729) Add tests for PB RPC in case version mismatch of client and server

Junping Du created HADOOP-10729: --- Summary: Add tests for PB RPC in case version mismatch of client and server Key: HADOOP-10729 URL: https://issues.apache.org/jira/browse/HADOOP-10729 Project: Hadoop

[jira] [Created] (HADOOP-10512) Document usage of node-group layer topology

Junping Du created HADOOP-10512: --- Summary: Document usage of node-group layer topology Key: HADOOP-10512 URL: https://issues.apache.org/jira/browse/HADOOP-10512 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-10006) Compilation failure in trunk for o.a.h.fs.swift.util.JSONUtil

Junping Du created HADOOP-10006: --- Summary: Compilation failure in trunk for o.a.h.fs.swift.util.JSONUtil Key: HADOOP-10006 URL: https://issues.apache.org/jira/browse/HADOOP-10006 Project: Hadoop Common

[jira] [Created] (HADOOP-10001) Document topology with NodeGroup layer configuration in branch-1

Junping Du created HADOOP-10001: --- Summary: Document topology with NodeGroup layer configuration in branch-1 Key: HADOOP-10001 URL: https://issues.apache.org/jira/browse/HADOOP-10001 Project: Hadoop

[jira] [Created] (HADOOP-9980) LightWeightGSet's modification field should be volatile so that detect changes by other thread in iteration.

Junping Du created HADOOP-9980: -- Summary: LightWeightGSet's modification field should be volatile so that detect changes by other thread in iteration. Key: HADOOP-9980 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HADOOP-9964) O.A.H.U.ReflectionUtils.printThreadInfo() is not thread-safe which cause TestHttpServer pending 10 minutes or longer.

Junping Du created HADOOP-9964: -- Summary: O.A.H.U.ReflectionUtils.printThreadInfo() is not thread-safe which cause TestHttpServer pending 10 minutes or longer. Key: HADOOP-9964 URL: https://issues.apache.org/jira

[jira] [Created] (HADOOP-9784) Add builder in creating HttpServer

Junping Du created HADOOP-9784: -- Summary: Add builder in creating HttpServer Key: HADOOP-9784 URL: https://issues.apache.org/jira/browse/HADOOP-9784 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-9756) Additional cleanup RPC code

Junping Du created HADOOP-9756: -- Summary: Additional cleanup RPC code Key: HADOOP-9756 URL: https://issues.apache.org/jira/browse/HADOOP-9756 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-9616) In branch-2, baseline of Javadoc Warnings (specified in test-patch.properties) is mismatch with Javadoc warnings in current codebase

Junping Du created HADOOP-9616: -- Summary: In branch-2, baseline of Javadoc Warnings (specified in test-patch.properties) is mismatch with Javadoc warnings in current codebase Key: HADOOP-9616 URL: https

[jira] [Reopened] (HADOOP-8470) Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup)

[ https://issues.apache.org/jira/browse/HADOOP-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HADOOP-8470: Reopen this JIRA for backport to branch-2. Implementation of 4-layer subclass

[jira] [Reopened] (HADOOP-8469) Make NetworkTopology class pluggable

[ https://issues.apache.org/jira/browse/HADOOP-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HADOOP-8469: Backport this patch to branch-2 Make NetworkTopology class pluggable

[jira] [Resolved] (HADOOP-9165) Dynamic Resource/Slot Configuration on NM/TT

[ https://issues.apache.org/jira/browse/HADOOP-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HADOOP-9165. Resolution: Invalid Track this issue in separated JIRA for YARN and MRV1

[jira] [Created] (HADOOP-9045) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

Junping Du created HADOOP-9045: -- Summary: In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup Key: HADOOP-9045 URL: https://issues.apache.org

[jira] [Created] (HADOOP-9047) TestHDFSFileSystemContract.testMkdirsWithUmask failed by using umask 022

Junping Du created HADOOP-9047: -- Summary: TestHDFSFileSystemContract.testMkdirsWithUmask failed by using umask 022 Key: HADOOP-9047 URL: https://issues.apache.org/jira/browse/HADOOP-9047 Project: Hadoop

[jira] [Created] (HADOOP-9048) TestHDFSFileSystemContract.testMkdirsWithUmask failed by using umask 022

Junping Du created HADOOP-9048: -- Summary: TestHDFSFileSystemContract.testMkdirsWithUmask failed by using umask 022 Key: HADOOP-9048 URL: https://issues.apache.org/jira/browse/HADOOP-9048 Project: Hadoop

[jira] [Resolved] (HADOOP-9048) TestHDFSFileSystemContract.testMkdirsWithUmask failed by using umask 022

[ https://issues.apache.org/jira/browse/HADOOP-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HADOOP-9048. Resolution: Duplicate It is duplicated with HADOOP-9047 as double click jira creation based

[jira] [Created] (HADOOP-8817) Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1

Junping Du created HADOOP-8817: -- Summary: Backport Network Topology Extension for Virtualization (HADOOP-8468) to branch-1 Key: HADOOP-8817 URL: https://issues.apache.org/jira/browse/HADOOP-8817 Project

[jira] [Created] (HADOOP-8820) Backport HADOOP-8469 and HADOOP-8470: add NodeGroup layer in new NetworkTopology (also known as NetworkTopologyWithNodeGroup)

Junping Du created HADOOP-8820: -- Summary: Backport HADOOP-8469 and HADOOP-8470: add NodeGroup layer in new NetworkTopology (also known as NetworkTopologyWithNodeGroup) Key: HADOOP-8820 URL: https://issues.apache.org

[jira] [Created] (HADOOP-8567) Backport conf servlet with dump running configuration to branch 1.x

Junping Du created HADOOP-8567: -- Summary: Backport conf servlet with dump running configuration to branch 1.x Key: HADOOP-8567 URL: https://issues.apache.org/jira/browse/HADOOP-8567 Project: Hadoop

[jira] [Created] (HADOOP-8557) Core Test failed in jekins for patch pre-commit

Junping Du created HADOOP-8557: -- Summary: Core Test failed in jekins for patch pre-commit Key: HADOOP-8557 URL: https://issues.apache.org/jira/browse/HADOOP-8557 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-8542) TestViewFsTrash failed several times on Precommit test

Junping Du created HADOOP-8542: -- Summary: TestViewFsTrash failed several times on Precommit test Key: HADOOP-8542 URL: https://issues.apache.org/jira/browse/HADOOP-8542 Project: Hadoop Common

[jira] [Created] (HADOOP-8526) Fix 13 Javadoc Warning in hadoop-hdfs-raid project

Junping Du created HADOOP-8526: -- Summary: Fix 13 Javadoc Warning in hadoop-hdfs-raid project Key: HADOOP-8526 URL: https://issues.apache.org/jira/browse/HADOOP-8526 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-8475) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

Junping Du created HADOOP-8475: -- Summary: 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN) Key: HADOOP-8475 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HADOOP-8468) Umbrella of enhancements to support different failure and locality topologies

Junping Du created HADOOP-8468: -- Summary: Umbrella of enhancements to support different failure and locality topologies Key: HADOOP-8468 URL: https://issues.apache.org/jira/browse/HADOOP-8468 Project

[jira] [Created] (HADOOP-8469) Make NetworkTopology class pluggable and support user specified topology class

Junping Du created HADOOP-8469: -- Summary: Make NetworkTopology class pluggable and support user specified topology class Key: HADOOP-8469 URL: https://issues.apache.org/jira/browse/HADOOP-8469 Project

[jira] [Created] (HADOOP-8470) Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup)

Junping Du created HADOOP-8470: -- Summary: Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWithNodeGroup) Key: HADOOP-8470 URL: https://issues.apache.org/jira/browse/HADOOP-8470

[jira] [Created] (HADOOP-8471) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

Junping Du created HADOOP-8471: -- Summary: Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass Key: HADOOP-8471 URL: https://issues.apache.org/jira/browse/HADOOP-8471 Project: Hadoop

[jira] [Created] (HADOOP-8473) Update Balancer to support new NetworkTopology with NodeGroup

Junping Du created HADOOP-8473: -- Summary: Update Balancer to support new NetworkTopology with NodeGroup Key: HADOOP-8473 URL: https://issues.apache.org/jira/browse/HADOOP-8473 Project: Hadoop Common

[jira] [Created] (HADOOP-8372) normalizeHostName() in NetUtils is not working properly in resolving a hostname start with numeric character

Junping Du created HADOOP-8372: -- Summary: normalizeHostName() in NetUtils is not working properly in resolving a hostname start with numeric character Key: HADOOP-8372 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HADOOP-8304) DNSToSwitchMapping should add interface to resolve individual host besides a list of host

Junping Du created HADOOP-8304: -- Summary: DNSToSwitchMapping should add interface to resolve individual host besides a list of host Key: HADOOP-8304 URL: https://issues.apache.org/jira/browse/HADOOP-8304

<    1   2