Re: [VOTE] Release Apache Hadoop 2.3.0
Very nice! I'll take it for the usual round of testing in Bigtop. Should take a few days, but I'll keep you guys posted! Thanks, Roman. On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to > get released. > > The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 > The RC tag in svn is here: > https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 > > The maven artifacts are available via repository.apache.org. > > Please try the release and vote; the vote will run for the usual 7 days. > > thanks, > Arun > > PS: Thanks to Andrew, Vinod & Alejandro for all their help in various release > activities. > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You.
[jira] [Created] (MAPREDUCE-5754) Preserve Job diagnostics in history
Gera Shegalov created MAPREDUCE-5754: Summary: Preserve Job diagnostics in history Key: MAPREDUCE-5754 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5754 Project: Hadoop Map/Reduce Issue Type: Improvement Components: jobhistoryserver, mr-am Reporter: Gera Shegalov Assignee: Gera Shegalov History does not store the runtime diagnostics information. JobHistoryParser tries to blame a task. We propose to preserve the original runtime diagnostics that covers all the cases including the job being killed. This is particularly important in the context of user-supplied diagnostic message as in MAPREDUCE-5648. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
Re: [VOTE] Release Apache Hadoop 2.3.0
Looks good. +1, also non-binding. I downloaded the source tarball, checked md5, built, ran some unit tests, ran an HDFS cluster. cheers, Colin On Tue, Feb 11, 2014 at 6:53 PM, Andrew Wang wrote: > Thanks for putting this together Arun. > > +1 non-binding > > Downloaded source tarball > Verified signature and digests > Ran apache-rat:check > Built with "mvn clean package install -Pdist -Dtar" > Started a one-node cluster and ran wordcount > > Best, > Andrew > > On Tue, Feb 11, 2014 at 5:40 PM, Ravi Prakash wrote: > >> Thanks Arun for another release! >> >> +1 non-binding >> >> Verified signatures, deployed a single node cluster and ran sleep and >> wordcount. Everything looks fine. >> >> >> Regards >> Ravi >> >> >> >> >> On Tuesday, February 11, 2014 5:36 PM, Travis Thompson < >> tthomp...@linkedin.com> wrote: >> >> Everything looks good so far, running on 100 nodes with security enabled. >> >> I've found two minor issues I've found with the new Namenode UI so far and >> will work on them over the next few days: >> >> HDFS-5934 >> HDFS-5935 >> >> Thanks, >> >> Travis >> >> >> On Feb 11, 2014, at 4:53 PM, Mohammad Islam >> wrote: >> >> > Thanks Arun for the initiative. >> > >> > +1 non-binding. >> > >> > >> > I tested the followings: >> > 1. Build package from the source tar. >> > 2. Verified with md5sum >> > 3. Verified with gpg >> > 4. Basic testing >> > >> > Overall, good to go. >> > >> > Regards, >> > Mohammad >> > >> > >> > >> > >> > On Tuesday, February 11, 2014 2:07 PM, Chen He >> wrote: >> > >> > +1, non-binding >> > successful compiled on MacOS 10.7 >> > deployed to Fedora 7 and run test job without any problem. >> > >> > >> > >> > On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy >> wrote: >> > >> >> Folks, >> >> >> >> I've created a release candidate (rc0) for hadoop-2.3.0 that I would >> like >> >> to get released. >> >> >> >> The RC is available at: >> >> http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 >> >> The RC tag in svn is here: >> >> https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 >> >> >> >> The maven artifacts are available via repository.apache.org. >> >> >> >> Please try the release and vote; the vote will run for the usual 7 days. >> >> >> >> thanks, >> >> Arun >> >> >> >> PS: Thanks to Andrew, Vinod & Alejandro for all their help in various >> >> release activities. >> >> -- >> >> CONFIDENTIALITY NOTICE >> >> NOTICE: This message is intended for the use of the individual or >> entity to >> >> which it is addressed and may contain information that is confidential, >> >> privileged and exempt from disclosure under applicable law. If the >> reader >> >> of this message is not the intended recipient, you are hereby notified >> that >> >> any printing, copying, dissemination, distribution, disclosure or >> >> forwarding of this communication is strictly prohibited. If you have >> >> received this communication in error, please contact the sender >> immediately >> >> and delete it from your system. Thank You. >>
Re: [VOTE] Release Apache Hadoop 2.3.0
Thanks Arun for another release! +1 non-binding Verified signatures, deployed a single node cluster and ran sleep and wordcount. Everything looks fine. Regards Ravi On Tuesday, February 11, 2014 5:36 PM, Travis Thompson wrote: Everything looks good so far, running on 100 nodes with security enabled. I've found two minor issues I've found with the new Namenode UI so far and will work on them over the next few days: HDFS-5934 HDFS-5935 Thanks, Travis On Feb 11, 2014, at 4:53 PM, Mohammad Islam wrote: > Thanks Arun for the initiative. > > +1 non-binding. > > > I tested the followings: > 1. Build package from the source tar. > 2. Verified with md5sum > 3. Verified with gpg > 4. Basic testing > > Overall, good to go. > > Regards, > Mohammad > > > > > On Tuesday, February 11, 2014 2:07 PM, Chen He wrote: > > +1, non-binding > successful compiled on MacOS 10.7 > deployed to Fedora 7 and run test job without any problem. > > > > On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy wrote: > >> Folks, >> >> I've created a release candidate (rc0) for hadoop-2.3.0 that I would like >> to get released. >> >> The RC is available at: >> http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 >> The RC tag in svn is here: >> https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 >> >> The maven artifacts are available via repository.apache.org. >> >> Please try the release and vote; the vote will run for the usual 7 days. >> >> thanks, >> Arun >> >> PS: Thanks to Andrew, Vinod & Alejandro for all their help in various >> release activities. >> -- >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity to >> which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You.
Re: [VOTE] Release Apache Hadoop 2.3.0
Everything looks good so far, running on 100 nodes with security enabled. I've found two minor issues I've found with the new Namenode UI so far and will work on them over the next few days: HDFS-5934 HDFS-5935 Thanks, Travis On Feb 11, 2014, at 4:53 PM, Mohammad Islam wrote: > Thanks Arun for the initiative. > > +1 non-binding. > > > I tested the followings: > 1. Build package from the source tar. > 2. Verified with md5sum > 3. Verified with gpg > 4. Basic testing > > Overall, good to go. > > Regards, > Mohammad > > > > > On Tuesday, February 11, 2014 2:07 PM, Chen He wrote: > > +1, non-binding > successful compiled on MacOS 10.7 > deployed to Fedora 7 and run test job without any problem. > > > > On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy wrote: > >> Folks, >> >> I've created a release candidate (rc0) for hadoop-2.3.0 that I would like >> to get released. >> >> The RC is available at: >> http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 >> The RC tag in svn is here: >> https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 >> >> The maven artifacts are available via repository.apache.org. >> >> Please try the release and vote; the vote will run for the usual 7 days. >> >> thanks, >> Arun >> >> PS: Thanks to Andrew, Vinod & Alejandro for all their help in various >> release activities. >> -- >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity to >> which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. signature.asc Description: Message signed with OpenPGP using GPGMail
Re: [VOTE] Release Apache Hadoop 2.3.0
Thanks Arun for the initiative. +1 non-binding. I tested the followings: 1. Build package from the source tar. 2. Verified with md5sum 3. Verified with gpg 4. Basic testing Overall, good to go. Regards, Mohammad On Tuesday, February 11, 2014 2:07 PM, Chen He wrote: +1, non-binding successful compiled on MacOS 10.7 deployed to Fedora 7 and run test job without any problem. On Tue, Feb 11, 2014 at 8:49 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.3.0 that I would like > to get released. > > The RC is available at: > http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 > The RC tag in svn is here: > https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 > > The maven artifacts are available via repository.apache.org. > > Please try the release and vote; the vote will run for the usual 7 days. > > thanks, > Arun > > PS: Thanks to Andrew, Vinod & Alejandro for all their help in various > release activities. > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. >
[jira] [Created] (MAPREDUCE-5753) finishedStatus is accessed without proper locking in RMContainerImpl#FinishedTransition#transition()
Ted Yu created MAPREDUCE-5753:
-
Summary: finishedStatus is accessed without proper locking in
RMContainerImpl#FinishedTransition#transition()
Key: MAPREDUCE-5753
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5753
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Ted Yu
{code}
container.finishedStatus = finishedEvent.getRemoteContainerStatus();
{code}
The access should be guarded by obtaining readLock
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
[jira] [Created] (MAPREDUCE-5752) Potential invalid iterator in NMClientImpl#cleanupRunningContainers()
Ted Yu created MAPREDUCE-5752:
-
Summary: Potential invalid iterator in
NMClientImpl#cleanupRunningContainers()
Key: MAPREDUCE-5752
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5752
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Ted Yu
Priority: Minor
In cleanupRunningContainers() :
{code}
for (StartedContainer startedContainer : startedContainers.values()) {
try {
stopContainer(startedContainer.getContainerId(),
startedContainer.getNodeId());
{code}
Removal of container is done in removeStartedContainer():
{code}
startedContainers.remove(container.containerId);
{code}
This may result in invalid iterator for the loop on startedContainers.values()
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
[jira] [Resolved] (MAPREDUCE-4401) Enhancements to MapReduce for Windows Server and Windows Azure development and runtime environments
[ https://issues.apache.org/jira/browse/MAPREDUCE-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-4401. -- Resolution: Fixed We've completed the intended scope of this issue, so I'm resolving it. Thank you to all contributors! > Enhancements to MapReduce for Windows Server and Windows Azure development > and runtime environments > --- > > Key: MAPREDUCE-4401 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4401 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: build, mrv2 >Affects Versions: 3.0.0 >Reporter: Bikas Saha >Assignee: Bikas Saha > > This JIRA tracks the work that needs to be done on trunk to enable Hadoop to > run on Windows Server and Azure environments. This incorporates porting > relevant work from the similar effort on branch 1 tracked via HADOOP-8079. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[VOTE] Release Apache Hadoop 2.3.0
Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released. The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.3.0-rc0 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun PS: Thanks to Andrew, Vinod & Alejandro for all their help in various release activities. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
