Re: [VOTE] Release hadoop-2.0.3-alpha
+1. Verified checksums and signature. Built from source and deployed on a multi node cluster. Verified with several MR examples. - Sid On Wed, Feb 6, 2013 at 7:59 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would like to release. This release contains several major enhancements such as QJM for HDFS HA, multi-resource scheduling for YARN, YARN ResourceManager restart etc. Also YARN has achieved significant stability at scale (more details from Y! folks here: http://s.apache.org/VYO). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.0.3-alpha-rc0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-2.0.3-alpha-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
Re: [VOTE] Release hadoop-2.0.3-alpha
+1 Verified checksums. Built from source, deployed and ran a couple of jobs. Kihwal On 2/6/13 9:59 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would like to release. This release contains several major enhancements such as QJM for HDFS HA, multi-resource scheduling for YARN, YARN ResourceManager restart etc. Also YARN has achieved significant stability at scale (more details from Y! folks here: http://s.apache.org/VYO). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.0.3-alpha-rc0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-2.0.3-alpha-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
Re: [VOTE] Release hadoop-2.0.3-alpha
+1 (non-binding) - Verified checksums and signatures on src and binary tarballs - Built from source - Deployed pseudo-distributed cluster and ran some example jobs Jason On 02/06/2013 09:59 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would like to release. This release contains several major enhancements such as QJM for HDFS HA, multi-resource scheduling for YARN, YARN ResourceManager restart etc. Also YARN has achieved significant stability at scale (more details from Y! folks here: http://s.apache.org/VYO). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.0.3-alpha-rc0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-2.0.3-alpha-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
[jira] [Reopened] (MAPREDUCE-4643) Make job-history cleanup-period configurable
[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened MAPREDUCE-4643: --- Make job-history cleanup-period configurable Key: MAPREDUCE-4643 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4643 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobhistoryserver Affects Versions: 1.0.3 Reporter: Karthik Kambatla Assignee: Sandy Ryza Fix For: 1.2.0 Attachments: MAPREDUCE-4643-branch1-2.patch, MAPREDUCE-4643-branch-1-3.patch, MAPREDUCE-4643-branch-1-4.patch, MAPREDUCE-4643-branch-1-5.patch, MAPREDUCE-4643-branch-1-6.patch, MAPREDUCE-4643-branch-1-addendum.patch, MAPREDUCE-4643-branch1.patch, MAPREDUCE-4643-branch1.patch, MAPREDUCE-4643.patch Job history cleanup should be made configurable. Currently, it is set to 1 month by default. The DEBUG_MODE (to be removed, see MAPREDUCE-4629) sets it to 20 minutes, but it should be configurable. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5002) AM could potentially allocate a reduce container to a map attempt
Jason Lowe created MAPREDUCE-5002: - Summary: AM could potentially allocate a reduce container to a map attempt Key: MAPREDUCE-5002 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5002 Project: Hadoop Map/Reduce Issue Type: Bug Components: mr-am Affects Versions: 2.0.3-alpha, 0.23.7 Reporter: Jason Lowe As discussed in MAPREDUCE-4982, after MAPREDUCE-4893 it is theoretically possible for the AM to accidentally assign a reducer container to a map attempt if the AM doesn't find a reduce attempt actively looking for the container (e.g.: the RM accidentally allocated too many reducer containers). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5003) AM recovery should recreate records for attempts that were incomplete
Jason Lowe created MAPREDUCE-5003: - Summary: AM recovery should recreate records for attempts that were incomplete Key: MAPREDUCE-5003 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5003 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mr-am Reporter: Jason Lowe As discussed in MAPREDUCE-4992, it would be nice if the AM recovered task attempt entries for *all* task attempts launched by the prior app attempt even if those task attempts did not complete. The attempts would have to be marked as killed or something similar to indicate it is no longer running. Having records for the task attempts enables the user to see what nodes were associated with the attempts and potentially access their logs. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] Release hadoop-2.0.3-alpha
We've created BigTop stack with 2.0.3 as the base. Ran YCSB, slive, and some other loads on up to 20 nodes clusters as a part of the release validation. Two issues were noted: - due to the known issue with Jetty we are seeing MR jobs hanging here and there - without properly configured capacity-scheduler.xml resource manager throws exception on the startup (BIGTOP-841). +1 Cos On Wed, Feb 06, 2013 at 07:59PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would like to release. This release contains several major enhancements such as QJM for HDFS HA, multi-resource scheduling for YARN, YARN ResourceManager restart etc. Also YARN has achieved significant stability at scale (more details from Y! folks here: http://s.apache.org/VYO). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.0.3-alpha-rc0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-2.0.3-alpha-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ signature.asc Description: Digital signature
Re: [VOTE] Release hadoop-2.0.3-alpha
On Tue, Feb 12, 2013 at 07:44PM, Konstantin Boudnik wrote: We've created BigTop stack with 2.0.3 as the base. Ran YCSB, slive, and some other loads on up to 20 nodes clusters as a part of the release validation. Two issues were noted: - due to the known issue with Jetty we are seeing MR jobs hanging here and there The issue referred here is reported as MAPREDUCE-2980 - without properly configured capacity-scheduler.xml resource manager throws exception on the startup (BIGTOP-841). +1 Cos On Wed, Feb 06, 2013 at 07:59PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would like to release. This release contains several major enhancements such as QJM for HDFS HA, multi-resource scheduling for YARN, YARN ResourceManager restart etc. Also YARN has achieved significant stability at scale (more details from Y! folks here: http://s.apache.org/VYO). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.0.3-alpha-rc0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-2.0.3-alpha-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/ signature.asc Description: Digital signature
Re: [VOTE] Release hadoop-2.0.3-alpha
+1 (non-binding) Built from source on Ubuntu and ran a couple different jobs under the fair scheduler. On Tue, Feb 12, 2013 at 8:52 PM, Konstantin Boudnik c...@apache.org wrote: On Tue, Feb 12, 2013 at 07:44PM, Konstantin Boudnik wrote: We've created BigTop stack with 2.0.3 as the base. Ran YCSB, slive, and some other loads on up to 20 nodes clusters as a part of the release validation. Two issues were noted: - due to the known issue with Jetty we are seeing MR jobs hanging here and there The issue referred here is reported as MAPREDUCE-2980 - without properly configured capacity-scheduler.xml resource manager throws exception on the startup (BIGTOP-841). +1 Cos On Wed, Feb 06, 2013 at 07:59PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would like to release. This release contains several major enhancements such as QJM for HDFS HA, multi-resource scheduling for YARN, YARN ResourceManager restart etc. Also YARN has achieved significant stability at scale (more details from Y! folks here: http://s.apache.org/VYO). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.0.3-alpha-rc0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-2.0.3-alpha-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
