[jira] [Created] (MAPREDUCE-5292) ShuffleConsumerPlugin.Context should support org.apache.hadoop.mapreduce.Reducer
Tsuyoshi OZAWA created MAPREDUCE-5292: - Summary: ShuffleConsumerPlugin.Context should support org.apache.hadoop.mapreduce.Reducer Key: MAPREDUCE-5292 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5292 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: trunk Reporter: Tsuyoshi OZAWA Assignee: Tsuyoshi OZAWA Priority: Blocker ShuffleConsumerPlugin.Context only supports org.apache.hadoop.mapred.Reducer currently. Because of this, Reduce side Combiner is not used when using the new API, and just ignored. Please see MAPREDUCE-5221 for more detail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5293) Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer
Tsuyoshi OZAWA created MAPREDUCE-5293: - Summary: Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer Key: MAPREDUCE-5293 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5293 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: trunk Reporter: Tsuyoshi OZAWA Assignee: Tsuyoshi OZAWA Priority: Blocker Shuffle#MergeManager only accepts org.apache.hadoop.mapred.Reducer currently. Because of this, Reduce-side Combiner is not used when using the new API, and just ignored. By supporting it and using the feature from ReduceTask, Reduce-side combiner can be enabled with new API. Please see MAPREDUCE-5221 for more detail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5294) Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer
Tsuyoshi OZAWA created MAPREDUCE-5294: - Summary: Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer Key: MAPREDUCE-5294 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5294 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: mrv2 Affects Versions: trunk, 2.1.0-beta, 2.0.5-alpha Reporter: Tsuyoshi OZAWA Assignee: Tsuyoshi OZAWA Shuffle#MergeManager only accepts org.apache.hadoop.mapred.Reducer currently. Because of this, Reduce-side Combiner is not used when using the new API, and just ignored. By supporting it and using the feature from ReduceTask, Reduce-side combiner can be enabled with new API. Please see MAPREDUCE-5221 for more detail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-5292) ShuffleConsumerPlugin.Context should support org.apache.hadoop.mapreduce.Reducer
[ https://issues.apache.org/jira/browse/MAPREDUCE-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA resolved MAPREDUCE-5292. --- Resolution: Duplicate Moved to MAPREDUCE-5294. ShuffleConsumerPlugin.Context should support org.apache.hadoop.mapreduce.Reducer Key: MAPREDUCE-5292 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5292 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: trunk Reporter: Tsuyoshi OZAWA Assignee: Tsuyoshi OZAWA Priority: Blocker ShuffleConsumerPlugin.Context only supports org.apache.hadoop.mapred.Reducer currently. Because of this, Reduce side Combiner is not used when using the new API, and just ignored. Please see MAPREDUCE-5221 for more detail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-5294) Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer
[ https://issues.apache.org/jira/browse/MAPREDUCE-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA resolved MAPREDUCE-5294. --- Resolution: Duplicate Moved to MAPREDUCE-5294, subtask of MAPREDUCE-5221. Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer --- Key: MAPREDUCE-5294 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5294 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: mrv2 Affects Versions: trunk, 2.1.0-beta, 2.0.5-alpha Reporter: Tsuyoshi OZAWA Assignee: Tsuyoshi OZAWA Shuffle#MergeManager only accepts org.apache.hadoop.mapred.Reducer currently. Because of this, Reduce-side Combiner is not used when using the new API, and just ignored. By supporting it and using the feature from ReduceTask, Reduce-side combiner can be enabled with new API. Please see MAPREDUCE-5221 for more detail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-5293) Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer
[ https://issues.apache.org/jira/browse/MAPREDUCE-5293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA resolved MAPREDUCE-5293. --- Resolution: Duplicate Moved to MAPREDUCE-5294, subtask of MAPREDUCE-5221. Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer --- Key: MAPREDUCE-5293 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5293 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2 Affects Versions: trunk Reporter: Tsuyoshi OZAWA Assignee: Tsuyoshi OZAWA Priority: Blocker Shuffle#MergeManager only accepts org.apache.hadoop.mapred.Reducer currently. Because of this, Reduce-side Combiner is not used when using the new API, and just ignored. By supporting it and using the feature from ReduceTask, Reduce-side combiner can be enabled with new API. Please see MAPREDUCE-5221 for more detail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (MAPREDUCE-5294) Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer
[ https://issues.apache.org/jira/browse/MAPREDUCE-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA reopened MAPREDUCE-5294: --- Sorry, I resolved this jira wrongly, so reopen it. Shuffle#MergeManager should support org.apache.hadoop.mapreduce.Reducer --- Key: MAPREDUCE-5294 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5294 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: mrv2 Affects Versions: trunk, 2.1.0-beta, 2.0.5-alpha Reporter: Tsuyoshi OZAWA Assignee: Tsuyoshi OZAWA Shuffle#MergeManager only accepts org.apache.hadoop.mapred.Reducer currently. Because of this, Reduce-side Combiner is not used when using the new API, and just ignored. By supporting it and using the feature from ReduceTask, Reduce-side combiner can be enabled with new API. Please see MAPREDUCE-5221 for more detail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha
Ok, if this the consensus on the issue, then tonight I will cut rc2 with only CHANGES.txt release dates update. After that I will extend the vote once again. Sorry for the hassle to all who did voted before. Cos On Mon, Jun 03, 2013 at 12:18AM, Doug Cutting wrote: On Sun, Jun 2, 2013 at 9:01 AM, Alejandro Abdelnur t...@cloudera.com wrote: [...] an easy way to solve it it would be using as release date the date the vote ends. +1 This is what I've done for release candidate builds. Doug
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc1)
NOTE: for consistency I'm moving my vote to the RC1 thread. On Fri, May 31, 2013 at 9:27 PM, Konstantin Boudnik c...@apache.org wrote: All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1 The maven artifacts will be available via repository.apache.org on Sat, June 1st, 2013 at 2 pm PDT as outlined here http://s.apache.org/WKD Please try the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move +1 (non-binding) pulled the RC into Bigtop, ran the usual battery of tests on our public Jenkins Thanks, Roman.
[jira] [Created] (MAPREDUCE-5296) Mapred API: Function signature change in JobControl
Zhijie Shen created MAPREDUCE-5296: -- Summary: Mapred API: Function signature change in JobControl Key: MAPREDUCE-5296 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5296 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporter: Zhijie Shen Assignee: Zhijie Shen String addJob(Job) - String addJob(ControlledJob) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (MAPREDUCE-5275) Mapreduce API: TokenCache incompatibility issues with MR1
[ https://issues.apache.org/jira/browse/MAPREDUCE-5275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reopened MAPREDUCE-5275: Mapreduce API: TokenCache incompatibility issues with MR1 - Key: MAPREDUCE-5275 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5275 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporter: Zhijie Shen Assignee: Mayank Bansal Fix For: 2.1.0-beta Attachments: MAPREDUCE-5275-trunk-1.patch, MAPREDUCE-5275-trunk-2.patch, MAPREDUCE-5275-trunk-3.patch, MAPREDUCE-5275-trunk-4.patch There're following incompatibility issues: * TokenDelegationTokenIdentifier getDelegationToken(Credentials, String) is removed * Credentials loadTokens(String, Configuration) changes to Credentials loadTokens(String, JobConf) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5297) Update MR App after YARN-748
Jian He created MAPREDUCE-5297: -- Summary: Update MR App after YARN-748 Key: MAPREDUCE-5297 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5297 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Jian He -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (MAPREDUCE-5220) Setter methods in TaskCompletionEvent are public in MR1 and protected in MR2
[ https://issues.apache.org/jira/browse/MAPREDUCE-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reopened MAPREDUCE-5220: void setTaskID(TaskAttemptID) is missing in TaskCompletionEvent Setter methods in TaskCompletionEvent are public in MR1 and protected in MR2 Key: MAPREDUCE-5220 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5220 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: client Affects Versions: 2.0.4-alpha Reporter: Sandy Ryza Assignee: Sandy Ryza Fix For: 2.1.0-beta Attachments: MAPREDUCE-5220-1.patch, MAPREDUCE-5220.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)
+1 RC2. Verified MD5 signature, checked CHANGES.txt files, built, configured pseudo cluster, run a couple of sample jobs, tested HTTPFS. On Mon, Jun 3, 2013 at 12:51 PM, Konstantin Boudnik c...@apache.org wrote: I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. The difference between rc1 and rc2 is the optimistic release date is set for 06/06/2013 in the CHANGES.txt files. The binary artifact is the same - there's no need to rebuild it. The maven artifacts are the same. The difference between the two RCs: svn diff \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1/\ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2/ New RC builds are uploaded to the web. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2 I would like to extend the vote for another three days for it is such a minor change that doesn't affect anything but the recorded release date. Please cast your vote before 06/06/2013 5pm PDT. Thanks for your patience! Cos On Fri, May 31, 2013 at 09:27PM, Konstantin Boudnik wrote: All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1 The maven artifacts will be available via repository.apache.org on Sat, June 1st, 2013 at 2 pm PDT as outlined here http://s.apache.org/WKD Please try the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move Thanks for your voting Cos -- Alejandro
[jira] [Created] (MAPREDUCE-5298) Move MapReduce services to YARN-117 stricter lifecycle
Steve Loughran created MAPREDUCE-5298: - Summary: Move MapReduce services to YARN-117 stricter lifecycle Key: MAPREDUCE-5298 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5298 Project: Hadoop Map/Reduce Issue Type: New Feature Components: applicationmaster Affects Versions: 2.0.4-alpha Reporter: Steve Loughran Assignee: Steve Loughran The MR services need to be in sync with the YARN-117 lifecycle enhancements -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)
+1 Checksum and signature match, ran some unit tests, checked diff against 2.0.4-alpha. Thanks for seeing this through, Cos. -C On Mon, Jun 3, 2013 at 1:13 PM, Alejandro Abdelnur t...@cloudera.com wrote: +1 RC2. Verified MD5 signature, checked CHANGES.txt files, built, configured pseudo cluster, run a couple of sample jobs, tested HTTPFS. On Mon, Jun 3, 2013 at 12:51 PM, Konstantin Boudnik c...@apache.org wrote: I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. The difference between rc1 and rc2 is the optimistic release date is set for 06/06/2013 in the CHANGES.txt files. The binary artifact is the same - there's no need to rebuild it. The maven artifacts are the same. The difference between the two RCs: svn diff \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1/\ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2/ New RC builds are uploaded to the web. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2 I would like to extend the vote for another three days for it is such a minor change that doesn't affect anything but the recorded release date. Please cast your vote before 06/06/2013 5pm PDT. Thanks for your patience! Cos On Fri, May 31, 2013 at 09:27PM, Konstantin Boudnik wrote: All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1 The maven artifacts will be available via repository.apache.org on Sat, June 1st, 2013 at 2 pm PDT as outlined here http://s.apache.org/WKD Please try the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move Thanks for your voting Cos -- Alejandro
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)
+1 (non-binding) Built from source, ran a few sample jobs on a pseudo-distributed cluster On Mon, Jun 3, 2013 at 3:22 PM, Chris Douglas cdoug...@apache.org wrote: +1 Checksum and signature match, ran some unit tests, checked diff against 2.0.4-alpha. Thanks for seeing this through, Cos. -C On Mon, Jun 3, 2013 at 1:13 PM, Alejandro Abdelnur t...@cloudera.com wrote: +1 RC2. Verified MD5 signature, checked CHANGES.txt files, built, configured pseudo cluster, run a couple of sample jobs, tested HTTPFS. On Mon, Jun 3, 2013 at 12:51 PM, Konstantin Boudnik c...@apache.org wrote: I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. The difference between rc1 and rc2 is the optimistic release date is set for 06/06/2013 in the CHANGES.txt files. The binary artifact is the same - there's no need to rebuild it. The maven artifacts are the same. The difference between the two RCs: svn diff \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1/\ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2/ New RC builds are uploaded to the web. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2 I would like to extend the vote for another three days for it is such a minor change that doesn't affect anything but the recorded release date. Please cast your vote before 06/06/2013 5pm PDT. Thanks for your patience! Cos On Fri, May 31, 2013 at 09:27PM, Konstantin Boudnik wrote: All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1 The maven artifacts will be available via repository.apache.org on Sat, June 1st, 2013 at 2 pm PDT as outlined here http://s.apache.org/WKD Please try the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move Thanks for your voting Cos -- Alejandro
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)
On Mon, Jun 3, 2013 at 12:51 PM, Konstantin Boudnik c...@apache.org wrote: I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. The difference between rc1 and rc2 is the optimistic release date is set for 06/06/2013 in the CHANGES.txt files. The binary artifact is the same - there's no need to rebuild it. The maven artifacts are the same. The difference between the two RCs: svn diff \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1/ \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2/ New RC builds are uploaded to the web. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2 I would like to extend the vote for another three days for it is such a minor change that doesn't affect anything but the recorded release date. Please cast your vote before 06/06/2013 5pm PDT. +1 (non-binding). Pulled into bigtop and built and all the supported platforms. Given the triviality of the change I didn't ran the usual battery of tests, since it has already been executed on previous RCs. Thanks, Roman.
[jira] [Resolved] (MAPREDUCE-5281) Mapreduce API: Counter changes from non-abstract class to interface
[ https://issues.apache.org/jira/browse/MAPREDUCE-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved MAPREDUCE-5281. Resolution: Won't Fix Mapreduce API: Counter changes from non-abstract class to interface --- Key: MAPREDUCE-5281 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5281 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporter: Zhijie Shen Assignee: Zhijie Shen Therefore, significant changes in Counter: 1. Two Constructors are removed; 2. Following methods are removed: * boolean equals(Object) * int hashCode() * void readFields(DataInput) * void write(DataOutput) Fix of this issue may break 0.23. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-5284) Mapreduce API: CounterGroup changes from non-abstract class to interface
[ https://issues.apache.org/jira/browse/MAPREDUCE-5284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved MAPREDUCE-5284. Resolution: Won't Fix Mapreduce API: CounterGroup changes from non-abstract class to interface Key: MAPREDUCE-5284 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5284 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporter: Zhijie Shen Assignee: Zhijie Shen Therefore, constructors and implemented methods are removed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5299) Mapred API: void setTaskID(TaskAttemptID) is missing in TaskCompletionEvent
Zhijie Shen created MAPREDUCE-5299: -- Summary: Mapred API: void setTaskID(TaskAttemptID) is missing in TaskCompletionEvent Key: MAPREDUCE-5299 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5299 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporter: Zhijie Shen Assignee: Zhijie Shen Move the add-on patch of MAPREDUCE-5220 here. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5300) Two function signature changes in filecache.DistributedCache
Zhijie Shen created MAPREDUCE-5300: -- Summary: Two function signature changes in filecache.DistributedCache Key: MAPREDUCE-5300 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5300 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporter: Zhijie Shen Assignee: Zhijie Shen Two more incompatibility issues: * long[] getArchiveTimestamps(Configuration) - String[] getArchiveTimestamps(Configuration) * long[] getFileTimestamps(Configuration) - String[] getFileTimestamps(Configuration) Changes will break 0.23 *Move the add-on patch of MAPREDUCE-5263 here.* -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] Release Apache Hadoop 0.23.8
+1 Checksum and signature match, ran some tests. -C On Mon, Jun 3, 2013 at 1:19 PM, Sandy Ryza sandy.r...@cloudera.com wrote: +1 (non-binding). Did a full build from source and ran a few sample jobs on a pseudo-distributed cluster. -Sandy On Mon, Jun 3, 2013 at 11:29 AM, Kihwal Lee kih...@yahoo-inc.com wrote: +1 I've downloaded built the RC and ran several tests on a single node cluster. Kihwal On 5/28/13 11:00 AM, Thomas Graves tgra...@yahoo-inc.com wrote: I've created a release candidate (RC0) for hadoop-0.23.8 that I would like to release. This release is a sustaining release with several important bug fixes in it. The most critical one is MAPREDUCE-5211. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.8-candidate-0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.8-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. I am +1 (binding). thanks, Tom Graves
Re: [VOTE] Release Apache Hadoop 0.23.8
+1 (non-binding) Built from source, ran some basic tests on a single node cluster. -- Hitesh On May 28, 2013, at 9:00 AM, Thomas Graves wrote: I've created a release candidate (RC0) for hadoop-0.23.8 that I would like to release. This release is a sustaining release with several important bug fixes in it. The most critical one is MAPREDUCE-5211. The RC is available at: http://people.apache.org/~tgraves/hadoop-0.23.8-candidate-0/ The RC tag in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.8-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. I am +1 (binding). thanks, Tom Graves
[jira] [Reopened] (MAPREDUCE-5300) Two function signature changes in filecache.DistributedCache
[ https://issues.apache.org/jira/browse/MAPREDUCE-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reopened MAPREDUCE-5300: -- Two function signature changes in filecache.DistributedCache Key: MAPREDUCE-5300 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5300 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporter: Zhijie Shen Assignee: Zhijie Shen Fix For: 2.1.0-beta Attachments: MAPREDUCE-5300.1.patch Two more incompatibility issues: * long[] getArchiveTimestamps(Configuration) - String[] getArchiveTimestamps(Configuration) * long[] getFileTimestamps(Configuration) - String[] getFileTimestamps(Configuration) Changes will break 0.23 *Move the add-on patch of MAPREDUCE-5263 here.* -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-5300) Two function signature changes in filecache.DistributedCache
[ https://issues.apache.org/jira/browse/MAPREDUCE-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5300. -- Resolution: Fixed Hadoop Flags: Incompatible change Re-opened to close with 'Incompatible Change' flag. Two function signature changes in filecache.DistributedCache Key: MAPREDUCE-5300 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5300 Project: Hadoop Map/Reduce Issue Type: Sub-task Reporter: Zhijie Shen Assignee: Zhijie Shen Fix For: 2.1.0-beta Attachments: MAPREDUCE-5300.1.patch Two more incompatibility issues: * long[] getArchiveTimestamps(Configuration) - String[] getArchiveTimestamps(Configuration) * long[] getFileTimestamps(Configuration) - String[] getFileTimestamps(Configuration) Changes will break 0.23 *Move the add-on patch of MAPREDUCE-5263 here.* -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)
+1 Thanks, --Konst On Mon, Jun 3, 2013 at 12:51 PM, Konstantin Boudnik c...@apache.org wrote: I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. The difference between rc1 and rc2 is the optimistic release date is set for 06/06/2013 in the CHANGES.txt files. The binary artifact is the same - there's no need to rebuild it. The maven artifacts are the same. The difference between the two RCs: svn diff \ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1/\ https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2/ New RC builds are uploaded to the web. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc2/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc2 I would like to extend the vote for another three days for it is such a minor change that doesn't affect anything but the recorded release date. Please cast your vote before 06/06/2013 5pm PDT. Thanks for your patience! Cos On Fri, May 31, 2013 at 09:27PM, Konstantin Boudnik wrote: All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.5-alpha-rc1 The maven artifacts will be available via repository.apache.org on Sat, June 1st, 2013 at 2 pm PDT as outlined here http://s.apache.org/WKD Please try the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move Thanks for your voting Cos
[jira] [Resolved] (MAPREDUCE-5297) Update MR App since BuilderUtils is moved to yarn-server-common after YARN-748
[ https://issues.apache.org/jira/browse/MAPREDUCE-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-5297. Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed Reviewed and committed this together with YARN-748 to trunk and branch-2. Closing this. Update MR App since BuilderUtils is moved to yarn-server-common after YARN-748 --- Key: MAPREDUCE-5297 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5297 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Jian He Assignee: Jian He Fix For: 2.1.0-beta Attachments: MAPREDUCE-5297.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-5277) Job history completed location cannot be on a file system other than default
[ https://issues.apache.org/jira/browse/MAPREDUCE-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mitic resolved MAPREDUCE-5277. --- Resolution: Duplicate Just realized that this is a dupe of MAPREDUCE-2351. Will reopen the original Jira and attach the branch-1 compatible backport patch. Job history completed location cannot be on a file system other than default Key: MAPREDUCE-5277 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5277 Project: Hadoop Map/Reduce Issue Type: Bug Components: jobhistoryserver Affects Versions: 1-win Reporter: Ivan Mitic Assignee: Ivan Mitic Attachments: MAPREDUCE-5277.branch-1-win.patch mapred.job.tracker.history.completed.location should be configurable to a location on any available file system. This can come handy for cases where HDFS is not the only file system in use. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5301) Update MR code to work with YARN-635 changes
Siddharth Seth created MAPREDUCE-5301: - Summary: Update MR code to work with YARN-635 changes Key: MAPREDUCE-5301 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5301 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Siddharth Seth Attachments: MAPREDUCE-5301.txt -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (MAPREDUCE-5302) NodeManager throws AvroRuntimeException on failed start
Sandy Ryza created MAPREDUCE-5302: - Summary: NodeManager throws AvroRuntimeException on failed start Key: MAPREDUCE-5302 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5302 Project: Hadoop Map/Reduce Issue Type: Bug Components: nodemanager Affects Versions: 2.0.4-alpha Reporter: Sandy Ryza NodeManager wraps exceptions that occur in its start method in AvroRuntimeExceptions, even though it doesn't use Avro anywhere else. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-5301) Update MR code to work with YARN-635 changes
[ https://issues.apache.org/jira/browse/MAPREDUCE-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-5301. Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed Committed this to trunk and branch-2 together with YARN-635. Thanks Sid! Update MR code to work with YARN-635 changes Key: MAPREDUCE-5301 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5301 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Siddharth Seth Fix For: 2.1.0-beta Attachments: MAPREDUCE-5301_branch2.txt, MAPREDUCE-5301.txt -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
