[jira] [Created] (MAPREDUCE-5271) Error: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in InMemoryMerger - Thread to merge in-memory shuffled map-outputs

2013-05-24 Thread lijuanhzou (JIRA)
lijuanhzou created MAPREDUCE-5271: - Summary: Error: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in InMemoryMerger - Thread to merge in-memory shuffled map-outputs Key: MAPREDUCE-5271

[jira] [Updated] (MAPREDUCE-5245) A number of public static variables are removed from JobConf

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5245: --- Attachment: MAPREDUCE-5245.2.patch Thanks, Mayank! The patch is updated, with assertion

[jira] [Commented] (MAPREDUCE-5245) A number of public static variables are removed from JobConf

2013-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666061#comment-13666061 ] Hadoop QA commented on MAPREDUCE-5245: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5246) Adding application type to submission context

2013-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666198#comment-13666198 ] Hudson commented on MAPREDUCE-5246: --- Integrated in Hadoop-Yarn-trunk #219 (See

[jira] [Commented] (MAPREDUCE-5230) createFileSplit is removed from NLineInputFormat of mapred

2013-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666196#comment-13666196 ] Hudson commented on MAPREDUCE-5230: --- Integrated in Hadoop-Yarn-trunk #219 (See

[jira] [Commented] (MAPREDUCE-5230) createFileSplit is removed from NLineInputFormat of mapred

2013-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666284#comment-13666284 ] Hudson commented on MAPREDUCE-5230: --- Integrated in Hadoop-Hdfs-trunk #1409 (See

[jira] [Commented] (MAPREDUCE-5246) Adding application type to submission context

2013-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666286#comment-13666286 ] Hudson commented on MAPREDUCE-5246: --- Integrated in Hadoop-Hdfs-trunk #1409 (See

[jira] [Commented] (MAPREDUCE-5271) Error: org.apache.hadoop.mapreduce.task.reduce.Shuffle$ShuffleError: error in shuffle in InMemoryMerger - Thread to merge in-memory shuffled map-outputs

2013-05-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666300#comment-13666300 ] Jason Lowe commented on MAPREDUCE-5271: --- This looks to be the same issue

[jira] [Commented] (MAPREDUCE-5230) createFileSplit is removed from NLineInputFormat of mapred

2013-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666331#comment-13666331 ] Hudson commented on MAPREDUCE-5230: --- Integrated in Hadoop-Mapreduce-trunk #1435 (See

[jira] [Commented] (MAPREDUCE-5246) Adding application type to submission context

2013-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666333#comment-13666333 ] Hudson commented on MAPREDUCE-5246: --- Integrated in Hadoop-Mapreduce-trunk #1435 (See

[jira] [Resolved] (MAPREDUCE-4042) unit test TestControlledMapReduceJob.testControlledMapReduceJob fails

2013-05-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4042. --- Resolution: Not A Problem No longer an issue since TestControlledMapReduceJob was

[jira] [Resolved] (MAPREDUCE-4041) TestMapredGroupMappingServiceRefresh unit test failures

2013-05-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4041. --- Resolution: Not A Problem TestMapredGroupMappingServiceRefresh was removed as part of

[jira] [Resolved] (MAPREDUCE-4235) Killing app can lead to inconsistent app status between RM and HS

2013-05-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4235. --- Resolution: Not A Problem This is an inherent race between the RM and the AM. The AM

[jira] [Commented] (MAPREDUCE-5237) ClusterStatus incompatiblity issues with MR1

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666460#comment-13666460 ] Zhijie Shen commented on MAPREDUCE-5237: Hm... Though MR 1.x applications will

[jira] [Updated] (MAPREDUCE-5237) ClusterStatus incompatiblity issues with MR1

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5237: --- Attachment: MAPREDUCE-5237.3.patch JobTracker.State.INVALID is removed from the lates

[jira] [Commented] (MAPREDUCE-5228) Enum Counter is removed from FileInputFormat and FileOutputFormat of both mapred and mapreduce

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666524#comment-13666524 ] Zhijie Shen commented on MAPREDUCE-5228: 1. FileInputFormat.Counter and

[jira] [Updated] (MAPREDUCE-5228) Enum Counter is removed from FileInputFormat and FileOutputFormat of both mapred and mapreduce

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5228: --- Status: Open (was: Patch Available) Enum Counter is removed from FileInputFormat

[jira] [Commented] (MAPREDUCE-5237) ClusterStatus incompatiblity issues with MR1

2013-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666531#comment-13666531 ] Hadoop QA commented on MAPREDUCE-5237: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2013-05-24 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1303#comment-1303 ] Andrey Klochkov commented on MAPREDUCE-4980: Vinod, can you please point

[jira] [Updated] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2013-05-24 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated MAPREDUCE-4980: --- Attachment: MAPREDUCE-4980--n5.patch rebasing and refreshing the patch

[jira] [Commented] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2013-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1321#comment-1321 ] Hadoop QA commented on MAPREDUCE-4980: -- {color:red}-1 overall{color}. Here are

[jira] [Created] (MAPREDUCE-5272) A Minor Error in Javadoc of TestMRWithDistributedCache in Branch-1

2013-05-24 Thread Zhijie Shen (JIRA)
Zhijie Shen created MAPREDUCE-5272: -- Summary: A Minor Error in Javadoc of TestMRWithDistributedCache in Branch-1 Key: MAPREDUCE-5272 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5272

[jira] [Updated] (MAPREDUCE-5272) A Minor Error in Javadoc of TestMRWithDistributedCache in Branch-1

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5272: --- Attachment: MAPREDUCE-5272-branch-1.patch Changed the javadoc A Minor

[jira] [Updated] (MAPREDUCE-5272) A Minor Error in Javadoc of TestMRWithDistributedCache in Branch-1

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5272: --- Status: Patch Available (was: Open) A Minor Error in Javadoc of

[jira] [Commented] (MAPREDUCE-5272) A Minor Error in Javadoc of TestMRWithDistributedCache in Branch-1

2013-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1370#comment-1370 ] Hadoop QA commented on MAPREDUCE-5272: -- {color:red}-1 overall{color}. Here are

[jira] [Created] (MAPREDUCE-5273) Protected variables are removed from CombineFileRecordReader in both mapred and mapreduce

2013-05-24 Thread Zhijie Shen (JIRA)
Zhijie Shen created MAPREDUCE-5273: -- Summary: Protected variables are removed from CombineFileRecordReader in both mapred and mapreduce Key: MAPREDUCE-5273 URL:

[jira] [Assigned] (MAPREDUCE-5251) Reducer should not implicate map attempt if it has insufficient space to fetch map output

2013-05-24 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar reassigned MAPREDUCE-5251: - Assignee: Ashwin Shankar Reducer should not implicate map attempt if it

[jira] [Created] (MAPREDUCE-5274) String toHex(byte[]) is removed from SecureShuffleUtils in mapreduce

2013-05-24 Thread Zhijie Shen (JIRA)
Zhijie Shen created MAPREDUCE-5274: -- Summary: String toHex(byte[]) is removed from SecureShuffleUtils in mapreduce Key: MAPREDUCE-5274 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5274

[jira] [Created] (MAPREDUCE-5275) Mapreduce API: TokenCache incompatibility issues with MR1

2013-05-24 Thread Zhijie Shen (JIRA)
Zhijie Shen created MAPREDUCE-5275: -- Summary: Mapreduce API: TokenCache incompatibility issues with MR1 Key: MAPREDUCE-5275 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5275 Project: Hadoop

[jira] [Updated] (MAPREDUCE-5274) Mapreduce API: String toHex(byte[]) is removed from SecureShuffleUtils

2013-05-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-5274: --- Summary: Mapreduce API: String toHex(byte[]) is removed from SecureShuffleUtils (was:

[jira] [Updated] (MAPREDUCE-5078) TestMRAppMaster fails on Windows due to mismatched path separators

2013-05-24 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated MAPREDUCE-5078: --- Target Version/s: (was: 3.0.0) Fix Version/s: (was: 3.0.0)

[jira] [Updated] (MAPREDUCE-4885) Streaming tests have multiple failures on Windows

2013-05-24 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated MAPREDUCE-4885: --- Fix Version/s: (was: 3.0.0) 2.0.5-beta I merged the patch

[jira] [Updated] (MAPREDUCE-4987) TestMRJobs#testDistributedCache fails on Windows due to classpath problems and unexpected behavior of symlinks

2013-05-24 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated MAPREDUCE-4987: --- Target Version/s: (was: 3.0.0) Fix Version/s: (was: 3.0.0)

[jira] [Updated] (MAPREDUCE-5191) TestQueue#testQueue fails with timeout on Windows

2013-05-24 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated MAPREDUCE-5191: --- Fix Version/s: (was: 3.0.0) 2.0.5-beta I merged the patch

[jira] [Updated] (MAPREDUCE-5177) Move to common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute

2013-05-24 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated MAPREDUCE-5177: --- Fix Version/s: (was: 3.0.0) 2.0.5-beta I merged the patch

[jira] [Updated] (MAPREDUCE-5270) Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side

2013-05-24 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5270: --- Status: Open (was: Patch Available) Straight forward patch,

[jira] [Updated] (MAPREDUCE-5270) Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side

2013-05-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated MAPREDUCE-5270: --- Attachment: MAPREDUCE-5270.3.patch the new patch fix conflicts with YARN-571

[jira] [Updated] (MAPREDUCE-5270) Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side

2013-05-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated MAPREDUCE-5270: --- Status: Patch Available (was: Open) Migrate from using BuilderUtil factory methods to

[jira] [Commented] (MAPREDUCE-5270) Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side

2013-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666889#comment-13666889 ] Hadoop QA commented on MAPREDUCE-5270: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-5270) Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side

2013-05-24 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5270: --- Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop

[jira] [Commented] (MAPREDUCE-5270) Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side

2013-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666920#comment-13666920 ] Hudson commented on MAPREDUCE-5270: --- Integrated in Hadoop-trunk-Commit #3789 (See

[jira] [Commented] (MAPREDUCE-259) Rack-aware Shuffle

2013-05-24 Thread nemon lou (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666926#comment-13666926 ] nemon lou commented on MAPREDUCE-259: - Interesting featrue. Still working on this?

[jira] [Commented] (MAPREDUCE-259) Rack-aware Shuffle

2013-05-24 Thread nemon lou (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666927#comment-13666927 ] nemon lou commented on MAPREDUCE-259: - MAPREDUCE-2038 is doing the same thing,but