[jira] Updated: (MAPREDUCE-1555) tasktracker heartbeat hang

2010-04-15 Thread Ruyue Ma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruyue Ma updated MAPREDUCE-1555: Summary: tasktracker heartbeat hang (was: Maybe some code of MapTask is wrong.) Descri

[jira] Updated: (MAPREDUCE-1516) JobTracker should issue a delegation token only for kerberos authenticated client

2010-04-15 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated MAPREDUCE-1516: Attachment: MR-1516.6.patch New patch addressing the comment. > JobTra

[jira] Commented: (MAPREDUCE-1516) JobTracker should issue a delegation token only for kerberos authenticated client

2010-04-15 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857225#action_12857225 ] Jitendra Nath Pandey commented on MAPREDUCE-1516: - test-patch results

[jira] Commented: (MAPREDUCE-1516) JobTracker should issue a delegation token only for kerberos authenticated client

2010-04-15 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857226#action_12857226 ] Jitendra Nath Pandey commented on MAPREDUCE-1516: - I ran ant tests. All

[jira] Updated: (MAPREDUCE-1690) Using BuddySystem to reduce the ReduceTask's mem usage in the step of shuffle

2010-04-15 Thread luoli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoli updated MAPREDUCE-1690: - Attachment: allo_use_buddy_gc.JPG > Using BuddySystem to reduce the ReduceTask's mem usage in the ste

[jira] Updated: (MAPREDUCE-1690) Using BuddySystem to reduce the ReduceTask's mem usage in the step of shuffle

2010-04-15 Thread luoli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoli updated MAPREDUCE-1690: - Attachment: allo_use_buddy.JPG allo_use_new.JPG allo_use_new_gc.JPG H

[jira] Created: (MAPREDUCE-1704) Parity files that are outdated or nonexistent should be immediately disregarded

2010-04-15 Thread Rodrigo Schmidt (JIRA)
Parity files that are outdated or nonexistent should be immediately disregarded --- Key: MAPREDUCE-1704 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1704 Project: Hado

[jira] Commented: (MAPREDUCE-1690) Using BuddySystem to reduce the ReduceTask's mem usage in the step of shuffle

2010-04-15 Thread luoli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857232#action_12857232 ] luoli commented on MAPREDUCE-1690: -- This is the performance comparison when I using bu

[jira] Created: (MAPREDUCE-1705) Archiving and Purging of parity files should handle globbed policies

2010-04-15 Thread Rodrigo Schmidt (JIRA)
Archiving and Purging of parity files should handle globbed policies Key: MAPREDUCE-1705 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1705 Project: Hadoop Map/Reduce

[jira] Assigned: (MAPREDUCE-1705) Archiving and Purging of parity files should handle globbed policies

2010-04-15 Thread Rodrigo Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Schmidt reassigned MAPREDUCE-1705: -- Assignee: Rodrigo Schmidt > Archiving and Purging of parity files should ha

[jira] Created: (MAPREDUCE-1706) Log RAID recoveries on HDFS

2010-04-15 Thread Rodrigo Schmidt (JIRA)
Log RAID recoveries on HDFS --- Key: MAPREDUCE-1706 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1706 Project: Hadoop Map/Reduce Issue Type: Improvement Components: contrib/raid Reporter:

[jira] Created: (MAPREDUCE-1707) TaskRunner can get NPE in getting ugi from TaskTracker

2010-04-15 Thread Amareshwari Sriramadasu (JIRA)
TaskRunner can get NPE in getting ugi from TaskTracker -- Key: MAPREDUCE-1707 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1707 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] Created: (MAPREDUCE-1708) Add a test for connect and read time outs during shuffle.

2010-04-15 Thread Amareshwari Sriramadasu (JIRA)
Add a test for connect and read time outs during shuffle. - Key: MAPREDUCE-1708 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1708 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] Commented: (MAPREDUCE-1276) Shuffle connection logic needs correction

2010-04-15 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857263#action_12857263 ] Amareshwari Sriramadasu commented on MAPREDUCE-1276: Test output fr

[jira] Updated: (MAPREDUCE-1673) Start and Stop scripts for the RaidNode

2010-04-15 Thread Rodrigo Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Schmidt updated MAPREDUCE-1673: --- Status: Open (was: Patch Available) > Start and Stop scripts for the RaidNode >

[jira] Updated: (MAPREDUCE-1673) Start and Stop scripts for the RaidNode

2010-04-15 Thread Rodrigo Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Schmidt updated MAPREDUCE-1673: --- Attachment: MAPREDUCE-1673.2.patch New patch! > Start and Stop scripts for the R

[jira] Updated: (MAPREDUCE-1673) Start and Stop scripts for the RaidNode

2010-04-15 Thread Rodrigo Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rodrigo Schmidt updated MAPREDUCE-1673: --- Status: Patch Available (was: Open) > Start and Stop scripts for the RaidNode >

[jira] Commented: (MAPREDUCE-1692) Remove TestStreamedMerge from the streaming tests

2010-04-15 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857271#action_12857271 ] Hemanth Yamijala commented on MAPREDUCE-1692: - The testcase (introduced in

[jira] Commented: (MAPREDUCE-1692) Remove TestStreamedMerge from the streaming tests

2010-04-15 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857279#action_12857279 ] Amareshwari Sriramadasu commented on MAPREDUCE-1692: bq. inputtagge

[jira] Commented: (MAPREDUCE-1695) capacity scheduler is not included in findbugs/javadoc targets

2010-04-15 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857280#action_12857280 ] Hemanth Yamijala commented on MAPREDUCE-1695: - Is it fair to assume that mo

[jira] Commented: (MAPREDUCE-1695) capacity scheduler is not included in findbugs/javadoc targets

2010-04-15 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857281#action_12857281 ] Hemanth Yamijala commented on MAPREDUCE-1695: - bq. Is there some way by whi

[jira] Updated: (MAPREDUCE-1434) Dynamic add input for one job

2010-04-15 Thread Xing Shi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Shi updated MAPREDUCE-1434: Fix Version/s: 0.20.3 Affects Version/s: 0.20.3 Environment: (was: 0.19.0)

[jira] Commented: (MAPREDUCE-1673) Start and Stop scripts for the RaidNode

2010-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857305#action_12857305 ] Hadoop QA commented on MAPREDUCE-1673: -- -1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1700) User supplied dependencies may conflict with MapReduce system JARs

2010-04-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857306#action_12857306 ] Steve Loughran commented on MAPREDUCE-1700: --- Getting custom classloaders righ

[jira] Updated: (MAPREDUCE-1221) Kill tasks on a node if the free physical memory on that machine falls below a configured threshold

2010-04-15 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-1221: - Status: Open (was: Patch Available) I just started looking at this, some minor comme

[jira] Commented: (MAPREDUCE-1221) Kill tasks on a node if the free physical memory on that machine falls below a configured threshold

2010-04-15 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857405#action_12857405 ] Arun C Murthy commented on MAPREDUCE-1221: -- Scott, I had a question: Comparin

[jira] Commented: (MAPREDUCE-596) can't package zip file with hadoop streaming -file argument

2010-04-15 Thread Trevor Rundell (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857411#action_12857411 ] Trevor Rundell commented on MAPREDUCE-596: -- Apparently this issue is still arou

[jira] Assigned: (MAPREDUCE-1641) Job submission should fail if same uri is added for mapred.cache.files and mapred.cache.archives

2010-04-15 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King reassigned MAPREDUCE-1641: Assignee: Dick King > Job submission should fail if same uri is added for mapred.cache.

[jira] Commented: (MAPREDUCE-1695) capacity scheduler is not included in findbugs/javadoc targets

2010-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857425#action_12857425 ] Hadoop QA commented on MAPREDUCE-1695: -- +1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1641) Job submission should fail if same uri is added for mapred.cache.files and mapred.cache.archives

2010-04-15 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857426#action_12857426 ] Dick King commented on MAPREDUCE-1641: -- I think I should throw an {{InvalidArgumen

[jira] Commented: (MAPREDUCE-1673) Start and Stop scripts for the RaidNode

2010-04-15 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857439#action_12857439 ] dhruba borthakur commented on MAPREDUCE-1673: - +1. Looks good. These are st

[jira] Created: (MAPREDUCE-1709) mapred.cache.archives is not creating links for long path names

2010-04-15 Thread Dick King (JIRA)
mapred.cache.archives is not creating links for long path names --- Key: MAPREDUCE-1709 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1709 Project: Hadoop Map/Reduce Issue Ty

[jira] Updated: (MAPREDUCE-1221) Kill tasks on a node if the free physical memory on that machine falls below a configured threshold

2010-04-15 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1221: -- Attachment: MAPREDUCE-1221-v5.txt > Kill tasks on a node if the free physical memory on tha

[jira] Commented: (MAPREDUCE-1221) Kill tasks on a node if the free physical memory on that machine falls below a configured threshold

2010-04-15 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857468#action_12857468 ] Scott Chen commented on MAPREDUCE-1221: --- Arun, Thanks for the review bq. We shoul

[jira] Updated: (MAPREDUCE-1221) Kill tasks on a node if the free physical memory on that machine falls below a configured threshold

2010-04-15 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1221: -- Status: Patch Available (was: Open) Fix Version/s: 0.21.0

[jira] Commented: (MAPREDUCE-1695) capacity scheduler is not included in findbugs/javadoc targets

2010-04-15 Thread Hong Tang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857470#action_12857470 ] Hong Tang commented on MAPREDUCE-1695: -- bq. Is it fair to assume that most project

[jira] Updated: (MAPREDUCE-778) Need a standalone JobHistory log anonymizer

2010-04-15 Thread Guanying Wang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanying Wang updated MAPREDUCE-778: Attachment: anonymizer.patch With the attached patch, an anonymizer is implemented integ

[jira] Commented: (MAPREDUCE-1695) capacity scheduler is not included in findbugs/javadoc targets

2010-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857520#action_12857520 ] Hadoop QA commented on MAPREDUCE-1695: -- +1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1221) Kill tasks on a node if the free physical memory on that machine falls below a configured threshold

2010-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857532#action_12857532 ] Hadoop QA commented on MAPREDUCE-1221: -- +1 overall. Here are the results of testi

[jira] Updated: (MAPREDUCE-1538) TrackerDistributedCacheManager can fail because the number of subdirectories reaches system limit

2010-04-15 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1538: -- Status: Open (was: Patch Available) > TrackerDistributedCacheManager can fail because the

[jira] Updated: (MAPREDUCE-1538) TrackerDistributedCacheManager can fail because the number of subdirectories reaches system limit

2010-04-15 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1538: -- Attachment: (was: MAPREDUCE-1538-v2.txt) > TrackerDistributedCacheManager can fail beca

[jira] Updated: (MAPREDUCE-1538) TrackerDistributedCacheManager can fail because the number of subdirectories reaches system limit

2010-04-15 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1538: -- Attachment: MAPREDUCE-1538-v2.txt > TrackerDistributedCacheManager can fail because the num

[jira] Updated: (MAPREDUCE-1538) TrackerDistributedCacheManager can fail because the number of subdirectories reaches system limit

2010-04-15 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1538: -- Status: Patch Available (was: Open) > TrackerDistributedCacheManager can fail because the

[jira] Commented: (MAPREDUCE-1545) Add 'first-task-launched' to job-summary

2010-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857577#action_12857577 ] Hudson commented on MAPREDUCE-1545: --- Integrated in Hadoop-Common-trunk-Commit #221 (S

[jira] Commented: (MAPREDUCE-1614) TestDFSIO should allow to configure output directory

2010-04-15 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857582#action_12857582 ] Konstantin Boudnik commented on MAPREDUCE-1614: --- It turns out the the pro

[jira] Commented: (MAPREDUCE-1538) TrackerDistributedCacheManager can fail because the number of subdirectories reaches system limit

2010-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857587#action_12857587 ] Hadoop QA commented on MAPREDUCE-1538: -- -1 overall. Here are the results of testi

[jira] Commented: (MAPREDUCE-1538) TrackerDistributedCacheManager can fail because the number of subdirectories reaches system limit

2010-04-15 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857604#action_12857604 ] Scott Chen commented on MAPREDUCE-1538: --- Got 105 test failures with the message {

[jira] Commented: (MAPREDUCE-1516) JobTracker should issue a delegation token only for kerberos authenticated client

2010-04-15 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857625#action_12857625 ] Devaraj Das commented on MAPREDUCE-1516: Sigh .. I wish we hadn't duplicated th

[jira] Commented: (MAPREDUCE-1317) Reducing memory consumption of rumen objects

2010-04-15 Thread Hong Tang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857640#action_12857640 ] Hong Tang commented on MAPREDUCE-1317: -- Patch "mapreduce-1317-20091223.patch" appl

[jira] Updated: (MAPREDUCE-1656) JobStory should provide queue info.

2010-04-15 Thread Hong Tang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Tang updated MAPREDUCE-1656: - Attachment: mr-1656-yhadoop-20.1xx.patch Patch for yhadoop 20.1xx branch. Not to be committed

[jira] Updated: (MAPREDUCE-1434) Dynamic add input for one job

2010-04-15 Thread Xing Shi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Shi updated MAPREDUCE-1434: Attachment: dynamic_input-v1.patch We can dynamic add input to a job by use cmd: {noformat} ha

[jira] Updated: (MAPREDUCE-1532) Delegation token is obtained as the superuser

2010-04-15 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated MAPREDUCE-1532: --- Attachment: 1532.1.patch The attached patch is for trunk > Delegation token is obtained

[jira] Updated: (MAPREDUCE-1692) Remove TestStreamedMerge from the streaming tests

2010-04-15 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1692: --- Status: Patch Available (was: Open) Fix Version/s: 0.2

[jira] Updated: (MAPREDUCE-1692) Remove TestStreamedMerge from the streaming tests

2010-04-15 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1692: --- Attachment: patch-1692.txt Patch incorporates Hemanth's suggestio