[jira] Commented: (MAPREDUCE-479) Add reduce ID to shuffle clienttrace

2009-07-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732356#action_12732356 ] Chris Douglas commented on MAPREDUCE-479: - bq. if the system's operation cannot

[jira] Commented: (MAPREDUCE-479) Add reduce ID to shuffle clienttrace

2009-07-17 Thread Jiaqi Tan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732362#action_12732362 ] Jiaqi Tan commented on MAPREDUCE-479: - I would argue that you cannot actually get

[jira] Updated: (MAPREDUCE-740) Provide summary information per job once a job is finished.

2009-07-17 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-740: Status: Open (was: Patch Available) Cancelling patch to incorporate feedback from

[jira] Updated: (MAPREDUCE-740) Provide summary information per job once a job is finished.

2009-07-17 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-740: Attachment: MAPREDUCE-740_1_20090716_yhadoop20.patch

[jira] Commented: (MAPREDUCE-740) Provide summary information per job once a job is finished.

2009-07-17 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732389#action_12732389 ] Arun C Murthy commented on MAPREDUCE-740: - Manual testing performed: # I've run

[jira] Commented: (MAPREDUCE-479) Add reduce ID to shuffle clienttrace

2009-07-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732391#action_12732391 ] Chris Douglas commented on MAPREDUCE-479: - As I said earlier, if you wanted to

[jira] Commented: (MAPREDUCE-40) Memory management variables need a backwards compatibility option after HADOOP-5881

2009-07-17 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732400#action_12732400 ] Hemanth Yamijala commented on MAPREDUCE-40: --- I found a couple of places where

[jira] Commented: (MAPREDUCE-766) Enhance -list-blacklisted-trackers to display host name, blacklisted reason and blacklist report.

2009-07-17 Thread rahul k singh (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732404#action_12732404 ] rahul k singh commented on MAPREDUCE-766: - Looking good: minor comments : 1.In

[jira] Updated: (MAPREDUCE-717) Fix some corner case issues in speculative execution (post hadoop-2141)

2009-07-17 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated MAPREDUCE-717: -- Attachment: 717.patch Apart from what I mentioned in the jira description, here are a few

[jira] Commented: (MAPREDUCE-717) Fix some corner case issues in speculative execution (post hadoop-2141)

2009-07-17 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732412#action_12732412 ] Devaraj Das commented on MAPREDUCE-717: --- Also disabled speculation for recovered

[jira] Commented: (MAPREDUCE-682) Reserved tasktrackers should be removed when a node is globally blacklisted

2009-07-17 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732418#action_12732418 ] Hemanth Yamijala commented on MAPREDUCE-682: Looks fine. A couple of minor

[jira] Updated: (MAPREDUCE-682) Reserved tasktrackers should be removed when a node is globally blacklisted

2009-07-17 Thread Sreekanth Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreekanth Ramakrishnan updated MAPREDUCE-682: - Attachment: mapreduce-682-2.patch Attaching patch incorporating

[jira] Commented: (MAPREDUCE-372) Change org.apache.hadoop.mapred.lib.ChainMapper/Reducer to use new api.

2009-07-17 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732456#action_12732456 ] Amareshwari Sriramadasu commented on MAPREDUCE-372: --- As per my

[jira] Commented: (MAPREDUCE-548) Global scheduling in the Fair Scheduler

2009-07-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732460#action_12732460 ] Tom White commented on MAPREDUCE-548: - I had a question about the latest patch: *

[jira] Commented: (MAPREDUCE-768) Configuration information should generate dump in a standard format.

2009-07-17 Thread rahul k singh (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732461#action_12732461 ] rahul k singh commented on MAPREDUCE-768: - In addition to the comment above:

[jira] Commented: (MAPREDUCE-711) Move Distributed Cache from Common to Map/Reduce

2009-07-17 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732463#action_12732463 ] Vinod K V commented on MAPREDUCE-711: - contrib tests also passed. This patch is

[jira] Commented: (MAPREDUCE-739) Allow relative paths to be created inside archives.

2009-07-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732466#action_12732466 ] Hudson commented on MAPREDUCE-739: -- Integrated in Hadoop-Common-trunk #29 (See

[jira] Commented: (MAPREDUCE-546) Provide sample fair scheduler config file in conf/ and set config file property to point to this by default

2009-07-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732468#action_12732468 ] Tom White commented on MAPREDUCE-546: - +1 I think having a configuration that works

[jira] Commented: (MAPREDUCE-476) extend DistributedCache to work locally (LocalJobRunner)

2009-07-17 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732474#action_12732474 ] Vinod K V commented on MAPREDUCE-476: - Looked at the remaining parts of the patch.

[jira] Commented: (MAPREDUCE-476) extend DistributedCache to work locally (LocalJobRunner)

2009-07-17 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732482#action_12732482 ] Vinod K V commented on MAPREDUCE-476: - Another point. We should consolidate

[jira] Created: (MAPREDUCE-769) findbugs warnings on trunk is non-zero

2009-07-17 Thread Amareshwari Sriramadasu (JIRA)
findbugs warnings on trunk is non-zero -- Key: MAPREDUCE-769 URL: https://issues.apache.org/jira/browse/MAPREDUCE-769 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.21.0

[jira] Updated: (MAPREDUCE-735) ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner

2009-07-17 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated MAPREDUCE-735: - Attachment: MAPREDUCE-735-v2.1.patch Attaching a patch that minimizes the code changes.

[jira] Commented: (MAPREDUCE-476) extend DistributedCache to work locally (LocalJobRunner)

2009-07-17 Thread Philip Zeyliger (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732547#action_12732547 ] Philip Zeyliger commented on MAPREDUCE-476: --- Vinod, Thanks for your comments

[jira] Commented: (MAPREDUCE-627) Modify TestTrackerBlacklistAcrossJobs to improve execution time

2009-07-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732602#action_12732602 ] Hudson commented on MAPREDUCE-627: -- Integrated in Hadoop-Mapreduce-trunk #25 (See

[jira] Commented: (MAPREDUCE-680) Reuse of Writable objects is improperly handled by MRUnit

2009-07-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732603#action_12732603 ] Hudson commented on MAPREDUCE-680: -- Integrated in Hadoop-Mapreduce-trunk #25 (See

[jira] Commented: (MAPREDUCE-18) Under load the shuffle sometimes gets incorrect data

2009-07-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732604#action_12732604 ] Hudson commented on MAPREDUCE-18: - Integrated in Hadoop-Mapreduce-trunk #25 (See

[jira] Commented: (MAPREDUCE-739) Allow relative paths to be created inside archives.

2009-07-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732606#action_12732606 ] Hudson commented on MAPREDUCE-739: -- Integrated in Hadoop-Mapreduce-trunk #25 (See

[jira] Commented: (MAPREDUCE-353) Allow shuffle read and connection timeouts to be configurable

2009-07-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732607#action_12732607 ] Hudson commented on MAPREDUCE-353: -- Integrated in Hadoop-Mapreduce-trunk #25 (See

[jira] Commented: (MAPREDUCE-740) Provide summary information per job once a job is finished.

2009-07-17 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732669#action_12732669 ] Dick King commented on MAPREDUCE-740: - I expect to have a responsive patch to 751,

[jira] Updated: (MAPREDUCE-548) Global scheduling in the Fair Scheduler

2009-07-17 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-548: Status: Open (was: Patch Available) Matei, can you please ensure that the checks Tom

[jira] Updated: (MAPREDUCE-770) org.apache.hadoop.tools.TestCopyFiles may leave junk files when an assertion fails

2009-07-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated MAPREDUCE-770: - Component/s: test Priority: Minor (was: Major) That's what

[jira] Commented: (MAPREDUCE-770) org.apache.hadoop.tools.TestCopyFiles may leave junk files when an assertion fails

2009-07-17 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732764#action_12732764 ] Dick King commented on MAPREDUCE-770: - ant clean does not solve the problem. Some

[jira] Commented: (MAPREDUCE-770) org.apache.hadoop.tools.TestCopyFiles may leave junk files when an assertion fails

2009-07-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732768#action_12732768 ] Tsz Wo (Nicholas), SZE commented on MAPREDUCE-770: -- ... Some of the

[jira] Commented: (MAPREDUCE-770) org.apache.hadoop.tools.TestCopyFiles may leave junk files when an assertion fails

2009-07-17 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732771#action_12732771 ] Dick King commented on MAPREDUCE-770: -

[jira] Updated: (MAPREDUCE-548) Global scheduling in the Fair Scheduler

2009-07-17 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated MAPREDUCE-548: Attachment: mapreduce-548-v3.patch Global scheduling in the Fair Scheduler

[jira] Updated: (MAPREDUCE-548) Global scheduling in the Fair Scheduler

2009-07-17 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated MAPREDUCE-548: Status: Patch Available (was: Open) Global scheduling in the Fair Scheduler

[jira] Commented: (MAPREDUCE-548) Global scheduling in the Fair Scheduler

2009-07-17 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732786#action_12732786 ] Matei Zaharia commented on MAPREDUCE-548: - I've added those checks back. Arun,

[jira] Updated: (MAPREDUCE-706) Support for FIFO pools in the fair scheduler

2009-07-17 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated MAPREDUCE-706: Attachment: fsdesigndoc.tex fsdesigndoc.pdf I've attached a design

[jira] Commented: (MAPREDUCE-666) Job scheduling information on jobtracker.jsp makes it clunky

2009-07-17 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732821#action_12732821 ] Matei Zaharia commented on MAPREDUCE-666: - Have you considered adding some kind

[jira] Commented: (MAPREDUCE-548) Global scheduling in the Fair Scheduler

2009-07-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732826#action_12732826 ] Hadoop QA commented on MAPREDUCE-548: - -1 overall. Here are the results of testing

[jira] Updated: (MAPREDUCE-765) eliminate the usage of FileSystem.create( ) depracated by Hadoop-5438

2009-07-17 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated MAPREDUCE-765: --- Attachment: mapreduce-765-2009-07-18.patch Incorporates Nicholas's comments eliminate