[jira] [Commented] (MAPREDUCE-5189) Basic AM changes to support preemption requests (per YARN-45)

2013-12-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851048#comment-13851048 ] Chris Douglas commented on MAPREDUCE-5189: -- I committed this. Thanks Carlo

[jira] [Updated] (MAPREDUCE-5196) CheckpointAMPreemptionPolicy implements preemption in MR AM via checkpointing

2013-12-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5196: - Status: Patch Available (was: Open) CheckpointAMPreemptionPolicy implements

[jira] [Updated] (MAPREDUCE-5196) CheckpointAMPreemptionPolicy implements preemption in MR AM via checkpointing

2013-12-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5196: - Attachment: MAPREDUCE-5196.2.patch CheckpointAMPreemptionPolicy implements

[jira] [Updated] (MAPREDUCE-5197) Checkpoint Service: a library component to facilitate checkpoint of task state

2013-12-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5197: - Status: Patch Available (was: Open) Checkpoint Service: a library component to

[jira] [Updated] (MAPREDUCE-5197) Checkpoint Service: a library component to facilitate checkpoint of task state

2013-12-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5197: - Status: Open (was: Patch Available) Checkpoint Service: a library component to

[jira] [Updated] (MAPREDUCE-5197) Checkpoint Service: a library component to facilitate checkpoint of task state

2013-12-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5197: - Attachment: MAPREDUCE-5197.3.patch Checkpoint Service: a library component to

[jira] [Updated] (MAPREDUCE-5189) Basic AM changes to support preemption requests (per YARN-45)

2013-12-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5189: - Status: Open (was: Patch Available) Basic AM changes to support preemption

[jira] [Updated] (MAPREDUCE-5189) Basic AM changes to support preemption requests (per YARN-45)

2013-12-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5189: - Attachment: MAPREDUCE-5189.4.patch Basic AM changes to support preemption requests

[jira] [Updated] (MAPREDUCE-5189) Basic AM changes to support preemption requests (per YARN-45)

2013-12-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5189: - Status: Patch Available (was: Open) Basic AM changes to support preemption

[jira] [Updated] (MAPREDUCE-5189) Basic AM changes to support preemption requests (per YARN-45)

2013-12-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5189: - Status: Open (was: Patch Available) Basic AM changes to support preemption

[jira] [Commented] (MAPREDUCE-5506) Hadoop-1.1.1 occurs ArrayIndexOutOfBoundsException with MultithreadedMapRunner

2013-09-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768460#comment-13768460 ] Chris Douglas commented on MAPREDUCE-5506: -- collect is already synchronized.

[jira] [Updated] (MAPREDUCE-5189) Basic AM changes to support preemption requests (per YARN-45)

2013-08-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5189: - Status: Patch Available (was: Open) Basic AM changes to support preemption

[jira] [Updated] (MAPREDUCE-5189) Basic AM changes to support preemption requests (per YARN-45)

2013-08-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5189: - Attachment: MAPREDUCE-5189.3.patch Basic AM changes to support preemption

[jira] [Updated] (MAPREDUCE-5197) Checkpoint Service: a library component to facilitate checkpoint of task state

2013-08-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5197: - Status: Patch Available (was: Open) Checkpoint Service: a library component to

[jira] [Updated] (MAPREDUCE-5197) Checkpoint Service: a library component to facilitate checkpoint of task state

2013-08-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5197: - Attachment: MAPREDUCE-5197.2.patch Checkpoint Service: a library component to

[jira] [Updated] (MAPREDUCE-5197) Checkpoint Service: a library component to facilitate checkpoint of task state

2013-08-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5197: - Status: Open (was: Patch Available) Checkpoint Service: a library component to

[jira] [Commented] (MAPREDUCE-5462) In map-side sort, swap entire meta entries instead of indexes for better cache performance

2013-08-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741845#comment-13741845 ] Chris Douglas commented on MAPREDUCE-5462: -- +1 lgtm In

[jira] [Updated] (MAPREDUCE-1176) Contribution: FixedLengthInputFormat and FixedLengthRecordReader

2013-08-01 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-1176: - Assignee: (was: Chris Douglas) Contribution: FixedLengthInputFormat and

[jira] [Updated] (MAPREDUCE-5176) Preemptable annotations (to support preemption in MR)

2013-06-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5176: - Description: Proposing a patch that introduces a new annotation @Checkpointable that

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-06-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Status: Patch Available (was: Open) Heed interrupts during Fetcher shutdown

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-06-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Attachment: M5194-2.patch bq. Should we make openConnection synchronized and add an

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-06-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (MAPREDUCE-5176) Preemptable annotations (to support preemption in MR)

2013-05-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5176: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Status:

[jira] [Updated] (MAPREDUCE-5176) Preemptable annotations (to support preemption in MR)

2013-05-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5176: - Attachment: MAPREDUCE-5176.2.patch Thanks for the review, Vinod. Changed the names,

[jira] [Updated] (MAPREDUCE-5176) Preemptable annotations (to support preemption in MR)

2013-05-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5176: - Status: Open (was: Patch Available) Preemptable annotations (to support

[jira] [Updated] (MAPREDUCE-5176) Preemptable annotations (to support preemption in MR)

2013-05-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5176: - Status: Patch Available (was: Open) Preemptable annotations (to support

[jira] [Updated] (MAPREDUCE-5176) Preemptable annotations (to support preemption in MR)

2013-05-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5176: - Attachment: MAPREDUCE-5176.3.patch Missed some license headers...

[jira] [Commented] (MAPREDUCE-5176) Preemptable annotations (to support preemption in MR)

2013-05-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669075#comment-13669075 ] Chris Douglas commented on MAPREDUCE-5176: -- I'm skeptical of YARN-level

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-05-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Status: Patch Available (was: Open) Separate TCE resolution from fetch

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-05-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Attachment: M5192-2.patch Fixed the inconsistent synchronization, but left the

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-05-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Fix Version/s: 2.0.5-beta Heed interrupts during Fetcher shutdown

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-05-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Fix Version/s: 2.0.5-beta Separate TCE resolution from fetch

[jira] [Updated] (MAPREDUCE-5176) Preemptable annotations (to support preemption in MR)

2013-05-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5176: - Fix Version/s: 2.0.5-beta Preemptable annotations (to support preemption in MR)

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-05-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Attachment: M5194-1.patch Unfortunately, there's no way (AFAICT) to trash a

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-05-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Status: Patch Available (was: Open) Heed interrupts during Fetcher shutdown

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-05-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Status: Open (was: Patch Available) Separate TCE resolution from fetch

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-05-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Attachment: M5192-1.patch Separate TCE resolution from fetch

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-05-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Status: Patch Available (was: Open) Separate TCE resolution from fetch

[jira] [Commented] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-05-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665903#comment-13665903 ] Chris Douglas commented on MAPREDUCE-5192: -- The findbugs warnings are from

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-05-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Status: Open (was: Patch Available) Separate TCE resolution from fetch

[jira] [Commented] (MAPREDUCE-4584) Umbrella: Preemption and restart of MapReduce tasks

2013-05-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13652832#comment-13652832 ] Chris Douglas commented on MAPREDUCE-4584: -- [~ozawa]: I've been reading some

[jira] [Updated] (MAPREDUCE-5209) ShuffleScheduler log message incorrect

2013-05-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5209: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed

[jira] [Created] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-04-30 Thread Chris Douglas (JIRA)
Chris Douglas created MAPREDUCE-5194: Summary: Heed interrupts during Fetcher shutdown Key: MAPREDUCE-5194 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5194 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-04-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Attachment: M5194.patch Heed interrupts during Fetcher shutdown

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-04-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Status: Patch Available (was: Open) Heed interrupts during Fetcher shutdown

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-04-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Status: Patch Available (was: Open) Separate TCE resolution from fetch

[jira] [Updated] (MAPREDUCE-5194) Heed interrupts during Fetcher shutdown

2013-04-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5194: - Status: Open (was: Patch Available) The approach is incorrect. Interruption of

[jira] [Created] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-04-29 Thread Chris Douglas (JIRA)
Chris Douglas created MAPREDUCE-5192: Summary: Separate TCE resolution from fetch Key: MAPREDUCE-5192 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5192 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-5192) Separate TCE resolution from fetch

2013-04-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5192: - Attachment: M5192.patch Separate TCE resolution from fetch

[jira] [Updated] (MAPREDUCE-5189) Basic AM changes to support preemption requests (per YARN-45)

2013-04-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-5189: - Attachment: MAPREDUCE-5189.patch Basic AM changes to support preemption

[jira] [Commented] (MAPREDUCE-5028) Maps fail when io.sort.mb is set to high value

2013-02-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13589413#comment-13589413 ] Chris Douglas commented on MAPREDUCE-5028: -- I'd rather leave

[jira] [Created] (MAPREDUCE-5032) MapTask.MapOutputBuffer contains arithmetic overflows

2013-02-26 Thread Chris Douglas (JIRA)
Chris Douglas created MAPREDUCE-5032: Summary: MapTask.MapOutputBuffer contains arithmetic overflows Key: MAPREDUCE-5032 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5032 Project: Hadoop

[jira] [Commented] (MAPREDUCE-5028) Maps fail when io.sort.mb is set to high value

2013-02-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13587448#comment-13587448 ] Chris Douglas commented on MAPREDUCE-5028: -- bq. getLength() returns the size

[jira] [Commented] (MAPREDUCE-2264) Job status exceeds 100% in some cases

2013-01-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13564012#comment-13564012 ] Chris Douglas commented on MAPREDUCE-2264: -- The patch to trunk changes

[jira] [Commented] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13558584#comment-13558584 ] Chris Douglas commented on MAPREDUCE-4808: -- Fair point. This looks ready to

[jira] [Commented] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13557635#comment-13557635 ] Chris Douglas commented on MAPREDUCE-4808: -- bq. So, I renamed

[jira] [Updated] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-4808: - Attachment: M4808-0.patch I'd argue: # {{sed}} is not brain surgery and these

[jira] [Updated] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-4808: - Attachment: M4808-1.patch Wrong patch; meant to change the target of the findbugs

[jira] [Commented] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13556536#comment-13556536 ] Chris Douglas commented on MAPREDUCE-4808: -- Asokan, the concern is that even

[jira] [Commented] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13556738#comment-13556738 ] Chris Douglas commented on MAPREDUCE-4808: -- +1 Looked through it; the latest

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2013-01-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13553076#comment-13553076 ] Chris Douglas commented on MAPREDUCE-4808: -- [~tucu00]: that sounds

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2013-01-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552113#comment-13552113 ] Chris Douglas commented on MAPREDUCE-4808: -- I like many of these changes

[jira] [Commented] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

2012-12-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536719#comment-13536719 ] Chris Douglas commented on MAPREDUCE-4888: -- +1

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13531405#comment-13531405 ] Chris Douglas commented on MAPREDUCE-4808: -- bq. Can you pls confirm if we

[jira] [Commented] (MAPREDUCE-4049) plugin for generic shuffle service

2012-12-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528913#comment-13528913 ] Chris Douglas commented on MAPREDUCE-4049: -- This is clearly related to

[jira] [Updated] (MAPREDUCE-4866) ShuffleRamManager is limited to 2Gb of memory - we should increase that

2012-12-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-4866: - Attachment: M4866-0.patch ShuffleRamManager is limited to 2Gb of memory - we

[jira] [Commented] (MAPREDUCE-4866) ShuffleRamManager is limited to 2Gb of memory - we should increase that

2012-12-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13529388#comment-13529388 ] Chris Douglas commented on MAPREDUCE-4866: -- The patch is against the 1.x

[jira] [Commented] (MAPREDUCE-4807) Allow MapOutputBuffer to be pluggable

2012-11-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506805#comment-13506805 ] Chris Douglas commented on MAPREDUCE-4807: -- Asokan, can you explain this part

[jira] [Comment Edited] (MAPREDUCE-4807) Allow MapOutputBuffer to be pluggable

2012-11-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506805#comment-13506805 ] Chris Douglas edited comment on MAPREDUCE-4807 at 11/29/12 9:16 PM:

[jira] [Commented] (MAPREDUCE-4502) Multi-level aggregation with combining the result of maps per node/rack

2012-09-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13455909#comment-13455909 ] Chris Douglas commented on MAPREDUCE-4502: -- bq. This seems to be good

[jira] [Commented] (MAPREDUCE-4502) Multi-level aggregation with combining the result of maps per node/rack

2012-09-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454424#comment-13454424 ] Chris Douglas commented on MAPREDUCE-4502: -- {quote} Will there be one

[jira] [Commented] (MAPREDUCE-4170) Move sleep and fail jobs from tests module to examples module

2012-04-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258661#comment-13258661 ] Chris Douglas commented on MAPREDUCE-4170: -- MAPREDUCE-973 The test

[jira] [Commented] (MAPREDUCE-2484) divideAndCeil should not use LOG.info or have a more meaningful message

2011-09-04 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13096999#comment-13096999 ] Chris Douglas commented on MAPREDUCE-2484: -- The log message should never

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2011-08-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13094154#comment-13094154 ] Chris Douglas commented on MAPREDUCE-2841: -- bq. we are trying to evaluate and

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2011-08-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13093121#comment-13093121 ] Chris Douglas commented on MAPREDUCE-2841: -- {quote}I agree. How to contribute

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2011-08-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13093291#comment-13093291 ] Chris Douglas commented on MAPREDUCE-2841: -- bq. If the java impl use the

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

2011-08-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2841: - Attachment: dualpivotv20-0.patch dualpivot-0.patch bq. Java 7 uses a

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2011-08-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13092596#comment-13092596 ] Chris Douglas commented on MAPREDUCE-2841: -- {quote}Just an idea, what if

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

2011-06-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2569: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] [Resolved] (MAPREDUCE-2535) JobClient creates a RunningJob with null status and profile

2011-06-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved MAPREDUCE-2535. -- Resolution: Fixed Committed the follow-up. Thanks for the quick fix. JobClient

[jira] [Commented] (MAPREDUCE-2529) Recognize Jetty bug 1342 and handle it

2011-06-04 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13044209#comment-13044209 ] Chris Douglas commented on MAPREDUCE-2529: -- bq. If the currently used version

[jira] [Updated] (MAPREDUCE-2529) Recognize Jetty bug 1342 and handle it

2011-06-04 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2529: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] [Updated] (MAPREDUCE-2558) Add queue-level metrics 0.20-security branch

2011-06-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2558: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] [Updated] (MAPREDUCE-2535) JobClient creates a RunningJob with null status and profile

2011-06-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2535: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] [Updated] (MAPREDUCE-2524) Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle

2011-06-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2524: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] [Updated] (MAPREDUCE-2529) Recognize Jetty bug 1342 and handle it

2011-06-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2529: - Attachment: M2529-1.patch M2529-1-20s.patch Minor nits: * As a

[jira] [Updated] (MAPREDUCE-2557) Counters don't reset state when readFields() called

2011-06-01 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2557: - Status: Patch Available (was: Open) Counters don't reset state when readFields()

[jira] [Updated] (MAPREDUCE-2470) Receiving NPE occasionally on RunningJob.getCounters() call

2011-05-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2470: - Resolution: Fixed Status: Resolved (was: Patch Available) I committed the

[jira] [Updated] (MAPREDUCE-2495) The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason

2011-05-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2495: - Resolution: Fixed Fix Version/s: 0.23.0 0.20.205.0

[jira] [Updated] (MAPREDUCE-2494) Make the distributed cache delete entires using LRU priority

2011-05-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2494: - Resolution: Fixed Fix Version/s: 0.23.0 Hadoop Flags: [Reviewed]

[jira] [Commented] (MAPREDUCE-2492) [MAPREDUCE] The new MapReduce API should make available task's progress to the task

2011-05-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038214#comment-13038214 ] Chris Douglas commented on MAPREDUCE-2492: -- This is partially my fault. I

[jira] [Updated] (MAPREDUCE-2470) Receiving NPE occasionally on RunningJob.getCounters() call

2011-05-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2470: - Resolution: Fixed Fix Version/s: 0.23.0 Hadoop Flags: [Reviewed]

[jira] [Updated] (MAPREDUCE-2514) ReinitTrackerAction class name misspelled RenitTrackerAction in task tracker log

2011-05-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2514: - Resolution: Fixed Fix Version/s: 0.23.0 0.20.205.0

[jira] [Updated] (MAPREDUCE-2490) Log blacklist debug count

2011-05-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated MAPREDUCE-2490: - Resolution: Fixed Fix Version/s: 0.23.0 0.20.205.0

[jira] [Commented] (MAPREDUCE-2470) Receiving NPE occasionally on RunningJob.getCounters() call

2011-05-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13037161#comment-13037161 ] Chris Douglas commented on MAPREDUCE-2470: -- *sigh* Yea, it looks like the

[jira] [Reopened] (MAPREDUCE-2470) Receiving NPE occasionally on RunningJob.getCounters() call

2011-05-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reopened MAPREDUCE-2470: -- Reverted while FI breakage is investigated Receiving NPE occasionally on

[jira] [Commented] (MAPREDUCE-2492) [MAPREDUCE] The new MapReduce API should make available task's progress to the task

2011-05-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13037231#comment-13037231 ] Chris Douglas commented on MAPREDUCE-2492: -- Adding progress to

[jira] [Commented] (MAPREDUCE-2520) InputSampler.RandomSampler only accepts Text keys

2011-05-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13036450#comment-13036450 ] Chris Douglas commented on MAPREDUCE-2520: -- Which version of Hadoop are you

[jira] [Resolved] (MAPREDUCE-2520) InputSampler.RandomSampler only accepts Text keys

2011-05-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved MAPREDUCE-2520. -- Resolution: Invalid I see. This doesn't appear to be a bug in Hadoop, so I'm going

[jira] [Commented] (MAPREDUCE-2470) Receiving NPE occasionally on RunningJob.getCounters() call

2011-05-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13036537#comment-13036537 ] Chris Douglas commented on MAPREDUCE-2470: -- Is there another NPE in

<    1   2   3   4   5   6   7   8   >