[jira] [Created] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list

Junping Du created MAPREDUCE-4198: - Summary: Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list of host) Key:

[jira] [Updated] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list

[ https://issues.apache.org/jira/browse/MAPREDUCE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4198: -- Status: Patch Available (was: Open) Update RackResolver and related tests to resolve

[jira] [Updated] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list

[ https://issues.apache.org/jira/browse/MAPREDUCE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4198: -- Attachment: MAPREDUCE-4198.patch This code is separated from HADOOP-8304's original patch.

[jira] [Commented] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a li

[ https://issues.apache.org/jira/browse/MAPREDUCE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13262354#comment-13262354 ] Junping Du commented on MAPREDUCE-4198: --- Sorry. This code looks wrong. Let me

[jira] [Updated] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list

[ https://issues.apache.org/jira/browse/MAPREDUCE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4198: -- Status: Open (was: Patch Available) Update RackResolver and related tests to resolve

[jira] [Updated] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list

[ https://issues.apache.org/jira/browse/MAPREDUCE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4198: -- Attachment: MAPREDUCE-4198-v2.patch This is an update patch as previous one include whole

[jira] [Updated] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list

[ https://issues.apache.org/jira/browse/MAPREDUCE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4198: -- Status: Patch Available (was: Open) Update RackResolver and related tests to resolve

[jira] [Commented] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a li

[ https://issues.apache.org/jira/browse/MAPREDUCE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13262386#comment-13262386 ] Junping Du commented on MAPREDUCE-4198: --- This patch depends on new interface

[jira] [Moved] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved HADOOP-8474 to MAPREDUCE-4309: --- Affects Version/s: (was: 2.0.0-alpha)

[jira] [Moved] (MAPREDUCE-4310) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/MAPREDUCE-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved HADOOP-8475 to MAPREDUCE-4310: --- Affects Version/s: (was: 2.0.0-alpha)

[jira] [Updated] (MAPREDUCE-4198) Update RackResolver and related tests to resolve host with new API from HADOOP-8304 (DNSToSwitchMapping should add interface to resolve individual host besides a list

[ https://issues.apache.org/jira/browse/MAPREDUCE-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4198: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) From Hadoop-8304,

[jira] [Commented] (MAPREDUCE-4310) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/MAPREDUCE-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13406830#comment-13406830 ] Junping Du commented on MAPREDUCE-4310: --- Hi Nicholas, There are two ways to

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Status: Open (was: Patch Available) Make locatlity in YARN's container assignment

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Attachment: MAPREDUCE-4309.patch Make locatlity in YARN's container assignment and

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13407714#comment-13407714 ] Junping Du commented on MAPREDUCE-4309: --- Yes. I cancelled the patch and now am

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Attachment: MAPREDUCE-4309-v2.patch Make locatlity in YARN's container assignment and

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Status: Patch Available (was: Open) Make locatlity in YARN's container assignment

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13408084#comment-13408084 ] Junping Du commented on MAPREDUCE-4309: --- Hey Nicholas, I just upload the

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Attachment: MAPREDUCE-4309-v3.patch Make locatlity in YARN's container assignment and

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13408562#comment-13408562 ] Junping Du commented on MAPREDUCE-4309: --- As this patch is mostly a refactoring

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Attachment: MAPREDUCE-4309-v4.patch In v4 patch, fix two minor issues in previous patch:

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13409323#comment-13409323 ] Junping Du commented on MAPREDUCE-4309: --- Hello Nicholas, Thanks for your

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13413546#comment-13413546 ] Junping Du commented on MAPREDUCE-4309: --- Bikas, thanks for your comments. Please

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13414294#comment-13414294 ] Junping Du commented on MAPREDUCE-4309: --- Yes. That's also what I am thinking. As

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13415947#comment-13415947 ] Junping Du commented on MAPREDUCE-4309: --- Looks like MAPREDUCE-4440 is just

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Status: Open (was: Patch Available) Make locatlity in YARN's container assignment

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Attachment: MAPREDUCE-4309-v5.patch Merge with recently code changes on YARN.

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Status: Patch Available (was: Open) Make locatlity in YARN's container assignment

[jira] [Updated] (MAPREDUCE-4310) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/MAPREDUCE-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4310: -- Attachment: MAPREDUCE-4310.patch Update patch as recently YARN scheduler change. Patch

[jira] [Created] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

Junping Du created MAPREDUCE-4452: - Summary: Several Findbugs issues with new FairScheduler in YARN Key: MAPREDUCE-4452 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4452 Project: Hadoop

[jira] [Updated] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4452: -- Attachment: MAPREDUCE-4452.patch Several Findbugs issues with new FairScheduler in

[jira] [Updated] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4452: -- Status: Patch Available (was: Open) Several Findbugs issues with new FairScheduler

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13416883#comment-13416883 ] Junping Du commented on MAPREDUCE-4309: --- The FindBugs issue is not related to

[jira] [Updated] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4452: -- Attachment: MAPREDUCE-4452-v1.patch Update for one FindBug issue. As this patch is to fix

[jira] [Commented] (MAPREDUCE-4439) MAPREDUCE-3451 introduced a bunch of findbugs warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13417867#comment-13417867 ] Junping Du commented on MAPREDUCE-4439: --- Oh, I just saw this issue after filed

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Attachment: MAPREDUCE-4309-v6.patch In newest patch (v6), update to use abstract factory

[jira] [Updated] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4452: -- Attachment: MAPREDUCE-4452-v2.patch Several Findbugs issues with new FairScheduler in

[jira] [Commented] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13419060#comment-13419060 ] Junping Du commented on MAPREDUCE-4452: --- Hi Patrick, Looks like the warnings are

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13419061#comment-13419061 ] Junping Du commented on MAPREDUCE-4309: --- The findbugs issues are unrelated and I

[jira] [Commented] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13419345#comment-13419345 ] Junping Du commented on MAPREDUCE-4452: --- Hi Patrick, For warning suppression,

[jira] [Updated] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4452: -- Attachment: MAPREDUCE-4452-v3.patch Several Findbugs issues with new FairScheduler in

[jira] [Commented] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13420120#comment-13420120 ] Junping Du commented on MAPREDUCE-4452: --- Patrick, you are right that the threads

[jira] [Updated] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4452: -- Attachment: MAPREDUCE-4452-v3.patch Several Findbugs issues with new FairScheduler in

[jira] [Commented] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13420133#comment-13420133 ] Junping Du commented on MAPREDUCE-4452: --- In new v3 patch, separating monitor

[jira] [Updated] (MAPREDUCE-4452) Several Findbugs issues with new FairScheduler in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4452: -- Attachment: (was: MAPREDUCE-4452-v3.patch) Several Findbugs issues with new

[jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4309: -- Attachment: MAPREDUCE-4309-v7.patch Rebase to latest trunk Make

[jira] [Updated] (MAPREDUCE-4310) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/MAPREDUCE-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4310: -- Attachment: MAPREDUCE-4310-v1.patch 4-layer topology (with NodeGroup layer)

[jira] [Commented] (MAPREDUCE-4310) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/MAPREDUCE-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13422429#comment-13422429 ] Junping Du commented on MAPREDUCE-4310: --- Update the newest patch to fit with v7

[jira] [Commented] (MAPREDUCE-4327) Enhance CS to schedule accounting for both memory and cpu cores

[ https://issues.apache.org/jira/browse/MAPREDUCE-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427672#comment-13427672 ] Junping Du commented on MAPREDUCE-4327: --- It looks like these findbugs warnings

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13428959#comment-13428959 ] Junping Du commented on MAPREDUCE-4309: --- Anyone can take a look at this patch.

[jira] [Commented] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13429048#comment-13429048 ] Junping Du commented on MAPREDUCE-4309: --- Bikas, Thanks for your review and help

[jira] [Created] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

Junping Du created MAPREDUCE-4660: - Summary: Update task placement policy for NetworkTopology with 'NodeGroup' layer Key: MAPREDUCE-4660 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4660

[jira] [Assigned] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-4660: - Assignee: Junping Du Update task placement policy for NetworkTopology with

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660.patch Update task placement policy for NetworkTopology

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Target Version/s: 1.2.0 (was: 1.0.3, 2.0.1-alpha) Update task placement policy for

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660-v2.patch Update patch to address recent changes on branch-1 in

[jira] [Updated] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4660: -- Attachment: MAPREDUCE-4660-v3.patch As HDFS-3942 is checked in to branch-1, so remove some

[jira] [Commented] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533744#comment-13533744 ] Junping Du commented on MAPREDUCE-4660: --- The test-patch result is as following:

[jira] [Created] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

Junping Du created MAPREDUCE-4886: - Summary: TestCapacityScheduler failed in branch-1 Key: MAPREDUCE-4886 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4886 Project: Hadoop Map/Reduce

[jira] [Assigned] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-4886: - Assignee: meng gong TestCapacityScheduler failed in branch-1

[jira] [Commented] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536914#comment-13536914 ] Junping Du commented on MAPREDUCE-4886: --- Yes. It should due to -noFile

[jira] [Resolved] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-4886. --- Resolution: Not A Problem TestCapacityScheduler failed in branch-1

[jira] [Created] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

Junping Du created MAPREDUCE-4900: - Summary: Dynamic configuration for task slots on TT Key: MAPREDUCE-4900 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4900 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904.patch Attach a quick fix. Meng, Would you verify it works on

[jira] [Commented] (MAPREDUCE-4660) Update task placement policy for NetworkTopology with 'NodeGroup' layer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13540404#comment-13540404 ] Junping Du commented on MAPREDUCE-4660: --- Thanks Luke! A very trivial bug related

[jira] [Commented] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13542687#comment-13542687 ] Junping Du commented on MAPREDUCE-4904: --- Sure. Thanks Luke for comments. If

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904-v2.patch Incorporate Luke's comments with adding comments to

[jira] [Updated] (MAPREDUCE-4904) TestMultipleLevelCaching failed in barnch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-4904: -- Attachment: MAPREDUCE-4904-v2.patch use --no-prefix to generate patch in new v2 patch.

[jira] [Commented] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

[ https://issues.apache.org/jira/browse/MAPREDUCE-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13554820#comment-13554820 ] Junping Du commented on MAPREDUCE-4900: --- Binglin, Thanks for the work. I see

[jira] [Commented] (MAPREDUCE-4944) Backport YARN-40 to support listClusterNodes and printNodeStatus in command line tool

[ https://issues.apache.org/jira/browse/MAPREDUCE-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13557031#comment-13557031 ] Junping Du commented on MAPREDUCE-4944: --- I prefer to break AdminOpProtocol if we

[jira] [Created] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

Junping Du created MAPREDUCE-5421: - Summary: TestNonExistentJob is failed due to recent changes in YARN Key: MAPREDUCE-5421 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5421 Project: Hadoop

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Attachment: MAPREDUCE-5421.patch Upload a quick patch to fix it.

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Target Version/s: 2.1.0-beta Status: Patch Available (was: Open)

[jira] [Updated] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5421: -- Attachment: MAPREDUCE-5421-v2.patch The ApplicationNotFoundException in server side should

[jira] [Commented] (MAPREDUCE-5421) TestNonExistentJob is failed due to recent changes in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13721341#comment-13721341 ] Junping Du commented on MAPREDUCE-5421: --- Thanks Vinod and Xuan for review!

[jira] [Updated] (MAPREDUCE-5301) Update MR code to work with YARN-635 changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5301: -- Assignee: Siddharth Seth Update MR code to work with YARN-635 changes

[jira] [Commented] (MAPREDUCE-4900) Dynamic configuration for task slots on TT

[ https://issues.apache.org/jira/browse/MAPREDUCE-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792110#comment-13792110 ] Junping Du commented on MAPREDUCE-4900: --- Thanks Binglin for the patch and

[jira] [Moved] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-1163 to MAPREDUCE-5593: - Component/s: (was: applications)

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Attachment: MAPREDUCE-5593-v3.patch rename the patch to MAPREDUCE in v3 patch and submit

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Attachment: MAPREDUCE-5593-v4.patch Sync patch with recently trunk branch. Cleanup code

[jira] [Updated] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5593: -- Status: Open (was: Patch Available) Cleanup code for AssignMapsWithLocality() in

[jira] [Commented] (MAPREDUCE-5593) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820906#comment-13820906 ] Junping Du commented on MAPREDUCE-5593: --- The test failure seems to be unrelated

[jira] [Commented] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996234#comment-13996234 ] Junping Du commented on MAPREDUCE-5861: --- Agree volatile is not help here so

[jira] [Updated] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5861: -- Issue Type: Improvement (was: Bug) finishedSubMaps field in LocalContainerLauncher does

[jira] [Updated] (MAPREDUCE-5861) finishedSubMaps field in LocalContainerLauncher does not need to be volatile

[ https://issues.apache.org/jira/browse/MAPREDUCE-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5861: -- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051046#comment-14051046 ] Junping Du commented on MAPREDUCE-5940: --- Thanks [~zjshen] to work on this and

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051048#comment-14051048 ] Junping Du commented on MAPREDUCE-5940: --- Also adding a test in TestTimes.java

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051345#comment-14051345 ] Junping Du commented on MAPREDUCE-5940: --- bq. Silently making the elapsed time as

[jira] [Commented] (MAPREDUCE-5940) Avoid negative elapsed time in JHS/MRAM web UI and services

[ https://issues.apache.org/jira/browse/MAPREDUCE-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052116#comment-14052116 ] Junping Du commented on MAPREDUCE-5940: --- Kick off Jenkins test. Patch looks good

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Issue Type: Sub-task (was: New Feature) Parent: MAPREDUCE-4150 ShuffleHandler DB

[jira] [Moved] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du moved YARN-2265 to MAPREDUCE-5963: - Component/s: (was: nodemanager) Target Version/s:

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963.patch Upload a draft patch. It should need some code in

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963-v2.patch Update patch to latest trunk and do some fix on

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Status: Patch Available (was: Open) ShuffleHandler DB schema should be versioned with

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963-v2.1.patch In latest patch, fix the findbug warning.

[jira] [Created] (MAPREDUCE-6023) Fix SuppressWarnings from unchecked to rawtypes in O.A.H.mapreduce.lib.input.TaggedInputSplit

Junping Du created MAPREDUCE-6023: - Summary: Fix SuppressWarnings from unchecked to rawtypes in O.A.H.mapreduce.lib.input.TaggedInputSplit Key: MAPREDUCE-6023 URL:

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101731#comment-14101731 ] Junping Du commented on MAPREDUCE-5891: --- Hi [~jlowe], I like to work on this if

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-demo.patch Thanks [~jlowe] for sharing the thoughts. I have a

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106341#comment-14106341 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for quickly feedback!

[jira] [Created] (MAPREDUCE-6052) Support overriding log4j.properties per job

Junping Du created MAPREDUCE-6052: - Summary: Support overriding log4j.properties per job Key: MAPREDUCE-6052 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6052 Project: Hadoop Map/Reduce

  1   2   3   4   5   6   7   >