[jira] [Commented] (YARN-6282) Recreate interceptor chain for different attemptId in the same node in AMRMProxy

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966160#comment-15966160 ] Carlo Curino commented on YARN-6282: [~botong] thanks for the patch, few questions: # while not very

[jira] [Commented] (YARN-3666) Federation Intercepting and propagating AM-RM communications

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966123#comment-15966123 ] Carlo Curino commented on YARN-3666: [~botong] if you are very confident about the fact that findbugs

[jira] [Commented] (YARN-3666) Federation Intercepting and propagating AM-RM communications

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966101#comment-15966101 ] Carlo Curino commented on YARN-3666: I will re-kicked yetus. > Federation Intercepting and propagating

[jira] [Updated] (YARN-6203) Occasional test failure in TestWeightedRandomRouterPolicy

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6203: --- Attachment: YARN-6203-YARN-2915.v1.patch Minutia, removed unnecessary zero check. > Occasional test

[jira] [Commented] (YARN-6203) Occasional test failure in TestWeightedRandomRouterPolicy

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966086#comment-15966086 ] Carlo Curino commented on YARN-6203: @subru can you check this out? > Occasional test failure in

[jira] [Updated] (YARN-6203) Occasional test failure in TestWeightedRandomRouterPolicy

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6203: --- Attachment: YARN-6203-YARN-2915.v0.patch Flacking was due to the fact that variance of sampling was

[jira] [Commented] (YARN-6473) Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966036#comment-15966036 ] Carlo Curino commented on YARN-6473: Initial patch. Depends on YARN-6451. > Create

[jira] [Updated] (YARN-6473) Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6473: --- Attachment: YARN-6473.v0.patch > Create ReservationInvariantChecker to validate ReservationSystem +

[jira] [Updated] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6451: --- Attachment: YARN-6451.v2.patch > Create a monitor to check whether we maintain RM (scheduling)

[jira] [Commented] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966031#comment-15966031 ] Carlo Curino commented on YARN-6451: Some more cleanup. > Create a monitor to check whether we

[jira] [Created] (YARN-6473) Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations

2017-04-12 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-6473: -- Summary: Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations Key: YARN-6473 URL: https://issues.apache.org/jira/browse/YARN-6473

[jira] [Commented] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966001#comment-15966001 ] Carlo Curino commented on YARN-6439: Thanks [~leftnoteasy] for reviewing and committing. > Fix

[jira] [Issue Comment Deleted] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: (was: YARN-6363.v8.patch) > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v9.patch > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v8.patch Rebasing after YARN-6439 is committed. > Extending SLS: Synthetic Load

[jira] [Commented] (YARN-6469) Extending Synthetic Load Generator and SLS for recurring reservation

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965982#comment-15965982 ] Carlo Curino commented on YARN-6469: This patch builds upon the synthetic generator introduced in

[jira] [Commented] (YARN-6469) Extending Synthetic Load Generator and SLS for recurring reservation

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965980#comment-15965980 ] Carlo Curino commented on YARN-6469: The initial patch (depending on YARN-6363): 1) modifies the

[jira] [Issue Comment Deleted] (YARN-6469) Extending Synthetic Load Generator and SLS for recurring reservation

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6469: --- Comment: was deleted (was: This patch builds upon the synthetic generator introduced in YARN-6363.) >

[jira] [Updated] (YARN-6469) Extending Synthetic Load Generator and SLS for recurring reservation

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6469: --- Summary: Extending Synthetic Load Generator and SLS for recurring reservation (was: Extending

[jira] [Updated] (YARN-6469) Extending Synthetic Load Generator for recurring reservation

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6469: --- Description: This JIRA extends the synthetic load generator, and SLS to support the generation and

[jira] [Updated] (YARN-6469) Extending Synthetic Load Generator for recurring reservation

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6469: --- Attachment: YARN-6469.v0.patch > Extending Synthetic Load Generator for recurring reservation >

[jira] [Assigned] (YARN-6469) Extending Synthetic Load Generator for recurring reservation

2017-04-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-6469: -- Assignee: Carlo Curino > Extending Synthetic Load Generator for recurring reservation >

[jira] [Created] (YARN-6469) Extending Synthetic Load Generator for recurring reservation

2017-04-11 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-6469: -- Summary: Extending Synthetic Load Generator for recurring reservation Key: YARN-6469 URL: https://issues.apache.org/jira/browse/YARN-6469 Project: Hadoop YARN

[jira] [Commented] (YARN-3663) Federation State and Policy Store (DBMS implementation)

2017-04-11 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964832#comment-15964832 ] Carlo Curino commented on YARN-3663: [~giovanni.fumarola], the current patch doesn't seem to contain

[jira] [Commented] (YARN-3663) Federation State and Policy Store (DBMS implementation)

2017-04-10 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963868#comment-15963868 ] Carlo Curino commented on YARN-3663: Now that HADOOP-13545 is committed I kicked yetus to run the usual

[jira] [Commented] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961521#comment-15961521 ] Carlo Curino commented on YARN-6451: [~jlowe] I think the inline asserts might be useful particularly

[jira] [Updated] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6451: --- Attachment: YARN-6451.v1.patch Fixed checkstyles and ASF warning, improved tests, metrics coverage,

[jira] [Commented] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959937#comment-15959937 ] Carlo Curino commented on YARN-6451: The patch provides and initial implementation of this idea. It

[jira] [Comment Edited] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959937#comment-15959937 ] Carlo Curino edited comment on YARN-6451 at 4/6/17 11:04 PM: - The patch

[jira] [Updated] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6451: --- Attachment: YARN-6451.v0.patch > Create a monitor to check whether we maintain RM (scheduling)

[jira] [Updated] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6439: --- Attachment: YARN-6439.v2.patch > Fix ReservationSystem creation of default ReservationQueue >

[jira] [Commented] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957856#comment-15957856 ] Carlo Curino commented on YARN-6439: Fixed the checkstyle... The

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v7.patch (missed one method rename) > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v6.patch Fixing dirty shutdown issue > Extending SLS: Synthetic Load Generator

[jira] [Created] (YARN-6451) Create a monitor to check whether we maintain RM (scheduling) invariants

2017-04-05 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-6451: -- Summary: Create a monitor to check whether we maintain RM (scheduling) invariants Key: YARN-6451 URL: https://issues.apache.org/jira/browse/YARN-6451 Project: Hadoop

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957655#comment-15957655 ] Carlo Curino commented on YARN-6363: [~wangda] I believe I addressed your concerns, and added the

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957657#comment-15957657 ] Carlo Curino commented on YARN-6363: QA rightfully gripes because we depend on YARN-6439. > Extending

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v5.patch > Extending SLS: Synthetic Load Generator >

[jira] [Commented] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956054#comment-15956054 ] Carlo Curino commented on YARN-6439: The v0 patch was failing in FairScheduler version of tests, as in

[jira] [Updated] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6439: --- Attachment: YARN-6439.v1.patch > Fix ReservationSystem creation of default ReservationQueue >

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956021#comment-15956021 ] Carlo Curino commented on YARN-6363: Moving some of this patch changes to YARN-6439, hence this patch

[jira] [Updated] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6439: --- Attachment: YARN-6439.v0.patch Simple patch anticipating the creation of the "default"

[jira] [Commented] (YARN-6430) Better unit test coverage required for SLS

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955978#comment-15955978 ] Carlo Curino commented on YARN-6430: [~leftnoteasy], I think I found and fixed the issues with tests in

[jira] [Commented] (YARN-6430) Better unit test coverage required for SLS

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955868#comment-15955868 ] Carlo Curino commented on YARN-6430: [~wangda] please checkout what I am doing in YARN-6363 for making

[jira] [Created] (YARN-6439) Fix ReservationSystem creation of default ReservationQueue

2017-04-04 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-6439: -- Summary: Fix ReservationSystem creation of default ReservationQueue Key: YARN-6439 URL: https://issues.apache.org/jira/browse/YARN-6439 Project: Hadoop YARN

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954658#comment-15954658 ] Carlo Curino commented on YARN-6363: Sounds good. Thanks [~wangda]. > Extending SLS: Synthetic Load

[jira] [Assigned] (YARN-6358) Cache the resolved hosts prevent calls to InetAddress.getByName and normalizeHost

2017-04-03 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-6358: -- Assignee: Jose Miguel Arreola > Cache the resolved hosts prevent calls to InetAddress.getByName

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-03 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954177#comment-15954177 ] Carlo Curino commented on YARN-6363: [~wangda] regarding the CS change, it does not change the behavior

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952005#comment-15952005 ] Carlo Curino commented on YARN-6363: It might be possible, but the case I was making is that the

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951534#comment-15951534 ] Carlo Curino commented on YARN-6363: Thanks [~wangda] for reviewing. Answering your questions: 1) ACK

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947980#comment-15947980 ] Carlo Curino commented on YARN-6363: v4 of the patch contains correct command-line scripts to run the

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v4.patch > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363 overview.pdf Minor fix in doc (commandline param) > Extending SLS: Synthetic

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: (was: YARN-6363 overview.pdf) > Extending SLS: Synthetic Load Generator >

[jira] [Commented] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

2017-03-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947652#comment-15947652 ] Carlo Curino commented on YARN-6408: It looks like the userName was probably removed (last app for this

[jira] [Updated] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

2017-03-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6408: --- Attachment: YARN-6408.v0.patch > NPE in handling NODE_UPDATE (while running SLS) >

[jira] [Commented] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

2017-03-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947638#comment-15947638 ] Carlo Curino commented on YARN-6408: After a 2 hours running SLS (with YARN-6363 synth generator), I

[jira] [Created] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

2017-03-29 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-6408: -- Summary: NPE in handling NODE_UPDATE (while running SLS) Key: YARN-6408 URL: https://issues.apache.org/jira/browse/YARN-6408 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-28 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946060#comment-15946060 ] Carlo Curino commented on YARN-6363: Heads up: the patch is definitely missing changes to slsrun.sh I

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944313#comment-15944313 ] Carlo Curino commented on YARN-6363: I added an initial document to describe hot to configure the

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: (was: YARN-6363 overview.pdf) > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363 overview.pdf > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363 overview.pdf > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v3.patch > Extending SLS: Synthetic Load Generator >

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-24 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941390#comment-15941390 ] Carlo Curino commented on YARN-6363: [~wangda] in the last (v2) patch, I tried to make the SLSRunner to

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-24 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v2.patch > Extending SLS: Synthetic Load Generator >

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939207#comment-15939207 ] Carlo Curino commented on YARN-6363: [~wangda], that is definitely something I plan to do. I will post

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v1.patch rebased > Extending SLS: Synthetic Load Generator >

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937422#comment-15937422 ] Carlo Curino commented on YARN-6363: [~subru] please check this out. This is an initial working version

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v0.patch Initial patch... forward port / adaptation from messier version we had

[jira] [Commented] (YARN-6370) Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy

2017-03-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937115#comment-15937115 ] Carlo Curino commented on YARN-6370: Thanks [~botong] for your contribution. > Properly handle rack

[jira] [Commented] (YARN-6370) Properly handle rack requests for non-active subclusters in LocalityMulticastAMRMProxyPolicy

2017-03-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936829#comment-15936829 ] Carlo Curino commented on YARN-6370: +1 The patch looks good to me. I will commit soon. > Properly

[jira] [Created] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-17 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-6363: -- Summary: Extending SLS: Synthetic Load Generator Key: YARN-6363 URL: https://issues.apache.org/jira/browse/YARN-6363 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3767) Yarn Scheduler Load Simulator does not work

2017-03-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930347#comment-15930347 ] Carlo Curino commented on YARN-3767: Makes sense. Is it ok to leave this JIRA closed, since we are

[jira] [Resolved] (YARN-3767) Yarn Scheduler Load Simulator does not work

2017-03-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino resolved YARN-3767. Resolution: Won't Fix >From my read of the conversation, I think this is not an actual issue. I will

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927509#comment-15927509 ] Carlo Curino commented on YARN-6344: I agree with what [~kkaranasos] said. In our clusters, the

[jira] [Commented] (YARN-6190) Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy

2017-02-28 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889499#comment-15889499 ] Carlo Curino commented on YARN-6190: Thanks [~subru]. > Validation and synchronization fixes in

[jira] [Commented] (YARN-6190) Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy

2017-02-28 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889253#comment-15889253 ] Carlo Curino commented on YARN-6190: Thanks [~botong], I just committed this to branch YARN-2915. >

[jira] [Updated] (YARN-6190) Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy

2017-02-28 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6190: --- Summary: Validation and synchronization fixes in LocalityMulticastAMRMProxyPolicy (was: Bug in

[jira] [Commented] (YARN-5385) Add a PriorityAgent in ReservationSystem

2017-02-28 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888967#comment-15888967 ] Carlo Curino commented on YARN-5385: [~seanpo03] thanks for addressing some of my comments, we are

[jira] [Commented] (YARN-6190) Bug in LocalityMulticastAMRMProxyPolicy argument validation

2017-02-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887051#comment-15887051 ] Carlo Curino commented on YARN-6190: Thanks [~botong] for the patch. What you say is consistent with

[jira] [Comment Edited] (YARN-6190) Bug fixes in federation polices

2017-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866793#comment-15866793 ] Carlo Curino edited comment on YARN-6190 at 2/14/17 10:04 PM: -- Hi [~botong],

[jira] [Comment Edited] (YARN-6190) Bug fixes in federation polices

2017-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866793#comment-15866793 ] Carlo Curino edited comment on YARN-6190 at 2/14/17 10:03 PM: -- Hi [~botong],

[jira] [Commented] (YARN-6190) Bug fixes in federation polices

2017-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866793#comment-15866793 ] Carlo Curino commented on YARN-6190: Hi [~botong], Thanks for the patch, it looks good in general. I

[jira] [Commented] (YARN-5864) Capacity Scheduler preemption for fragmented cluster

2016-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754101#comment-15754101 ] Carlo Curino commented on YARN-5864: [~wangda] I like the direction of specifying more clearly what

[jira] [Updated] (YARN-5871) Add support for reservation-based routing.

2016-11-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5871: --- Attachment: YARN-5871-YARN-2915.04.patch Addressing some of Yetus complaints > Add support for

[jira] [Updated] (YARN-5871) Add support for reservation-based routing.

2016-11-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5871: --- Attachment: YARN-5871-YARN-2915.03.patch > Add support for reservation-based routing. >

[jira] [Updated] (YARN-5871) Add support for reservation-based routing.

2016-11-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5871: --- Attachment: YARN-5871-YARN-2915.02.patch Uploading the right patch. > Add support for

[jira] [Commented] (YARN-5871) Add support for reservation-based routing.

2016-11-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709640#comment-15709640 ] Carlo Curino commented on YARN-5871: Marking as patch available to trigger initial runs of Yetus...

[jira] [Commented] (YARN-5871) Add support for reservation-based routing.

2016-11-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709633#comment-15709633 ] Carlo Curino commented on YARN-5871: I added to this also changes to the {{RouterPolicyFacade}} to

[jira] [Updated] (YARN-5871) Add support for reservation-based routing.

2016-11-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5871: --- Attachment: YARN-5871-YARN-2915.01.patch > Add support for reservation-based routing. >

[jira] [Comment Edited] (YARN-5435) [Regression] QueueCapacities not being updated for dynamic ReservationQueue

2016-11-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707056#comment-15707056 ] Carlo Curino edited comment on YARN-5435 at 11/30/16 12:37 AM: --- Thanks

[jira] [Commented] (YARN-5435) [Regression] QueueCapacities not being updated for dynamic ReservationQueue

2016-11-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707056#comment-15707056 ] Carlo Curino commented on YARN-5435: Thanks [~seanpo03] for working on this. Few comments below. # in

[jira] [Comment Edited] (YARN-5839) ClusterApplication API does not include a ReservationID

2016-11-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707020#comment-15707020 ] Carlo Curino edited comment on YARN-5839 at 11/30/16 12:21 AM: --- [~seanpo03]

[jira] [Commented] (YARN-5839) ClusterApplication API does not include a ReservationID

2016-11-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707020#comment-15707020 ] Carlo Curino commented on YARN-5839: [~seanpo03] thanks for contributing this. Seems like a simple and

[jira] [Comment Edited] (YARN-5385) Add a PriorityAgent in ReservationSystem

2016-11-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706987#comment-15706987 ] Carlo Curino edited comment on YARN-5385 at 11/30/16 12:06 AM: --- [~seanpo03]

[jira] [Commented] (YARN-5385) Add a PriorityAgent in ReservationSystem

2016-11-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706987#comment-15706987 ] Carlo Curino commented on YARN-5385: [~seanpo03] thanks for working on this. I like the general

[jira] [Commented] (YARN-5871) Add support for reservation-based routing.

2016-11-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706815#comment-15706815 ] Carlo Curino commented on YARN-5871: This initial (rough) patch provides an idea of how we can: 1)

[jira] [Updated] (YARN-5871) Add support for reservation-based routing.

2016-11-29 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5871: --- Attachment: YARN-5871-YARN-2915.01.patch > Add support for reservation-based routing. >

<    1   2   3   4   5   6   7   8   9   10   >