[jira] [Commented] (YARN-881) Priority#compareTo method seems to be wrong.

2013-08-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13744084#comment-13744084 ] Sandy Ryza commented on YARN-881: - Lgtm, +1 > Priority#compareTo method see

[jira] [Commented] (YARN-881) Priority#compareTo method seems to be wrong.

2013-08-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13741515#comment-13741515 ] Sandy Ryza commented on YARN-881: - I'm OK with the change. Can testPriority to be renamed t

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13741289#comment-13741289 ] Sandy Ryza commented on YARN-1024: -- My opinion is that we shouldn't delay the release for

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13741191#comment-13741191 ] Sandy Ryza commented on YARN-1024: -- bq. To paraphrase your proposal... Thanks for summariz

[jira] [Commented] (YARN-1064) YarnConfiguration scheduler configuration constants are not consistent

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13740216#comment-13740216 ] Sandy Ryza commented on YARN-1064: -- I think this is only for the scheduler configs. Do yo

[jira] [Commented] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13740198#comment-13740198 ] Sandy Ryza commented on YARN-1008: -- +1 > MiniYARNCluster with multiple no

[jira] [Commented] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13740101#comment-13740101 ] Sandy Ryza commented on YARN-1008: -- Is there a reason for using "include-port-in-node.name

[jira] [Commented] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13739913#comment-13739913 ] Sandy Ryza commented on YARN-1008: -- A few comments: Can we call the config RM_SCHEDULER_I

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13739900#comment-13739900 ] Sandy Ryza commented on YARN-1024: -- bq. I would also like us to have a flag that would eit

[jira] [Commented] (YARN-1060) Two tests in TestFairScheduler are missing @Test annotation

2013-08-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13739216#comment-13739216 ] Sandy Ryza commented on YARN-1060: -- Committed to trunk and branch-2. Thanks Niranjan!

[jira] [Commented] (YARN-1060) Two tests in TestFairScheduler are missing @Test annotation

2013-08-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13739211#comment-13739211 ] Sandy Ryza commented on YARN-1060: -- +1 > Two tests in TestFairScheduler a

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13738985#comment-13738985 ] Sandy Ryza commented on YARN-1024: -- I've been thinking a lot about this, and wanted to pro

[jira] [Created] (YARN-1060) Two tests in TestFairScheduler are missing @Test annotation

2013-08-12 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1060: Summary: Two tests in TestFairScheduler are missing @Test annotation Key: YARN-1060 URL: https://issues.apache.org/jira/browse/YARN-1060 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13735605#comment-13735605 ] Sandy Ryza commented on YARN-899: - Oh, makes sense because the NodeManager uses it as well.

[jira] [Commented] (YARN-1046) Disable mem monitoring by default in MiniYARNCluster

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13735406#comment-13735406 ] Sandy Ryza commented on YARN-1046: -- Vinod's comment on MAPREDUCE-5094 for disabling pmem a

[jira] [Created] (YARN-1052) Enforce submit application queue ACLs outside the scheduler

2013-08-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1052: Summary: Enforce submit application queue ACLs outside the scheduler Key: YARN-1052 URL: https://issues.apache.org/jira/browse/YARN-1052 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13735358#comment-13735358 ] Sandy Ryza commented on YARN-899: - The general approach and patch are looking good. Some co

[jira] [Commented] (YARN-1046) Disable mem monitoring by default in MiniYARNCluster

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13735310#comment-13735310 ] Sandy Ryza commented on YARN-1046: -- Thanks Karthik! Just committed this to trunk, branch-

[jira] [Updated] (YARN-1046) Disable mem monitoring by default in MiniYARNCluster

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1046: - Assignee: Karthik Kambatla (was: Sandy Ryza) > Disable mem monitoring by default in MiniYARNCluster >

[jira] [Assigned] (YARN-1046) TestDistributedShell fails intermittently

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1046: Assignee: Sandy Ryza (was: Karthik Kambatla) > TestDistributedShell fails intermittently >

[jira] [Updated] (YARN-1046) Disable mem monitoring by default in MiniYARNCluster

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1046: - Summary: Disable mem monitoring by default in MiniYARNCluster (was: TestDistributedShell fails intermitte

[jira] [Created] (YARN-1050) Document the Fair Scheduler REST API

2013-08-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1050: Summary: Document the Fair Scheduler REST API Key: YARN-1050 URL: https://issues.apache.org/jira/browse/YARN-1050 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13734935#comment-13734935 ] Sandy Ryza commented on YARN-589: - Good point - filed YARN-1050 > Expose a

[jira] [Commented] (YARN-1046) TestDistributedShell fails intermittently

2013-08-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13734265#comment-13734265 ] Sandy Ryza commented on YARN-1046: -- And yeah, MAPREDUCE-5094 may not be necessary now, tho

[jira] [Commented] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-08-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13734267#comment-13734267 ] Sandy Ryza commented on YARN-589: - Thanks for the review, Alejandro. Committed to trunk, br

[jira] [Commented] (YARN-1046) TestDistributedShell fails intermittently

2013-08-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13734264#comment-13734264 ] Sandy Ryza commented on YARN-1046: -- +1 > TestDistributedShell fails inter

[jira] [Commented] (YARN-1046) TestDistributedShell fails intermittently

2013-08-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13733913#comment-13733913 ] Sandy Ryza commented on YARN-1046: -- Just did some research and looks like these kinds of t

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732635#comment-13732635 ] Sandy Ryza commented on YARN-899: - bq. So, I think that the applicationACLs should be only f

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732615#comment-13732615 ] Sandy Ryza commented on YARN-899: - bq. In case of YARN, a queue is a YARN construct. Queue a

[jira] [Resolved] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1018. -- Resolution: Not A Problem > prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong >

[jira] [Commented] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732568#comment-13732568 ] Sandy Ryza commented on YARN-1018: -- Ah ok cool. In that case I'll close this and obviousl

[jira] [Commented] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732244#comment-13732244 ] Sandy Ryza commented on YARN-1018: -- If I understand correctly, you're saying that someone

[jira] [Updated] (YARN-1039) Add parameter for YARN resource requests to indicate "long lived"

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1039: - Description: A container request could support a new parameter "long-lived". This could be used by a sche

[jira] [Updated] (YARN-1039) Add parameter for YARN resource requests to indicate "long lived"

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1039: - Summary: Add parameter for YARN resource requests to indicate "long lived" (was: Add resource for YARN co

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732176#comment-13732176 ] Sandy Ryza commented on YARN-899: - I just took a look at the MR1 code. There, what was cont

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13731729#comment-13731729 ] Sandy Ryza commented on YARN-899: - Thanks for taking this up, Xuan. I took a look at the pa

[jira] [Updated] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-08-06 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-589: Attachment: YARN-589-2.patch > Expose a REST API for monitoring the fair scheduler >

[jira] [Commented] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-08-06 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13731413#comment-13731413 ] Sandy Ryza commented on YARN-589: - Latest patch adds scheduling policy to queue information.

[jira] [Created] (YARN-1034) Remove "experimental" in the Fair Scheduler documentation

2013-08-06 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1034: Summary: Remove "experimental" in the Fair Scheduler documentation Key: YARN-1034 URL: https://issues.apache.org/jira/browse/YARN-1034 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13730197#comment-13730197 ] Sandy Ryza commented on YARN-1024: -- bq. The speed that hardware permits a task to read fro

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13730195#comment-13730195 ] Sandy Ryza commented on YARN-1024: -- Jason, Steve, and Arun, you bring up good points that

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13729839#comment-13729839 ] Sandy Ryza commented on YARN-1024: -- If I am used to running my single-threaded task on a f

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728966#comment-13728966 ] Sandy Ryza commented on YARN-1024: -- For context, there has been discussion on YARN-972 abo

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728964#comment-13728964 ] Sandy Ryza commented on YARN-972: - bq. Not true. I did not mean to claim that that was the o

[jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-08-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728311#comment-13728311 ] Sandy Ryza commented on YARN-1003: -- You would set it when you discover that you are having

[jira] [Commented] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

2013-08-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13727728#comment-13727728 ] Sandy Ryza commented on YARN-1018: -- By setting locality relaxation to false, you're essent

[jira] [Commented] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726846#comment-13726846 ] Sandy Ryza commented on YARN-1008: -- No, this is common between schedulers.

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726726#comment-13726726 ] Sandy Ryza commented on YARN-972: - Agreed that speculative containers will be an awesome fea

[jira] [Commented] (YARN-1010) FairScheduler: decouple container scheduling from nodemanager heartbeats

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726704#comment-13726704 ] Sandy Ryza commented on YARN-1010: -- Agreed that it would be a good change to include in al

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726595#comment-13726595 ] Sandy Ryza commented on YARN-972: - Meant: That's why I say (3) and (4) should be non-goals.

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726594#comment-13726594 ] Sandy Ryza commented on YARN-972: - bq. Determinism isn't something you can get with other wo

[jira] [Commented] (YARN-1009) Scheduler configuration properties should be prefixed with the scheduler type

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726590#comment-13726590 ] Sandy Ryza commented on YARN-1009: -- Is this a duplicate of YARN-1004? > S

[jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726586#comment-13726586 ] Sandy Ryza commented on YARN-1003: -- bq. this can be done by being conservative on the memo

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726122#comment-13726122 ] Sandy Ryza commented on YARN-1004: -- Uploaded a patch that adds "fair", "capacity", and "fi

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726124#comment-13726124 ] Sandy Ryza commented on YARN-1004: -- By which I mean [~tucu00] > yarn.sche

[jira] [Updated] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1004: - Attachment: YARN-1004.patch > yarn.scheduler.minimum|maximum|increment-allocation-mb should have sched

[jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726111#comment-13726111 ] Sandy Ryza commented on YARN-1003: -- My thinking was not per job. Agreed that the way to d

[jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726100#comment-13726100 ] Sandy Ryza commented on YARN-1003: -- This makes it so that we don't need to use the resourc

[jira] [Commented] (YARN-758) Augment MockNM to use multiple cores

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726069#comment-13726069 ] Sandy Ryza commented on YARN-758: - +1 > Augment MockNM to use multiple core

[jira] [Commented] (YARN-758) TestRMRestart should use MockNMs with multiple cores

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13725842#comment-13725842 ] Sandy Ryza commented on YARN-758: - There are likely a number of other tests that have simila

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13725837#comment-13725837 ] Sandy Ryza commented on YARN-972: - I should have probably tried to be more clear about what

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13725522#comment-13725522 ] Sandy Ryza commented on YARN-1004: -- [~hitesh], your reasoning makes sense to me. I'll lea

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13725476#comment-13725476 ] Sandy Ryza commented on YARN-1004: -- [~hitesh], maximum-allocation is just for consistency.

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13725459#comment-13725459 ] Sandy Ryza commented on YARN-972: - [~ste...@apache.org], bq. Those caches are the key to per

[jira] [Created] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1004: Summary: yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler Key: YARN-1004 URL: https://issues.apache.org/jira/browse/YARN-1004 Project: Hadoop YARN

[jira] [Created] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1003: Summary: Add a maxContainersPerNode config to the Fair Scheduler Key: YARN-1003 URL: https://issues.apache.org/jira/browse/YARN-1003 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13724585#comment-13724585 ] Sandy Ryza commented on YARN-353: - The patch looks good to me, other than the findbugs warni

[jira] [Commented] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13724228#comment-13724228 ] Sandy Ryza commented on YARN-957: - I believe we fixed this for the Fair Scheduler in YARN-28

[jira] [Updated] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-589: Attachment: YARN-589-1.patch > Expose a REST API for monitoring the fair scheduler >

[jira] [Commented] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13724147#comment-13724147 ] Sandy Ryza commented on YARN-589: - Added a test. > Expose a REST API for mo

[jira] [Commented] (YARN-932) TestResourceLocalizationService.testLocalizationInit can fail on JDK7

2013-07-29 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13723047#comment-13723047 ] Sandy Ryza commented on YARN-932: - Thanks Karthik! Committed to trunk, branch-2, and branch

[jira] [Commented] (YARN-948) RM should validate the release container list before actually releasing them

2013-07-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13721486#comment-13721486 ] Sandy Ryza commented on YARN-948: - +1 to InvalidContainerReleaseException >

[jira] [Created] (YARN-976) Document the meaning of a virtual core

2013-07-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-976: --- Summary: Document the meaning of a virtual core Key: YARN-976 URL: https://issues.apache.org/jira/browse/YARN-976 Project: Hadoop YARN Issue Type: Task Compo

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13720052#comment-13720052 ] Sandy Ryza commented on YARN-972: - Ah, so if I understand correctly, you're saying that runn

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13719844#comment-13719844 ] Sandy Ryza commented on YARN-972: - [~t.st.clair], when you say the "real scheduler" you mean

[jira] [Created] (YARN-973) yarn.application.classpath requires client to know service internals

2013-07-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-973: --- Summary: yarn.application.classpath requires client to know service internals Key: YARN-973 URL: https://issues.apache.org/jira/browse/YARN-973 Project: Hadoop YARN I

[jira] [Created] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-24 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-972: --- Summary: Allow requests and scheduling for fractional virtual cores Key: YARN-972 URL: https://issues.apache.org/jira/browse/YARN-972 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-969) Fair Scheduler should validate the release container list before actually releasing them

2013-07-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13718823#comment-13718823 ] Sandy Ryza commented on YARN-969: - [~ojoshi], makes sense to me. > Fair Sch

[jira] [Commented] (YARN-932) TestResourceLocalizationService.testLocalizationInit can fail on JDK7

2013-07-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13718729#comment-13718729 ] Sandy Ryza commented on YARN-932: - Thanks Karthik. +1 > TestResourceLocali

[jira] [Created] (YARN-969) Fair Scheduler should validate the release container list before actually releasing them

2013-07-24 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-969: --- Summary: Fair Scheduler should validate the release container list before actually releasing them Key: YARN-969 URL: https://issues.apache.org/jira/browse/YARN-969 Project: Had

[jira] [Commented] (YARN-944) App failed with container launch failed even though container started

2013-07-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13716672#comment-13716672 ] Sandy Ryza commented on YARN-944: - I'm facing this as well. The error I'm getting on the AM

[jira] [Commented] (YARN-701) ApplicationTokens should be used irrespective of kerberos

2013-07-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13716668#comment-13716668 ] Sandy Ryza commented on YARN-701: - I'm getting the following error in the AM when trying to

[jira] [Updated] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-589: Attachment: YARN-589.patch > Expose a REST API for monitoring the fair scheduler > --

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713966#comment-13713966 ] Sandy Ryza commented on YARN-905: - +1 > Add state filters to nodes CLI > --

[jira] [Created] (YARN-942) In Fair Scheduler documentation, inconsistency on which properties have prefix

2013-07-19 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-942: --- Summary: In Fair Scheduler documentation, inconsistency on which properties have prefix Key: YARN-942 URL: https://issues.apache.org/jira/browse/YARN-942 Project: Hadoop YARN

[jira] [Updated] (YARN-939) Rename ContainerManagerImpl to ContainerManagementImpl

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-939: Labels: newbie (was: ) > Rename ContainerManagerImpl to ContainerManagementImpl > --

[jira] [Created] (YARN-939) Rename ContainerManagerImpl to ContainerManagementImpl

2013-07-19 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-939: --- Summary: Rename ContainerManagerImpl to ContainerManagementImpl Key: YARN-939 URL: https://issues.apache.org/jira/browse/YARN-939 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713812#comment-13713812 ] Sandy Ryza commented on YARN-905: - Thanks for working on this, [~ywskycn]. The patch mostly

[jira] [Commented] (YARN-932) TestResourceLocalizationService.testLocalizationInit can fail on JDK7

2013-07-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13710551#comment-13710551 ] Sandy Ryza commented on YARN-932: - {code} org.apache.hadoop.yarn.YarnException: ${yarn.log.d

[jira] [Created] (YARN-932) TestResourceLocalizationService.testLocalizationInit can fail on JDK7

2013-07-16 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-932: --- Summary: TestResourceLocalizationService.testLocalizationInit can fail on JDK7 Key: YARN-932 URL: https://issues.apache.org/jira/browse/YARN-932 Project: Hadoop YARN

[jira] [Commented] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13710388#comment-13710388 ] Sandy Ryza commented on YARN-927: - +1 > Change ContainerRequest to not have

[jira] [Updated] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2013-07-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-807: Attachment: YARN-807.patch > When querying apps by queue, iterating over all apps is inefficient and > l

[jira] [Commented] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13710204#comment-13710204 ] Sandy Ryza commented on YARN-927: - I've thought about this a little more and I'm no longer o

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13710152#comment-13710152 ] Sandy Ryza commented on YARN-521: - Thanks Bikas! > Augment AM - RM client m

[jira] [Commented] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709359#comment-13709359 ] Sandy Ryza commented on YARN-927: - Removing the ability to request multiple containers would

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708707#comment-13708707 ] Sandy Ryza commented on YARN-521: - (The diff you were comparing was before I had uploaded th

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708706#comment-13708706 ] Sandy Ryza commented on YARN-521: - Rebased on trunk > Augment AM - RM clien

[jira] [Updated] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-521: Attachment: YARN-521-6.patch > Augment AM - RM client module to be able to request containers only at >

[jira] [Updated] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-521: Attachment: YARN-521-5.patch > Augment AM - RM client module to be able to request containers only at >

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708652#comment-13708652 ] Sandy Ryza commented on YARN-521: - Looks like Eclipse wasn't failing on the non-JUnit assert

<    5   6   7   8   9   10   11   12   13   14   >