[jira] [Resolved] (YARN-723) Yarn default value of physical cpu cores to virtual core is 2

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-723. - Resolution: Invalid Yarn default value of physical cpu cores to virtual core is 2

[jira] [Commented] (YARN-723) Yarn default value of physical cpu cores to virtual core is 2

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13751775#comment-13751775 ] Sandy Ryza commented on YARN-723: - Resolving as invalid now that YARN-782 removed the

[jira] [Updated] (YARN-832) Update Resource javadoc to clarify units for memory

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-832: Fix Version/s: (was: 2.3.0) Update Resource javadoc to clarify units for memory

[jira] [Updated] (YARN-832) Update Resource javadoc to clarify units for memory

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-832: Labels: newbie (was: ) Update Resource javadoc to clarify units for memory

[jira] [Updated] (YARN-832) Update Resource javadoc to clarify units for memory

2013-08-27 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-832: Target Version/s: 2.3.0 Update Resource javadoc to clarify units for memory

[jira] [Created] (YARN-1109) Consider throttling or demoting NodeManager Sending out status for container logs

2013-08-27 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1109: Summary: Consider throttling or demoting NodeManager Sending out status for container logs Key: YARN-1109 URL: https://issues.apache.org/jira/browse/YARN-1109 Project:

[jira] [Created] (YARN-1110) NodeManager doesn't complete container after transition from LOCALIZED to KILLING

2013-08-27 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1110: Summary: NodeManager doesn't complete container after transition from LOCALIZED to KILLING Key: YARN-1110 URL: https://issues.apache.org/jira/browse/YARN-1110 Project:

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13750286#comment-13750286 ] Sandy Ryza commented on YARN-1024: -- bq. It seems to me that the only time you'd want a YCU

[jira] [Updated] (YARN-1093) Corrections to fair scheduler documentation

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1093: - Summary: Corrections to fair scheduler documentation (was: corrections to fair scheduler documentation)

[jira] [Updated] (YARN-1093) Corrections to Fair Scheduler documentation

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1093: - Summary: Corrections to Fair Scheduler documentation (was: Corrections to fair scheduler documentation)

[jira] [Updated] (YARN-1093) Corrections to Fair Scheduler documentation

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1093: - Hadoop Flags: Reviewed Corrections to Fair Scheduler documentation

[jira] [Updated] (YARN-942) In Fair Scheduler documentation, inconsistency on which properties have prefix

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-942: Labels: documentation newbie (was: docuentation newbie) In Fair Scheduler documentation, inconsistency

[jira] [Commented] (YARN-1093) Corrections to Fair Scheduler documentation

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13750489#comment-13750489 ] Sandy Ryza commented on YARN-1093: -- I just committed this to trunk, branch-2, and

[jira] [Updated] (YARN-942) In Fair Scheduler documentation, inconsistency on which properties have prefix

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-942: Assignee: Akira AJISAKA In Fair Scheduler documentation, inconsistency on which properties have prefix

[jira] [Updated] (YARN-649) Make container logs available over HTTP in plain text

2013-08-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-649: Attachment: YARN-649-7.patch Make container logs available over HTTP in plain text

[jira] [Created] (YARN-1100) Giving multiple commands to ContainerLaunchContext doesn't work as expected

2013-08-26 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1100: Summary: Giving multiple commands to ContainerLaunchContext doesn't work as expected Key: YARN-1100 URL: https://issues.apache.org/jira/browse/YARN-1100 Project: Hadoop YARN

[jira] [Updated] (YARN-1093) corrections to fair scheduler documentation

2013-08-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1093: - Fix Version/s: (was: 2.1.0-beta) corrections to fair scheduler documentation

[jira] [Commented] (YARN-1093) corrections to fair scheduler documentation

2013-08-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13748879#comment-13748879 ] Sandy Ryza commented on YARN-1093: -- Thanks Wing Yew! +1 pendings Jenkins.

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-08-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749142#comment-13749142 ] Sandy Ryza commented on YARN-905: - I just committed this before Vinod's comment. I don't

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13747701#comment-13747701 ] Sandy Ryza commented on YARN-1024: -- Filed YARN-1089 for adding YCUs.

[jira] [Updated] (YARN-1089) Add YARN compute units alongside virtual cores

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1089: - Description: Based on discussion in YARN-1024, we will add YARN compute units as a resource for

[jira] [Commented] (YARN-1089) Add YARN compute units alongside virtual cores

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13747881#comment-13747881 ] Sandy Ryza commented on YARN-1089: -- Yeah, I'll write up a document and post it on

[jira] [Updated] (YARN-1024) Define a virtual core unambigiously

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1024: - Attachment: CPUasaYARNresource.pdf Define a virtual core unambigiously

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13748062#comment-13748062 ] Sandy Ryza commented on YARN-1024: -- I wrote up a more detailed proposal and attached a PDF

[jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text

2013-08-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13746880#comment-13746880 ] Sandy Ryza commented on YARN-649: - Uploading a new patch that * Puts

[jira] [Updated] (YARN-649) Make container logs available over HTTP in plain text

2013-08-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-649: Attachment: YARN-649-6.patch Make container logs available over HTTP in plain text

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13747142#comment-13747142 ] Sandy Ryza commented on YARN-972: - Based on the approach we've agreed upon in YARN-1024 that

[jira] [Resolved] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-972. - Resolution: Won't Fix Allow requests and scheduling for fractional virtual cores

[jira] [Created] (YARN-1089) Add YARN compute units alongside virtual cores

2013-08-21 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1089: Summary: Add YARN compute units alongside virtual cores Key: YARN-1089 URL: https://issues.apache.org/jira/browse/YARN-1089 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-881) Priority#compareTo method seems to be wrong.

2013-08-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13744084#comment-13744084 ] Sandy Ryza commented on YARN-881: - Lgtm, +1 Priority#compareTo method

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741191#comment-13741191 ] Sandy Ryza commented on YARN-1024: -- bq. To paraphrase your proposal... Thanks for

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741289#comment-13741289 ] Sandy Ryza commented on YARN-1024: -- My opinion is that we shouldn't delay the release for

[jira] [Commented] (YARN-881) Priority#compareTo method seems to be wrong.

2013-08-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741515#comment-13741515 ] Sandy Ryza commented on YARN-881: - I'm OK with the change. Can testPriority to be renamed

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739900#comment-13739900 ] Sandy Ryza commented on YARN-1024: -- bq. I would also like us to have a flag that would

[jira] [Commented] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739913#comment-13739913 ] Sandy Ryza commented on YARN-1008: -- A few comments: Can we call the config

[jira] [Commented] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740101#comment-13740101 ] Sandy Ryza commented on YARN-1008: -- Is there a reason for using include-port-in-node.name

[jira] [Commented] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740198#comment-13740198 ] Sandy Ryza commented on YARN-1008: -- +1 MiniYARNCluster with multiple

[jira] [Commented] (YARN-1064) YarnConfiguration scheduler configuration constants are not consistent

2013-08-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740216#comment-13740216 ] Sandy Ryza commented on YARN-1064: -- I think this is only for the scheduler configs. Do

[jira] [Created] (YARN-1060) Two tests in TestFairScheduler are missing @Test annotation

2013-08-13 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1060: Summary: Two tests in TestFairScheduler are missing @Test annotation Key: YARN-1060 URL: https://issues.apache.org/jira/browse/YARN-1060 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13738985#comment-13738985 ] Sandy Ryza commented on YARN-1024: -- I've been thinking a lot about this, and wanted to

[jira] [Commented] (YARN-1060) Two tests in TestFairScheduler are missing @Test annotation

2013-08-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739216#comment-13739216 ] Sandy Ryza commented on YARN-1060: -- Committed to trunk and branch-2. Thanks Niranjan!

[jira] [Commented] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13734935#comment-13734935 ] Sandy Ryza commented on YARN-589: - Good point - filed YARN-1050 Expose a

[jira] [Created] (YARN-1052) Enforce submit application queue ACLs outside the scheduler

2013-08-09 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1052: Summary: Enforce submit application queue ACLs outside the scheduler Key: YARN-1052 URL: https://issues.apache.org/jira/browse/YARN-1052 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-1046) Disable mem monitoring by default in MiniYARNCluster

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13735406#comment-13735406 ] Sandy Ryza commented on YARN-1046: -- Vinod's comment on MAPREDUCE-5094 for disabling pmem

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13735605#comment-13735605 ] Sandy Ryza commented on YARN-899: - Oh, makes sense because the NodeManager uses it as well.

[jira] [Commented] (YARN-1046) TestDistributedShell fails intermittently

2013-08-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13734264#comment-13734264 ] Sandy Ryza commented on YARN-1046: -- +1 TestDistributedShell fails

[jira] [Commented] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-08-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13734267#comment-13734267 ] Sandy Ryza commented on YARN-589: - Thanks for the review, Alejandro. Committed to trunk,

[jira] [Commented] (YARN-1046) TestDistributedShell fails intermittently

2013-08-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13734265#comment-13734265 ] Sandy Ryza commented on YARN-1046: -- And yeah, MAPREDUCE-5094 may not be necessary now,

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731729#comment-13731729 ] Sandy Ryza commented on YARN-899: - Thanks for taking this up, Xuan. I took a look at the

[jira] [Updated] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1039: - Description: A container request could support a new parameter long-lived. This could be used by a

[jira] [Commented] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732568#comment-13732568 ] Sandy Ryza commented on YARN-1018: -- Ah ok cool. In that case I'll close this and

[jira] [Resolved] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1018. -- Resolution: Not A Problem prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-08-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732635#comment-13732635 ] Sandy Ryza commented on YARN-899: - bq. So, I think that the applicationACLs should be only

[jira] [Created] (YARN-1034) Remove experimental in the Fair Scheduler documentation

2013-08-06 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1034: Summary: Remove experimental in the Fair Scheduler documentation Key: YARN-1034 URL: https://issues.apache.org/jira/browse/YARN-1034 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-08-06 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-589: Attachment: YARN-589-2.patch Expose a REST API for monitoring the fair scheduler

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729839#comment-13729839 ] Sandy Ryza commented on YARN-1024: -- If I am used to running my single-threaded task on a

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730195#comment-13730195 ] Sandy Ryza commented on YARN-1024: -- Jason, Steve, and Arun, you bring up good points that

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-08-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730197#comment-13730197 ] Sandy Ryza commented on YARN-1024: -- bq. The speed that hardware permits a task to read

[jira] [Commented] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

2013-08-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13727728#comment-13727728 ] Sandy Ryza commented on YARN-1018: -- By setting locality relaxation to false, you're

[jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-08-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728311#comment-13728311 ] Sandy Ryza commented on YARN-1003: -- You would set it when you discover that you are having

[jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726100#comment-13726100 ] Sandy Ryza commented on YARN-1003: -- This makes it so that we don't need to use the

[jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726111#comment-13726111 ] Sandy Ryza commented on YARN-1003: -- My thinking was not per job. Agreed that the way to

[jira] [Updated] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1004: - Attachment: YARN-1004.patch yarn.scheduler.minimum|maximum|increment-allocation-mb should have

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726122#comment-13726122 ] Sandy Ryza commented on YARN-1004: -- Uploaded a patch that adds fair, capacity, and fifo to

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726124#comment-13726124 ] Sandy Ryza commented on YARN-1004: -- By which I mean [~tucu00]

[jira] [Commented] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726586#comment-13726586 ] Sandy Ryza commented on YARN-1003: -- bq. this can be done by being conservative on the

[jira] [Commented] (YARN-1009) Scheduler configuration properties should be prefixed with the scheduler type

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726590#comment-13726590 ] Sandy Ryza commented on YARN-1009: -- Is this a duplicate of YARN-1004?

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726595#comment-13726595 ] Sandy Ryza commented on YARN-972: - Meant: That's why I say (3) and (4) should be non-goals.

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726594#comment-13726594 ] Sandy Ryza commented on YARN-972: - bq. Determinism isn't something you can get with other

[jira] [Commented] (YARN-1010) FairScheduler: decouple container scheduling from nodemanager heartbeats

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726704#comment-13726704 ] Sandy Ryza commented on YARN-1010: -- Agreed that it would be a good change to include in

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-08-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726726#comment-13726726 ] Sandy Ryza commented on YARN-972: - Agreed that speculative containers will be an awesome

[jira] [Created] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1003: Summary: Add a maxContainersPerNode config to the Fair Scheduler Key: YARN-1003 URL: https://issues.apache.org/jira/browse/YARN-1003 Project: Hadoop YARN Issue

[jira] [Created] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1004: Summary: yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler Key: YARN-1004 URL: https://issues.apache.org/jira/browse/YARN-1004 Project: Hadoop

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725459#comment-13725459 ] Sandy Ryza commented on YARN-972: - [~ste...@apache.org], bq. Those caches are the key to

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725476#comment-13725476 ] Sandy Ryza commented on YARN-1004: -- [~hitesh], maximum-allocation is just for consistency.

[jira] [Commented] (YARN-1004) yarn.scheduler.minimum|maximum|increment-allocation-mb should have scheduler

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725522#comment-13725522 ] Sandy Ryza commented on YARN-1004: -- [~hitesh], your reasoning makes sense to me. I'll

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725837#comment-13725837 ] Sandy Ryza commented on YARN-972: - I should have probably tried to be more clear about what

[jira] [Commented] (YARN-758) TestRMRestart should use MockNMs with multiple cores

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725842#comment-13725842 ] Sandy Ryza commented on YARN-758: - There are likely a number of other tests that have

[jira] [Commented] (YARN-758) Augment MockNM to use multiple cores

2013-07-31 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726069#comment-13726069 ] Sandy Ryza commented on YARN-758: - +1 Augment MockNM to use multiple cores

[jira] [Commented] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724147#comment-13724147 ] Sandy Ryza commented on YARN-589: - Added a test. Expose a REST API for

[jira] [Updated] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-589: Attachment: YARN-589-1.patch Expose a REST API for monitoring the fair scheduler

[jira] [Commented] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724228#comment-13724228 ] Sandy Ryza commented on YARN-957: - I believe we fixed this for the Fair Scheduler in

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724585#comment-13724585 ] Sandy Ryza commented on YARN-353: - The patch looks good to me, other than the findbugs

[jira] [Commented] (YARN-948) RM should validate the release container list before actually releasing them

2013-07-26 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13721486#comment-13721486 ] Sandy Ryza commented on YARN-948: - +1 to InvalidContainerReleaseException

[jira] [Created] (YARN-973) yarn.application.classpath requires client to know service internals

2013-07-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-973: --- Summary: yarn.application.classpath requires client to know service internals Key: YARN-973 URL: https://issues.apache.org/jira/browse/YARN-973 Project: Hadoop YARN

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13719844#comment-13719844 ] Sandy Ryza commented on YARN-972: - [~t.st.clair], when you say the real scheduler you mean

[jira] [Commented] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13720052#comment-13720052 ] Sandy Ryza commented on YARN-972: - Ah, so if I understand correctly, you're saying that

[jira] [Created] (YARN-976) Document the meaning of a virtual core

2013-07-25 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-976: --- Summary: Document the meaning of a virtual core Key: YARN-976 URL: https://issues.apache.org/jira/browse/YARN-976 Project: Hadoop YARN Issue Type: Task

[jira] [Created] (YARN-969) Fair Scheduler should validate the release container list before actually releasing them

2013-07-24 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-969: --- Summary: Fair Scheduler should validate the release container list before actually releasing them Key: YARN-969 URL: https://issues.apache.org/jira/browse/YARN-969 Project:

[jira] [Commented] (YARN-932) TestResourceLocalizationService.testLocalizationInit can fail on JDK7

2013-07-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13718729#comment-13718729 ] Sandy Ryza commented on YARN-932: - Thanks Karthik. +1

[jira] [Commented] (YARN-969) Fair Scheduler should validate the release container list before actually releasing them

2013-07-24 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13718823#comment-13718823 ] Sandy Ryza commented on YARN-969: - [~ojoshi], makes sense to me. Fair

[jira] [Created] (YARN-972) Allow requests and scheduling for fractional virtual cores

2013-07-24 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-972: --- Summary: Allow requests and scheduling for fractional virtual cores Key: YARN-972 URL: https://issues.apache.org/jira/browse/YARN-972 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-701) ApplicationTokens should be used irrespective of kerberos

2013-07-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13716668#comment-13716668 ] Sandy Ryza commented on YARN-701: - I'm getting the following error in the AM when trying to

[jira] [Commented] (YARN-944) App failed with container launch failed even though container started

2013-07-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13716672#comment-13716672 ] Sandy Ryza commented on YARN-944: - I'm facing this as well. The error I'm getting on the AM

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13713812#comment-13713812 ] Sandy Ryza commented on YARN-905: - Thanks for working on this, [~ywskycn]. The patch mostly

[jira] [Created] (YARN-939) Rename ContainerManagerImpl to ContainerManagementImpl

2013-07-19 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-939: --- Summary: Rename ContainerManagerImpl to ContainerManagementImpl Key: YARN-939 URL: https://issues.apache.org/jira/browse/YARN-939 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-939) Rename ContainerManagerImpl to ContainerManagementImpl

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-939: Labels: newbie (was: ) Rename ContainerManagerImpl to ContainerManagementImpl

[jira] [Created] (YARN-942) In Fair Scheduler documentation, inconsistency on which properties have prefix

2013-07-19 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-942: --- Summary: In Fair Scheduler documentation, inconsistency on which properties have prefix Key: YARN-942 URL: https://issues.apache.org/jira/browse/YARN-942 Project: Hadoop YARN

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13713966#comment-13713966 ] Sandy Ryza commented on YARN-905: - +1 Add state filters to nodes CLI

[jira] [Updated] (YARN-589) Expose a REST API for monitoring the fair scheduler

2013-07-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-589: Attachment: YARN-589.patch Expose a REST API for monitoring the fair scheduler

<    4   5   6   7   8   9   10   11   12   13   >