[jira] [Commented] (YARN-1461) RM API and RM changes to handle tags for running jobs

[ https://issues.apache.org/jira/browse/YARN-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13859103#comment-13859103 ] Sandy Ryza commented on YARN-1461: -- +1 RM API and RM changes to handle tags for running

[jira] [Commented] (YARN-1550) the page http:/ip:50030/cluster/scheduler has 500 error fairScheduler

[ https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13858552#comment-13858552 ] Sandy Ryza commented on YARN-1550: -- Does anything suspicious show up in the

[jira] [Moved] (YARN-1550) the page http:/ip:50030/cluster/scheduler has 500 error fairScheduler

[ https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza moved MAPREDUCE-5701 to YARN-1550: - Component/s: (was: scheduler) scheduler

[jira] [Commented] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors

[ https://issues.apache.org/jira/browse/YARN-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13858101#comment-13858101 ] Sandy Ryza commented on YARN-1295: -- Hi Raymie. The release that was going to be called

[jira] [Commented] (YARN-1295) In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors

[ https://issues.apache.org/jira/browse/YARN-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13858254#comment-13858254 ] Sandy Ryza commented on YARN-1295: -- My understanding is that 2.2.1 isn't happening at all.

[jira] [Commented] (YARN-1481) Move internal services logic from AdminService to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13857611#comment-13857611 ] Sandy Ryza commented on YARN-1481: -- +1 to the addendum patch Move internal services

[jira] [Commented] (YARN-1493) Schedulers don't recognize apps separately from app-attempts

[ https://issues.apache.org/jira/browse/YARN-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13857702#comment-13857702 ] Sandy Ryza commented on YARN-1493: -- Thanks for clarifying about the FinalTransition, Jian.

[jira] [Commented] (YARN-1539) Queue admin ACLs should NOT be similar to submit-acls w.r.t hierarchy.

[ https://issues.apache.org/jira/browse/YARN-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13857050#comment-13857050 ] Sandy Ryza commented on YARN-1539: -- My understanding was that the way that both submit and

[jira] [Commented] (YARN-1539) Queue admin ACLs should NOT be similar to submit-acls w.r.t hierarchy.

[ https://issues.apache.org/jira/browse/YARN-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13857074#comment-13857074 ] Sandy Ryza commented on YARN-1539: -- The code I posted above is from the Capacity

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13854588#comment-13854588 ] Sandy Ryza commented on YARN-1028: -- +1 to the addendum patch Add FailoverProxyProvider

[jira] [Commented] (YARN-321) Generic application history service

[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13853439#comment-13853439 ] Sandy Ryza commented on YARN-321: - Thanks Vinod for the design doc. A few additional

[jira] [Commented] (YARN-1287) Consolidate MockClocks

[ https://issues.apache.org/jira/browse/YARN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851958#comment-13851958 ] Sandy Ryza commented on YARN-1287: -- Actually just noticed - the MockClock class should go

[jira] [Commented] (YARN-1287) Consolidate MockClocks

[ https://issues.apache.org/jira/browse/YARN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851955#comment-13851955 ] Sandy Ryza commented on YARN-1287: -- +1 Consolidate MockClocks --

[jira] [Commented] (YARN-1493) Schedulers don't recognize apps separately from app-attempts

[ https://issues.apache.org/jira/browse/YARN-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850929#comment-13850929 ] Sandy Ryza commented on YARN-1493: -- Thanks Jian. A question and some stylistic issues.

[jira] [Commented] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850955#comment-13850955 ] Sandy Ryza commented on YARN-1414: -- Thanks for finding this Siqi. This will fix the issue

[jira] [Commented] (YARN-1493) Schedulers don't recognize apps separately from app-attempts

[ https://issues.apache.org/jira/browse/YARN-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851069#comment-13851069 ] Sandy Ryza commented on YARN-1493: -- I took another look at the patch and noticed something

[jira] [Commented] (YARN-1448) AM-RM protocol changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13849430#comment-13849430 ] Sandy Ryza commented on YARN-1448: -- This was only for the protocol additions. We will

[jira] [Commented] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13849442#comment-13849442 ] Sandy Ryza commented on YARN-1445: -- In yarn_protos, we shouldn't change the numbers on the

[jira] [Commented] (YARN-1493) Schedulers don't recognize apps separately from app-attempts

[ https://issues.apache.org/jira/browse/YARN-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13849638#comment-13849638 ] Sandy Ryza commented on YARN-1493: -- Before this, could the scheduler ever be running two

[jira] [Commented] (YARN-1493) Schedulers don't recognize apps separately from app-attempts

[ https://issues.apache.org/jira/browse/YARN-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13849761#comment-13849761 ] Sandy Ryza commented on YARN-1493: -- Thanks for clarifying Jian. bq. will rename this to

[jira] [Updated] (YARN-1451) TestResourceManager relies on the capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1451: - Attachment: YARN-1451-1.patch TestResourceManager relies on the capacity scheduler

[jira] [Updated] (YARN-1451) TestResourceManager relies on the capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1451: - Summary: TestResourceManager relies on the capacity scheduler (was: A couple tests rely on the capacity

[jira] [Updated] (YARN-1451) TestResourceManager relies on the capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1451: - Description: TestResourceManager rely on the capacity scheduler. For TestNetworkedJob, the queue name

[jira] [Updated] (YARN-1451) TestResourceManager relies on the capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1451: - Description: TestResourceManager rely on the capacity scheduler. It relies on a scheduler that assigns

[jira] [Updated] (YARN-1451) TestResourceManager relies on the capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1451: - Attachment: YARN-1451.patch TestResourceManager relies on the capacity scheduler

[jira] [Commented] (YARN-1495) Allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13848006#comment-13848006 ] Sandy Ryza commented on YARN-1495: -- bq. We have to touch RMApp etc before hitting

[jira] [Commented] (YARN-1459) Handle supergroups, usergroups and ACLs across RMs during failover

[ https://issues.apache.org/jira/browse/YARN-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13848098#comment-13848098 ] Sandy Ryza commented on YARN-1459: -- bq. We can create a configuration folder in hdfs, set

[jira] [Updated] (YARN-1498) RM changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1498: - Attachment: YARN-1498.patch RM changes for moving apps between queues

[jira] [Commented] (YARN-1415) In scheduler UI, including used memory in Memory Total seems to be inaccurate

[ https://issues.apache.org/jira/browse/YARN-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846951#comment-13846951 ] Sandy Ryza commented on YARN-1415: -- Currently, all the schedulers interpret available MB

[jira] [Commented] (YARN-1495) Allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13847108#comment-13847108 ] Sandy Ryza commented on YARN-1495: -- Thanks for taking a look Vinod. bq. Any specific

[jira] [Updated] (YARN-1498) Common scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1498: - Attachment: YARN-1498-1.patch Common scheduler changes for moving apps between queues

[jira] [Updated] (YARN-1498) Common scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1498: - Summary: Common scheduler changes for moving apps between queues (was: RM changes for moving apps

[jira] [Updated] (YARN-1498) Common scheduler changes for moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1498: - Description: This JIRA is to track changes that aren't in particular schedulers but that help them

[jira] [Commented] (YARN-1495) Allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13847134#comment-13847134 ] Sandy Ryza commented on YARN-1495: -- Also, a coding question you can maybe provide me

[jira] [Resolved] (YARN-247) Fair scheduler should support assigning queues by user group

[ https://issues.apache.org/jira/browse/YARN-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-247. - Resolution: Duplicate Fair scheduler should support assigning queues by user group

[jira] [Commented] (YARN-1404) Enable external systems/frameworks to share resources with Hadoop leveraging Yarn resource scheduling

[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845261#comment-13845261 ] Sandy Ryza commented on YARN-1404: -- bq. Other than saying you don't want to wait for

[jira] [Assigned] (YARN-1496) Protocol additions to allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1496: Assignee: Sandy Ryza Protocol additions to allow moving apps between queues

[jira] [Updated] (YARN-1496) Protocol additions to allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1496: - Attachment: YARN-1496.patch Protocol additions to allow moving apps between queues

[jira] [Commented] (YARN-1496) Protocol additions to allow moving apps between queues

[ https://issues.apache.org/jira/browse/YARN-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845706#comment-13845706 ] Sandy Ryza commented on YARN-1496: -- Here's a patch with a sketch of the protocol changes.

[jira] [Created] (YARN-1498) RM changes for moving apps between queues

Sandy Ryza created YARN-1498: Summary: RM changes for moving apps between queues Key: YARN-1498 URL: https://issues.apache.org/jira/browse/YARN-1498 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-1499) Fair Scheduler changes for moving apps between queues

Sandy Ryza created YARN-1499: Summary: Fair Scheduler changes for moving apps between queues Key: YARN-1499 URL: https://issues.apache.org/jira/browse/YARN-1499 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-1497) Expose moving apps between queues on the command line

Sandy Ryza created YARN-1497: Summary: Expose moving apps between queues on the command line Key: YARN-1497 URL: https://issues.apache.org/jira/browse/YARN-1497 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845982#comment-13845982 ] Sandy Ryza commented on YARN-1197: -- bq. Seems like the control flow is asymetrical for

[jira] [Created] (YARN-1501) Fair Scheduler will NPE if it hits IOException on queue assignment

Sandy Ryza created YARN-1501: Summary: Fair Scheduler will NPE if it hits IOException on queue assignment Key: YARN-1501 URL: https://issues.apache.org/jira/browse/YARN-1501 Project: Hadoop YARN

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846064#comment-13846064 ] Sandy Ryza commented on YARN-1197: -- Wanted to post some thoughts on this vs. YARN-1488.

[jira] [Commented] (YARN-1404) Enable external systems/frameworks to share resources with Hadoop leveraging Yarn resource scheduling

[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13844740#comment-13844740 ] Sandy Ryza commented on YARN-1404: -- Arun, I think I agree with most of the above and your

[jira] [Commented] (YARN-1404) Enable external systems/frameworks to share resources with Hadoop leveraging Yarn resource scheduling

[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13844954#comment-13844954 ] Sandy Ryza commented on YARN-1404: -- bq. The thing is to enable only central scheduling,

[jira] [Commented] (YARN-1448) Protocol changes in RM side to support change container resources

[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842975#comment-13842975 ] Sandy Ryza commented on YARN-1448: -- +1 Protocol changes in RM side to support change

[jira] [Updated] (YARN-1448) Protocol changes in RM side to support changING container resources

[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1448: - Summary: Protocol changes in RM side to support changING container resources (was: Protocol changes in

[jira] [Updated] (YARN-1448) Protocol changes in RM side to support changing container resources

[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1448: - Summary: Protocol changes in RM side to support changing container resources (was: Protocol changes in

[jira] [Updated] (YARN-1448) AM-RM protocol changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1448: - Summary: AM-RM protocol changes to support container resizing (was: Protocol changes in RM side to

[jira] [Commented] (YARN-1449) Protocol changes and implementations in NM side to support change container resource

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13843375#comment-13843375 ] Sandy Ryza commented on YARN-1449: -- Can you do annotations in the same way that was done

[jira] [Commented] (YARN-1448) Protocol changes in RM side to support change container resources

[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842382#comment-13842382 ] Sandy Ryza commented on YARN-1448: -- The patch overall looks good to me, just a few nits:

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841873#comment-13841873 ] Sandy Ryza commented on YARN-807: - Thanks Karthik, will commit this tomorrow if there are no

[jira] [Commented] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI list command

[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841872#comment-13841872 ] Sandy Ryza commented on YARN-1480: -- I think it definitely make sense to add the missing

[jira] [Commented] (YARN-1470) Add audience annotation to MiniYARNCluster

[ https://issues.apache.org/jira/browse/YARN-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840275#comment-13840275 ] Sandy Ryza commented on YARN-1470: -- Agreed it's essential. My inclination would be to

[jira] [Updated] (YARN-546) mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-546: Attachment: YARN-546-1.patch mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

[jira] [Updated] (YARN-1447) Common PB type definitions for container resizing

[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1447: - Summary: Common PB type definitions for container resizing (was: Common PB types define for container

[jira] [Updated] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-807: Attachment: YARN-807-3.patch When querying apps by queue, iterating over all apps is inefficient and

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13840789#comment-13840789 ] Sandy Ryza commented on YARN-807: - Attached a patch that addresses Karthik's comments When

[jira] [Updated] (YARN-546) Allow disabling the Fair Scheduler event log

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-546: Summary: Allow disabling the Fair Scheduler event log (was: mapred.fairscheduler.eventlog.enabled removed

[jira] [Updated] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-807: Attachment: YARN-807-4.patch Attaching patch that fixes test When querying apps by queue, iterating over

[jira] [Updated] (YARN-546) mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-546: Attachment: YARN-546.patch mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

[jira] [Commented] (YARN-546) mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839176#comment-13839176 ] Sandy Ryza commented on YARN-546: - Thought about this again and I think the option is better

[jira] [Commented] (YARN-1181) Augment MiniYARNCluster to support HA mode

[ https://issues.apache.org/jira/browse/YARN-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839519#comment-13839519 ] Sandy Ryza commented on YARN-1181: -- +1 Augment MiniYARNCluster to support HA mode

[jira] [Commented] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839523#comment-13839523 ] Sandy Ryza commented on YARN-1403: -- Thanks for the review. Attaching a patch that makes

[jira] [Updated] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1403: - Attachment: YARN-1403-4.patch Separate out configuration loading from QueueManager in the Fair Scheduler

[jira] [Updated] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1403: - Attachment: YARN-1403-5.patch Separate out configuration loading from QueueManager in the Fair Scheduler

[jira] [Created] (YARN-1474) Make schedulers services

Sandy Ryza created YARN-1474: Summary: Make schedulers services Key: YARN-1474 URL: https://issues.apache.org/jira/browse/YARN-1474 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839678#comment-13839678 ] Sandy Ryza commented on YARN-1403: -- Filed https://issues.apache.org/jira/browse/YARN-1474

[jira] [Commented] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839762#comment-13839762 ] Sandy Ryza commented on YARN-1403: -- I just committed this. Thanks Tucu for reviewing.

[jira] [Resolved] (YARN-1475) Container out of memery

[ https://issues.apache.org/jira/browse/YARN-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1475. -- Resolution: Invalid The place to start with an issue like this is the Hadoop user list. If it turns

[jira] [Resolved] (YARN-1476) Container out of memery

[ https://issues.apache.org/jira/browse/YARN-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1476. -- Resolution: Duplicate Container out of memery --- Key:

[jira] [Commented] (YARN-1447) Common PB types define for container resource change

[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837492#comment-13837492 ] Sandy Ryza commented on YARN-1447: -- Thanks Wangda. The proto definitions look good to me

[jira] [Commented] (YARN-1447) Common PB types define for container resource change

[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13838130#comment-13838130 ] Sandy Ryza commented on YARN-1447: -- +1 after findbugs fixes Common PB types define for

[jira] [Created] (YARN-1470) Add audience annotation to MiniYARNCluster

Sandy Ryza created YARN-1470: Summary: Add audience annotation to MiniYARNCluster Key: YARN-1470 URL: https://issues.apache.org/jira/browse/YARN-1470 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1287) Consolidate MockClocks

[ https://issues.apache.org/jira/browse/YARN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13838270#comment-13838270 ] Sandy Ryza commented on YARN-1287: -- It should be placed in the corresponding test

[jira] [Commented] (YARN-1181) Augment MiniYARNCluster to support HA mode

[ https://issues.apache.org/jira/browse/YARN-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13838293#comment-13838293 ] Sandy Ryza commented on YARN-1181: -- Just a few stylistic comments. {code} +if

[jira] [Commented] (YARN-1458) hadoop2.2.0 fairscheduler ResourceManager Event Processor thread blocked

[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836747#comment-13836747 ] Sandy Ryza commented on YARN-1458: -- If size based weight is turned on and an app has 0

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1458: - Summary: In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely (was:

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1458: - Description: The ResourceManager$SchedulerEventDispatcher$EventProcessor blocked when clients submit

[jira] [Commented] (YARN-1458) hadoop2.2.0 fairscheduler ResourceManager Event Processor thread blocked

[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836103#comment-13836103 ] Sandy Ryza commented on YARN-1458: -- Thanks for tracking this down. That makes a lot of

[jira] [Commented] (YARN-1458) hadoop2.2.0 fairscheduler ResourceManager Event Processor thread blocked

[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836326#comment-13836326 ] Sandy Ryza commented on YARN-1458: -- Cool, in that case I think I understand the problem.

[jira] [Updated] (YARN-1403) Separate out configuration loading from QueueManager in the Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1403: - Attachment: YARN-1403-3.patch Rebased after YARN-1241 Separate out configuration loading from

[jira] [Commented] (YARN-1458) hadoop2.2.0 fairscheduler ResourceManager Event Processor thread blocked

[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835280#comment-13835280 ] Sandy Ryza commented on YARN-1458: -- In the jstack, the Fair Scheduler update thread, which

[jira] [Commented] (YARN-1447) Common PB types define for container resource change

[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835504#comment-13835504 ] Sandy Ryza commented on YARN-1447: -- bq. And I think for AM-NM increase, we don't need

[jira] [Commented] (YARN-1458) hadoop2.2.0 fairscheduler ResourceManager Event Processor thread blocked

[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835505#comment-13835505 ] Sandy Ryza commented on YARN-1458: -- About how many apps are running / submitted when this

[jira] [Updated] (YARN-1241) In Fair Scheduler, maxRunningApps does not work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Summary: In Fair Scheduler, maxRunningApps does not work for non-leaf queues (was: In Fair Scheduler

[jira] [Assigned] (YARN-1241) In Fair Scheduler, maxRunningApps does not work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1241: Assignee: Sandy Ryza (was: Karthik Kambatla) In Fair Scheduler, maxRunningApps does not work for

[jira] [Commented] (YARN-1332) In TestAMRMClient, replace assertTrue with assertEquals where possible

[ https://issues.apache.org/jira/browse/YARN-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834992#comment-13834992 ] Sandy Ryza commented on YARN-1332: -- +1 In TestAMRMClient, replace assertTrue with

[jira] [Reopened] (YARN-546) mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reopened YARN-546: - Assignee: Sandy Ryza I've spoken to a few people that still see the event log as valuable. Independent

[jira] [Commented] (YARN-546) mapred.fairscheduler.eventlog.enabled removed from Hadoop 2.0

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834999#comment-13834999 ] Sandy Ryza commented on YARN-546: - *off and on at runtime

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835008#comment-13835008 ] Sandy Ryza commented on YARN-1241: -- Test failure is unrelated In Fair Scheduler

[jira] [Commented] (YARN-1447) Common PB types define for container resource change

[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835037#comment-13835037 ] Sandy Ryza commented on YARN-1447: -- Thanks Wangda. Some comments: The new files are

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834454#comment-13834454 ] Sandy Ryza commented on YARN-1241: -- *to verify In Fair Scheduler maxRunningApps does not

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: YARN-1241-11.patch Attached a patch that addresses latest comments. Regarding the

[jira] [Updated] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1241: - Attachment: (was: YARN-1241-11.patch) In Fair Scheduler maxRunningApps does not work for non-leaf

[jira] [Updated] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-807: Attachment: YARN-807-2.patch Rebased patch When querying apps by queue, iterating over all apps is

[jira] [Created] (YARN-1451) A couple tests rely on the capacity scheduler

Sandy Ryza created YARN-1451: Summary: A couple tests rely on the capacity scheduler Key: YARN-1451 URL: https://issues.apache.org/jira/browse/YARN-1451 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-1451) A couple tests rely on the capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1451: - Description: TestNetworkedJob and TestResourceManager rely on the capacity scheduler. For

<    1   2   3   4   5   6   7   8   9   10   >