[jira] [Updated] (YARN-795) Fair scheduler root queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Description: The root queue metrics of fair scheduler doesn't subtract allocated vCores from available vCores,

[jira] [Created] (YARN-795) Fair scheduler root queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
Wei Yan created YARN-795: Summary: Fair scheduler root queue metrics should subtract allocated vCores from available vCores Key: YARN-795 URL: https://issues.apache.org/jira/browse/YARN-795 Project: Hadoop

[jira] [Updated] (YARN-795) Fair scheduler root queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Description: The root queue metrics of fair scheduler doesn't subtract allocated vCores from available vCores,

[jira] [Updated] (YARN-795) Fair scheduler root queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Description: The root queue metrics of fair scheduler doesn't subtract allocated vCores from available vCores,

[jira] [Updated] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Summary: Fair scheduler queue metrics should subtract allocated vCores from available vCores (was: Fair scheduler

[jira] [Updated] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Description: The queue metrics of fair scheduler doesn't subtract allocated vCores from available vCores, causing

[jira] [Updated] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Attachment: YARN-795.patch Uploaded patch that subtracts allocated vcores from available vcores in QueueMetrics.

[jira] [Created] (YARN-866) Add test for class ResourceWeights

2013-06-20 Thread Wei Yan (JIRA)
Wei Yan created YARN-866: Summary: Add test for class ResourceWeights Key: YARN-866 URL: https://issues.apache.org/jira/browse/YARN-866 Project: Hadoop YARN Issue Type: Test Affects Versions:

[jira] [Updated] (YARN-866) Add test for class ResourceWeights

2013-06-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-866: - Attachment: Yarn-866.patch pacth for testing ResourceWeights. Add test for class ResourceWeights

[jira] [Updated] (YARN-866) Add test for class ResourceWeights

2013-06-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-866: - Attachment: Yarn-866.patch Thansk, Sandy. Attached the new patch. Add test for class

[jira] [Updated] (YARN-866) Add test for class ResourceWeights

2013-06-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-866: - Attachment: (was: Yarn-866.patch) Add test for class ResourceWeights --

[jira] [Updated] (YARN-866) Add test for class ResourceWeights

2013-06-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-866: - Attachment: Yarn-866.patch Add test for class ResourceWeights --

[jira] [Updated] (YARN-866) Add test for class ResourceWeights

2013-06-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-866: - Attachment: YARN-866.patch Add test for class ResourceWeights --

[jira] [Commented] (YARN-866) Add test for class ResourceWeights

2013-06-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13689896#comment-13689896 ] Wei Yan commented on YARN-866: -- Thanks, Karthik. Update the patch with assert messages.

[jira] [Updated] (YARN-461) Fair scheduler accepts apps with empty string names and queues

2013-06-27 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-461: - Attachment: YARN-461.patch Uploaded a patch to throw an exception when the submited app has an empty application

[jira] [Updated] (YARN-461) Fair scheduler accepts apps with empty string names and queues

2013-06-27 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-461: - Attachment: YARN-461.patch Added default name for other coreTests without a default name. Fair

[jira] [Commented] (YARN-461) Fair scheduler accepts apps with empty string names and queues

2013-06-28 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13695679#comment-13695679 ] Wei Yan commented on YARN-461: -- Got it. I'll update the patch. Fair scheduler

[jira] [Assigned] (YARN-905) Add state filters to nodes CLI

2013-07-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned YARN-905: Assignee: Wei Yan Add state filters to nodes CLI -- Key:

[jira] [Updated] (YARN-905) Add state filters to nodes CLI

2013-07-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-905: - Attachment: YARN-905.patch [~sandyr] Attaching patch adds state filters to node CLI, following approach in

[jira] [Updated] (YARN-905) Add state filters to nodes CLI

2013-07-19 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-905: - Attachment: Yarn-905.patch Thanks, [~sandyr]. Upload a patch to fix the comments. Here are the commands

[jira] [Updated] (YARN-461) Fair scheduler accepts apps with empty string names and queues

2013-07-19 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-461: - Attachment: YARN-461.patch Reject application with empty queue name in FairScheduler, as CapacityScheduler does.

[jira] [Created] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-03 Thread Wei Yan (JIRA)
Wei Yan created YARN-1021: - Summary: Yarn Scheduler Load Simulator Key: YARN-1021 URL: https://issues.apache.org/jira/browse/YARN-1021 Project: Hadoop YARN Issue Type: New Feature

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-05 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Description: The Yarn Scheduler is a fertile area of interest with different implementations, e.g., Fifo,

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021-images.tar.gz YARN-1021-demo.tar.gz YARN-1021.pdf

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Description: The Yarn Scheduler is a fertile area of interest with different implementations, e.g., Fifo,

[jira] [Assigned] (YARN-1010) FairScheduler: decouple container scheduling from nodemanager heartbeats

2013-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned YARN-1010: - Assignee: Wei Yan (was: Alejandro Abdelnur) FairScheduler: decouple container scheduling from

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: (was: YARN-1021-demo.tar.gz) Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021-demo.tar.gz Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Update a patch to remove javac findbugs warnings. As the simulator uses jquery.js

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch New patch for excluding license checks for d3.js and jquery.js.

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021-demo.tar.gz YARN-1021.pdf Update patch and documents according to

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-09 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.pdf Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-09 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: (was: YARN-1021.pdf) Yarn Scheduler Load Simulator -

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13738556#comment-13738556 ] Wei Yan commented on YARN-1021: --- Updates of the patch: Reduce the number of threads needed

[jira] [Updated] (YARN-905) Add state filters to nodes CLI

2013-08-19 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-905: - Attachment: YARN-905.patch retrigger the QA server Add state filters to nodes CLI

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

2013-08-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13745799#comment-13745799 ] Wei Yan commented on YARN-1021: --- [~curino] Thanks for your further comments. bq. I might

[jira] [Assigned] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-23 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned YARN-1008: - Assignee: Wei Yan (was: Alejandro Abdelnur) MiniYARNCluster with multiple nodemanagers, all nodes

[jira] [Updated] (YARN-1008) MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations

2013-08-23 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1008: -- Assignee: Alejandro Abdelnur (was: Wei Yan) MiniYARNCluster with multiple nodemanagers, all nodes have

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-08-23 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13749130#comment-13749130 ] Wei Yan commented on YARN-905: -- Sure, will update a patch later to fix the all/ALL and the user

[jira] [Created] (YARN-1126) Add validation of users input nodes-states options to nodes CLI

2013-08-29 Thread Wei Yan (JIRA)
Wei Yan created YARN-1126: - Summary: Add validation of users input nodes-states options to nodes CLI Key: YARN-1126 URL: https://issues.apache.org/jira/browse/YARN-1126 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-08-29 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754362#comment-13754362 ] Wei Yan commented on YARN-905: -- [~vinodkv][~sandyr] YARN-1126 is created. Add

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-12 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-12 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: (was: YARN-1021.pdf) Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-12 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.pdf Yarn Scheduler Load Simulator -

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-12 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765772#comment-13765772 ] Wei Yan commented on YARN-1021: --- Update a new patch according to [~curino]'s comments. Main

[jira] [Created] (YARN-1186) Add support for simulating several important behaviors in the MRAM to yarn scheduler simulator

2013-09-13 Thread Wei Yan (JIRA)
Wei Yan created YARN-1186: - Summary: Add support for simulating several important behaviors in the MRAM to yarn scheduler simulator Key: YARN-1186 URL: https://issues.apache.org/jira/browse/YARN-1186

[jira] [Created] (YARN-1187) Add discrete event-based simulation to yarn scheduler simulator

2013-09-13 Thread Wei Yan (JIRA)
Wei Yan created YARN-1187: - Summary: Add discrete event-based simulation to yarn scheduler simulator Key: YARN-1187 URL: https://issues.apache.org/jira/browse/YARN-1187 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-09-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765778#comment-13765778 ] Wei Yan commented on YARN-905: -- [~sandyr], [~vinodkv] Confused last time. I'll close YARN-1126

[jira] [Updated] (YARN-905) Add state filters to nodes CLI

2013-09-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-905: - Attachment: YARN-905-addendum.patch Add state filters to nodes CLI --

[jira] [Updated] (YARN-905) Add state filters to nodes CLI

2013-09-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-905: - Attachment: YARN-905-addendum.patch Update an addendum patch that fixs case-ignored all and invalid input

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-18 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-18 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-18 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.pdf Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: (was: YARN-1021.pdf) Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13776364#comment-13776364 ] Wei Yan commented on YARN-1021: --- Update a new patch according to [~tucu00]'s latest comments.

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: (was: YARN-1021.pdf) Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

2013-09-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.pdf Yarn Scheduler Load Simulator -

[jira] [Commented] (YARN-2252) Intermittent failure for testcase TestFairScheduler.testContinuousScheduling

2014-07-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063846#comment-14063846 ] Wei Yan commented on YARN-2252: --- [~rdsr], sorry for later reply. the patch looks good to me.

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2014-07-17 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065170#comment-14065170 ] Wei Yan commented on YARN-2306: --- Thanks, [~zhiguohong], the patch looks good to me. leak of

[jira] [Updated] (YARN-810) Support CGroup ceiling enforcement on CPU

2014-07-18 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-810: - Attachment: YARN-810.patch Upload a patch for review. (1) Add a configuration field cpu_enforce_ceiling_enabled to

[jira] [Updated] (YARN-810) Support CGroup ceiling enforcement on CPU

2014-07-18 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-810: - Attachment: YARN-810.patch Support CGroup ceiling enforcement on CPU -

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-18 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273-replayException.patch [~kasha], uploaded the testcase used before. NPE in

[jira] [Commented] (YARN-2323) FairShareComparator creates too much Resource object

2014-07-19 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067744#comment-14067744 ] Wei Yan commented on YARN-2323: --- Good catch, [~zhiguohong]. Thanks, LGTM.

[jira] [Commented] (YARN-2324) Race condition in continuousScheduling for FairScheduler

2014-07-20 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067821#comment-14067821 ] Wei Yan commented on YARN-2324: --- duplicate of YARN-2273? Race condition in

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068684#comment-14068684 ] Wei Yan commented on YARN-2273: --- [~kasha], [~ozawa], will update a patch soon. NPE in

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273.patch NPE in ContinuousScheduling Thread crippled RM after DN flap

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273.patch Thanks, [~kasha], update a new patch to address the comments. NPE in

[jira] [Updated] (YARN-1726) ResourceSchedulerWrapper failed due to the AbstractYarnScheduler introduced in YARN-1041

2014-07-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1726: -- Attachment: YARN-1726-5.patch Rebase the patch. ResourceSchedulerWrapper failed due to the

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273-5.patch new patch adds return in the continuous scheduling thread. NPE in

[jira] [Created] (YARN-2335) Annotate all hadoop-sls APIs as @Private

2014-07-22 Thread Wei Yan (JIRA)
Wei Yan created YARN-2335: - Summary: Annotate all hadoop-sls APIs as @Private Key: YARN-2335 URL: https://issues.apache.org/jira/browse/YARN-2335 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-2335) Annotate all hadoop-sls APIs as @Private

2014-07-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2335: -- Attachment: YARN-2335-1.patch Annotate all hadoop-sls APIs as @Private

[jira] [Updated] (YARN-2335) Annotate all hadoop-sls APIs as @Private

2014-07-25 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2335: -- Attachment: YARN-2335-1.branch2.patch update patch for branch-2 Annotate all hadoop-sls APIs as @Private

[jira] [Updated] (YARN-1726) ResourceSchedulerWrapper failed due to the AbstractYarnScheduler introduced in YARN-1041

2014-07-25 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1726: -- Attachment: YARN-1726-6.patch rebase the patch after YARN-2335. May not work with branch-2, will update a

[jira] [Updated] (YARN-1726) ResourceSchedulerWrapper failed due to the AbstractYarnScheduler introduced in YARN-1041

2014-07-25 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1726: -- Attachment: YARN-1726-6-branch2.patch update a patch for branch2 ResourceSchedulerWrapper failed due to the

[jira] [Updated] (YARN-1726) ResourceSchedulerWrapper failed due to the AbstractYarnScheduler introduced in YARN-1041

2014-07-25 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1726: -- Attachment: YARN-1726-7.patch Update a patch to fix the comments. ResourceSchedulerWrapper failed due to the

[jira] [Updated] (YARN-1726) ResourceSchedulerWrapper broken due to AbstractYarnScheduler

2014-07-25 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1726: -- Attachment: YARN-1726-7-branch2.patch update a patch for branch-2. ResourceSchedulerWrapper broken due to

[jira] [Commented] (YARN-2380) The normalizeRequests method in SchedulerUtils always resets the vCore to 1

2014-08-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083171#comment-14083171 ] Wei Yan commented on YARN-2380: --- [~john.jian.fang], maybe you can try FairScheduler which

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

2014-08-04 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084797#comment-14084797 ] Wei Yan commented on YARN-1021: --- [~Jackliu91], yes, the simulator has exception in

[jira] [Updated] (YARN-2381) CLONE - Yarn Scheduler Load Simulator

2014-08-04 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2381: -- Assignee: (was: Wei Yan) CLONE - Yarn Scheduler Load Simulator -

[jira] [Commented] (YARN-2381) CLONE - Yarn Scheduler Load Simulator

2014-08-04 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084804#comment-14084804 ] Wei Yan commented on YARN-2381: --- [~Jackliu91], purpose of this jira? CLONE - Yarn Scheduler

[jira] [Commented] (YARN-2382) Resource Manager throws InvalidStateTransitonException

2014-08-05 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086714#comment-14086714 ] Wei Yan commented on YARN-2382: --- Hi, [~nishan], could u share more configuration info? I

[jira] [Commented] (YARN-2382) Resource Manager throws InvalidStateTransitonException

2014-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087543#comment-14087543 ] Wei Yan commented on YARN-2382: --- thanks, [~nishan], that's enough information. Resource

[jira] [Commented] (YARN-2381) aa

2014-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087549#comment-14087549 ] Wei Yan commented on YARN-2381: --- Never mind, [~Jackliu91]. aa -- Key:

[jira] [Commented] (YARN-1177) Support automatic failover using ZKFC

2014-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087869#comment-14087869 ] Wei Yan commented on YARN-1177: --- hey, [~kasha], I'm interested in taking it. could you assign

[jira] [Commented] (YARN-2385) Adding support for listing all applications in a queue

2014-08-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089628#comment-14089628 ] Wei Yan commented on YARN-2385: --- The YarnScheduler.java already has a function which has

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement static fair share

2014-08-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091152#comment-14091152 ] Wei Yan commented on YARN-2393: --- Hey, [~ashwinshankar77], would u mind if I take this one?

[jira] [Assigned] (YARN-2393) Fair Scheduler : Implement static fair share

2014-08-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned YARN-2393: - Assignee: Wei Yan Fair Scheduler : Implement static fair share

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement static fair share

2014-08-11 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093222#comment-14093222 ] Wei Yan commented on YARN-2393: --- [~ashwinshankar77], thanks for the comment. Will check that.

[jira] [Updated] (YARN-2393) Fair Scheduler : Implement static fair share

2014-08-12 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2393: -- Attachment: YARN-2393-2.patch Update a patch which address Ashwin's comment: recompute share when new queue

[jira] [Updated] (YARN-2393) Fair Scheduler : Implement static fair share

2014-08-14 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2393: -- Attachment: YARN-2393-3.patch Rebase a new patch. [~kasha], for the reloading, if we want only update queues

[jira] [Created] (YARN-2420) Fair Scheduler: change yarn.scheduler.fair.assignmultiple from boolean to integer

2014-08-14 Thread Wei Yan (JIRA)
Wei Yan created YARN-2420: - Summary: Fair Scheduler: change yarn.scheduler.fair.assignmultiple from boolean to integer Key: YARN-2420 URL: https://issues.apache.org/jira/browse/YARN-2420 Project: Hadoop YARN

[jira] [Commented] (YARN-2420) Fair Scheduler: change yarn.scheduler.fair.assignmultiple from boolean to integer

2014-08-14 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097941#comment-14097941 ] Wei Yan commented on YARN-2420: --- yes, my mistake. Just saw the max.assign field. I'll change

[jira] [Updated] (YARN-2420) Fair Scheduler: dynamically update yarn.scheduler.fair.max.assign based on cluster load

2014-08-14 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2420: -- Summary: Fair Scheduler: dynamically update yarn.scheduler.fair.max.assign based on cluster load (was: Fair

[jira] [Commented] (YARN-2420) Fair Scheduler: dynamically update yarn.scheduler.fair.max.assign based on cluster load

2014-08-14 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097965#comment-14097965 ] Wei Yan commented on YARN-2420: --- For continuous scheduling, yes, we don't need maxAttempt,

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement static fair share

2014-08-15 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099328#comment-14099328 ] Wei Yan commented on YARN-2393: --- Thanks for the comments, [~ashwinshankar77]. For the

  1   2   3   4   5   >