[jira] [Commented] (YARN-5479) FairScheduler: Scheduling performance improvement

[ https://issues.apache.org/jira/browse/YARN-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415975#comment-15415975 ] Ray Chiang commented on YARN-5479: -- Sorry for the delay in replying. YARN-5047 has the lead-in

[jira] [Updated] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.009.patch - Rebased after YARN-4091 and YARN-5495 merges. > Refactor nodeUpdate

[jira] [Commented] (YARN-5495) Remove import wildcard in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415877#comment-15415877 ] Ray Chiang commented on YARN-5495: -- Thanks [~Naganarasimha]! I got a bit sidetracked yesterday. > Remove

[jira] [Commented] (YARN-5495) Remove import wildcard in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414478#comment-15414478 ] Ray Chiang commented on YARN-5495: -- RE: unit test failure Unit test passes in my tree. May or not be

[jira] [Commented] (YARN-5495) Remove import wildcard in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414449#comment-15414449 ] Ray Chiang commented on YARN-5495: -- Not a problem. I just wanted to check. Thanks for the quick reply.

[jira] [Updated] (YARN-5495) Remove import wildcard in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5495: - Summary: Remove import wildcard in CapacityScheduler (was: Clean up imports in CapacityScheduler) >

[jira] [Commented] (YARN-5495) Clean up imports in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414375#comment-15414375 ] Ray Chiang commented on YARN-5495: -- [~leftnoteasy], it looks like this happened (presumably due to an IDE

[jira] [Updated] (YARN-5495) Clean up imports in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5495: - Attachment: YARN-5495.001.patch Replace wildcard with individual imports again. > Clean up imports in

[jira] [Created] (YARN-5495) Clean up imports in CapacityScheduler

Ray Chiang created YARN-5495: Summary: Clean up imports in CapacityScheduler Key: YARN-5495 URL: https://issues.apache.org/jira/browse/YARN-5495 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable in NodeManager

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412392#comment-15412392 ] Ray Chiang commented on YARN-5137: -- Thanks [~vvasudev] for your help on YARN-5444. I look forward to

[jira] [Commented] (YARN-5479) FairScheduler: Scheduling performance improvement

[ https://issues.apache.org/jira/browse/YARN-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411121#comment-15411121 ] Ray Chiang commented on YARN-5479: -- What you have in mind sounds interesting. I'd have to look at parts

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable in NodeManager

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394456#comment-15394456 ] Ray Chiang commented on YARN-5137: -- Yeah, I think the fix to LinuxContainerExecutor and

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable in NodeManager

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392593#comment-15392593 ] Ray Chiang commented on YARN-5137: -- Another minor nit. In the constructor for ContainerLocalizer, it

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389905#comment-15389905 ] Ray Chiang commented on YARN-5047: -- RE: checkstyle Same protected variable warning as before. >

[jira] [Updated] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.008.patch Not sure what happened, but versions 006 and 007 of the patch ended up

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable in NodeManager

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388239#comment-15388239 ] Ray Chiang commented on YARN-5137: -- * In DirectoryCollection and ResourceLocalizationService, I recommend

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383067#comment-15383067 ] Ray Chiang commented on YARN-5047: -- RE: checkstyle Same issue as before (protected variable being used by

[jira] [Commented] (YARN-5397) [Umbrella] Usability improvements in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383070#comment-15383070 ] Ray Chiang commented on YARN-5397: -- Thanks [~yufeigu]. > [Umbrella] Usability improvements in

[jira] [Updated] (YARN-5264) Use FSQueue to store queue-specific information

[ https://issues.apache.org/jira/browse/YARN-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5264: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5397 > Use FSQueue to store queue-specific

[jira] [Updated] (YARN-4911) Bad placement policy in FairScheduler causes the RM to crash

[ https://issues.apache.org/jira/browse/YARN-4911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4911: - Issue Type: Sub-task (was: Bug) Parent: YARN-5397 > Bad placement policy in FairScheduler causes

[jira] [Created] (YARN-5399) Add configuration to remember ad-hoc queues upon configuration reload

Ray Chiang created YARN-5399: Summary: Add configuration to remember ad-hoc queues upon configuration reload Key: YARN-5399 URL: https://issues.apache.org/jira/browse/YARN-5399 Project: Hadoop YARN

[jira] [Created] (YARN-5398) Standardize whitespace trimming and splitting in FairScheduler code

Ray Chiang created YARN-5398: Summary: Standardize whitespace trimming and splitting in FairScheduler code Key: YARN-5398 URL: https://issues.apache.org/jira/browse/YARN-5398 Project: Hadoop YARN

[jira] [Updated] (YARN-5387) FairScheduler: add the ability to specify a parent queue to all placement rules

[ https://issues.apache.org/jira/browse/YARN-5387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5387: - Issue Type: Sub-task (was: New Feature) Parent: YARN-5397 > FairScheduler: add the ability to

[jira] [Created] (YARN-5397) [Umbrella] Usability improvements in FairScheduler

Ray Chiang created YARN-5397: Summary: [Umbrella] Usability improvements in FairScheduler Key: YARN-5397 URL: https://issues.apache.org/jira/browse/YARN-5397 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.007.patch - Fix javadoc tag > Refactor nodeUpdate across schedulers >

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380318#comment-15380318 ] Ray Chiang commented on YARN-5047: -- Will do. Thanks [~ajisakaa]. > Refactor nodeUpdate across schedulers

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380282#comment-15380282 ] Ray Chiang commented on YARN-5047: -- RE: checkstyle Same issue with protected variable RE: Javadoc Looks

[jira] [Updated] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.006.patch - Changed return type of AbstractYarnScheduler#getSchedulerNode() to

[jira] [Commented] (YARN-5272) Handle queue names consistently in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379885#comment-15379885 ] Ray Chiang commented on YARN-5272: -- Filing a new JIRA for the whitespace fixing is fine by me. The

[jira] [Commented] (YARN-5272) Handle queue names consistently in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376276#comment-15376276 ] Ray Chiang commented on YARN-5272: -- [~wilfreds], let me know if you'd prefer to abstract out the

[jira] [Updated] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5283: - Attachment: YARN-5283.002.patch Accidentally included another patch in the same tree. > Refactor

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371328#comment-15371328 ] Ray Chiang commented on YARN-5283: -- [~subru], sanity checks like {{isReadyToAssignContainers}} are bad for

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366808#comment-15366808 ] Ray Chiang commented on YARN-5283: -- [~subru], let me know if the refactored version suits your needs as we

[jira] [Updated] (YARN-5272) Handle queue names consistently in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5272: - Summary: Handle queue names consistently in FairScheduler (was: FairScheduler handles "invalid" queue

[jira] [Commented] (YARN-5272) FairScheduler handles "invalid" queue names inconsistently even after YARN-3241

[ https://issues.apache.org/jira/browse/YARN-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366680#comment-15366680 ] Ray Chiang commented on YARN-5272: -- Looks very nice [~wilfreds]. One debatable nit: Rather than call

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365276#comment-15365276 ] Ray Chiang commented on YARN-5283: -- RE: Javadoc errors I see these in trunk even without my changes,

[jira] [Updated] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5283: - Attachment: YARN-5283.001.patch Initial refactor attempt > Refactor container assignment into

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359869#comment-15359869 ] Ray Chiang commented on YARN-5047: -- RE: No new tests Pure code refactoring. RE: Checkstyle Complaining

[jira] [Commented] (YARN-4568) Fix message when NodeManager runs into errors initializing the recovery directory

[ https://issues.apache.org/jira/browse/YARN-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359776#comment-15359776 ] Ray Chiang commented on YARN-4568: -- Checking this in. > Fix message when NodeManager runs into errors

[jira] [Commented] (YARN-5282) Fix typos in CapacityScheduler documentation

[ https://issues.apache.org/jira/browse/YARN-5282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15359738#comment-15359738 ] Ray Chiang commented on YARN-5282: -- Thanks [~varun_saxena] for the commit and [~ajisakaa] for the review!

[jira] [Updated] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.005.patch Adding same patch for Jenkins run. > Refactor nodeUpdate across

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342631#comment-15342631 ] Ray Chiang commented on YARN-5047: -- Thanks [~wangda] and [~kasha]. I've filed the following JIRAs: *

[jira] [Created] (YARN-5285) Refactor common code in initScheduler across schedulers

Ray Chiang created YARN-5285: Summary: Refactor common code in initScheduler across schedulers Key: YARN-5285 URL: https://issues.apache.org/jira/browse/YARN-5285 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5284) Refactor handle across schedulers

Ray Chiang created YARN-5284: Summary: Refactor handle across schedulers Key: YARN-5284 URL: https://issues.apache.org/jira/browse/YARN-5284 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

Ray Chiang created YARN-5283: Summary: Refactor container assignment into AbstractYarnScheduler#assignContainers Key: YARN-5283 URL: https://issues.apache.org/jira/browse/YARN-5283 Project: Hadoop YARN

[jira] [Updated] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.004.patch - Added overriding nodeUpdate() to CapacityScheduler. Will make handle()

[jira] [Updated] (YARN-5282) Fix typos in CapacityScheduler documentation

[ https://issues.apache.org/jira/browse/YARN-5282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5282: - Attachment: YARN-5282.001.patch > Fix typos in CapacityScheduler documentation >

[jira] [Created] (YARN-5282) Fix typos in CapacityScheduler documentation

Ray Chiang created YARN-5282: Summary: Fix typos in CapacityScheduler documentation Key: YARN-5282 URL: https://issues.apache.org/jira/browse/YARN-5282 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5274) Use smartctl to determine health of disks

[ https://issues.apache.org/jira/browse/YARN-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340376#comment-15340376 ] Ray Chiang commented on YARN-5274: -- One question: # [~vvasudev], do you think this should be organized as

[jira] [Reopened] (YARN-5137) Make DiskChecker pluggable

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reopened YARN-5137: -- Reopening after

[jira] [Commented] (YARN-4271) Make the NodeManager's health checker service pluggable

[ https://issues.apache.org/jira/browse/YARN-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308623#comment-15308623 ] Ray Chiang commented on YARN-4271: -- Thanks [~subru] and [~rmohan]. I'll reopen YARN-5137 and we can

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301396#comment-15301396 ] Ray Chiang commented on YARN-5137: -- I'm a little confused by the above statement. If we want more places

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301234#comment-15301234 ] Ray Chiang commented on YARN-5137: -- [~subru] NodeStatusHealthChecker already has the capability to change

[jira] [Updated] (YARN-5137) Make DiskChecker pluggable

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5137: - Description: It would be nice to have the option for a DiskChecker that has more sophisticated checking

[jira] [Updated] (YARN-5137) Make DiskChecker pluggable

[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5137: - Assignee: Yufei Gu > Make DiskChecker pluggable > -- > > Key:

[jira] [Created] (YARN-5137) Make DiskChecker pluggable

Ray Chiang created YARN-5137: Summary: Make DiskChecker pluggable Key: YARN-5137 URL: https://issues.apache.org/jira/browse/YARN-5137 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297344#comment-15297344 ] Ray Chiang commented on YARN-5047: -- RE: checkstyle Same issue with protected member variable. RE:

[jira] [Updated] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.003.patch - Implement earlier feedback - Removes optimization to assignMultiple

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297041#comment-15297041 ] Ray Chiang commented on YARN-5047: -- Filed follow up JIRAs YARN-5128 and YARN-5129. > Refactor nodeUpdate

[jira] [Updated] (YARN-5128) Investigate potential race condition in the scheduler nodeUpdate() method

[ https://issues.apache.org/jira/browse/YARN-5128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5128: - Summary: Investigate potential race condition in the scheduler nodeUpdate() method (was: Investigate

[jira] [Created] (YARN-5129) Update FairScheduler to use SchedulerHealth

Ray Chiang created YARN-5129: Summary: Update FairScheduler to use SchedulerHealth Key: YARN-5129 URL: https://issues.apache.org/jira/browse/YARN-5129 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297002#comment-15297002 ] Ray Chiang commented on YARN-5047: -- Thanks for the feedback guys. I agree with doing #1, but it looks

[jira] [Created] (YARN-5128) Investigate potential race condition in the scheuduler nodeUpdate() method

Ray Chiang created YARN-5128: Summary: Investigate potential race condition in the scheuduler nodeUpdate() method Key: YARN-5128 URL: https://issues.apache.org/jira/browse/YARN-5128 Project: Hadoop YARN

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292009#comment-15292009 ] Ray Chiang commented on YARN-4464: -- +1 (nonbinding), pending Jenkins. Passed TestYarnConfigurationFields

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291981#comment-15291981 ] Ray Chiang commented on YARN-4464: -- This patch looks like it modifies the property

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290199#comment-15290199 ] Ray Chiang commented on YARN-4878: -- Oh weird. My visual diff made it look like "public synchronized" was

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289911#comment-15289911 ] Ray Chiang commented on YARN-4464: -- Nope. Thanks for the explanation. > default value of

[jira] [Commented] (YARN-5001) Aggregated Logs root directory is created with wrong group if nonexistent

[ https://issues.apache.org/jira/browse/YARN-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289882#comment-15289882 ] Ray Chiang commented on YARN-5001: -- +1 (nonbinding). Looks like a simple enough change. > Aggregated

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289743#comment-15289743 ] Ray Chiang commented on YARN-4766: -- Minor nit: Rename noMoreRetentionLogFiles to

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4464: - Target Version/s: 3.0.0-alpha1 > default value of

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289707#comment-15289707 ] Ray Chiang commented on YARN-4464: -- Agree about making this trunk-only. One thought. If we change the

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289697#comment-15289697 ] Ray Chiang commented on YARN-4878: -- Some minor nitpicks: - Change the metric description from "Maximum

[jira] [Updated] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

[ https://issues.apache.org/jira/browse/YARN-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4975: - Assignee: Yufei Gu > Fair Scheduler: exception thrown when a parent queue marked 'parent' has >

[jira] [Updated] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5106: - Assignee: Yufei Gu > Provide a builder interface for FairScheduler allocations for use in tests >

[jira] [Updated] (YARN-3890) FairScheduler should show the scheduler health metrics similar to ones added in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3890: - Assignee: Yufei Gu > FairScheduler should show the scheduler health metrics similar to ones added > in

[jira] [Commented] (YARN-5047) Refactor nodeUpdate() from FairScheduler, CapacityScheduler, and FifoScheduler

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15287492#comment-15287492 ] Ray Chiang commented on YARN-5047: -- RE: no new tests Refactoring relying on existing tests for

[jira] [Updated] (YARN-5047) Refactor nodeUpdate() from FairScheduler, CapacityScheduler, and FifoScheduler

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.002.patch - Fix missing synchronize in overridden method FairScheduler#nodeUpdate()

[jira] [Updated] (YARN-4301) NM disk health checker should have a timeout

[ https://issues.apache.org/jira/browse/YARN-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4301: - Issue Type: Sub-task (was: Bug) Parent: YARN-5078 > NM disk health checker should have a timeout

[jira] [Updated] (YARN-3321) "Health-Report" column of NodePage should display more information.

[ https://issues.apache.org/jira/browse/YARN-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3321: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5078 > "Health-Report" column of NodePage

[jira] [Updated] (YARN-1072) Need a default NodeManager health check script

[ https://issues.apache.org/jira/browse/YARN-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-1072: - Issue Type: Sub-task (was: Task) Parent: YARN-5078 > Need a default NodeManager health check

[jira] [Updated] (YARN-1072) Need a default NodeManager health check script

[ https://issues.apache.org/jira/browse/YARN-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-1072: - Assignee: Yufei Gu > Need a default NodeManager health check script >

[jira] [Updated] (YARN-3531) Make "good" local directories available to ContainerExecutors at initialization time

[ https://issues.apache.org/jira/browse/YARN-3531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3531: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5078 > Make "good" local directories

[jira] [Updated] (YARN-3321) "Health-Report" column of NodePage should display more information.

[ https://issues.apache.org/jira/browse/YARN-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3321: - Assignee: Yufei Gu > "Health-Report" column of NodePage should display more information. >

[jira] [Updated] (YARN-3531) Make "good" local directories available to ContainerExecutors at initialization time

[ https://issues.apache.org/jira/browse/YARN-3531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3531: - Assignee: Yufei Gu > Make "good" local directories available to ContainerExecutors at > initialization

[jira] [Updated] (YARN-3797) NodeManager not blacklisting the disk (shuffle) with errors

[ https://issues.apache.org/jira/browse/YARN-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3797: - Issue Type: Sub-task (was: Bug) Parent: YARN-5078 > NodeManager not blacklisting the disk

[jira] [Updated] (YARN-3797) NodeManager not blacklisting the disk (shuffle) with errors

[ https://issues.apache.org/jira/browse/YARN-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3797: - Assignee: Yufei Gu > NodeManager not blacklisting the disk (shuffle) with errors >

[jira] [Updated] (YARN-4271) Make the NodeManager's health checker service pluggable

[ https://issues.apache.org/jira/browse/YARN-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4271: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5078 > Make the NodeManager's health checker

[jira] [Created] (YARN-5078) [Umbrella] NodeManager health checker improvements

Ray Chiang created YARN-5078: Summary: [Umbrella] NodeManager health checker improvements Key: YARN-5078 URL: https://issues.apache.org/jira/browse/YARN-5078 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5047) Refactor nodeUpdate() from FairScheduler, CapacityScheduler, and FifoScheduler

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Summary: Refactor nodeUpdate() from FairScheduler, CapacityScheduler, and FifoScheduler (was: Refactor

[jira] [Commented] (YARN-1418) Add Tracing to YARN

[ https://issues.apache.org/jira/browse/YARN-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278454#comment-15278454 ] Ray Chiang commented on YARN-1418: -- [~iwasakims], let me know if you could use a collaborator (design

[jira] [Updated] (YARN-5047) Refactor nodeUpdate() from FairScheduler and CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Attachment: YARN-5047.001.patch - First attempt at refactoring > Refactor nodeUpdate() from FairScheduler

[jira] [Commented] (YARN-5046) [Umbrella] Refactor scheduler code

[ https://issues.apache.org/jira/browse/YARN-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273324#comment-15273324 ] Ray Chiang commented on YARN-5046: -- [~leftnoteasy] or [~jianhe], let me know if you think if it makes

[jira] [Assigned] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

[ https://issues.apache.org/jira/browse/YARN-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-2143: Assignee: Ray Chiang > Merge common killContainer logic of Fair/Capacity scheduler into >

[jira] [Assigned] (YARN-5030) Revisit o.a.h.y.s.rm.scheduler.ResourceUsage

[ https://issues.apache.org/jira/browse/YARN-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-5030: Assignee: Ray Chiang > Revisit o.a.h.y.s.rm.scheduler.ResourceUsage >

[jira] [Created] (YARN-5047) Refactor nodeUpdate() from FairScheduler and CapacityScheduler

Ray Chiang created YARN-5047: Summary: Refactor nodeUpdate() from FairScheduler and CapacityScheduler Key: YARN-5047 URL: https://issues.apache.org/jira/browse/YARN-5047 Project: Hadoop YARN

[jira] [Updated] (YARN-5046) [Umbrella] Refactor scheduler code

[ https://issues.apache.org/jira/browse/YARN-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5046: - Description: At this point in time, there are several places where code common to the schedulers can be

[jira] [Updated] (YARN-4809) De-duplicate container completion across schedulers

[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4809: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > De-duplicate container completion

[jira] [Updated] (YARN-5030) Revisit o.a.h.y.s.rm.scheduler.ResourceUsage

[ https://issues.apache.org/jira/browse/YARN-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5030: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > Revisit

[jira] [Updated] (YARN-3776) FairScheduler code refactoring to separate out the code paths for assigning a reserved container and a non-reserved container

[ https://issues.apache.org/jira/browse/YARN-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3776: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > FairScheduler code refactoring to

[jira] [Updated] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

[ https://issues.apache.org/jira/browse/YARN-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2143: - Issue Type: Sub-task (was: Task) Parent: YARN-5046 > Merge common killContainer logic of

<    1   2   3   4   5   6   >