[jira] [Assigned] (YARN-1965) Interrupted exception when closing YarnClient

[ https://issues.apache.org/jira/browse/YARN-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-1965: - Assignee: Kuhu Shukla Interrupted exception when closing YarnClient

[jira] [Updated] (YARN-1965) Interrupted exception when closing YarnClient

[ https://issues.apache.org/jira/browse/YARN-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-1965: -- Attachment: YARN-1965-v2.patch Patch with correction for whitespace. Fix to log Interrupted Exception

[jira] [Updated] (YARN-1965) Interrupted exception when closing YarnClient

[ https://issues.apache.org/jira/browse/YARN-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-1965: -- Attachment: YARN-1965.patch Fix to log Interrupted Exception in IPC Client as a warning. The current

[jira] [Updated] (YARN-1965) Interrupted exception when closing YarnClient

[ https://issues.apache.org/jira/browse/YARN-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-1965: -- Attachment: YARN-1965-v3.patch Changes to TestIPC and Client with correct indentation and formatting.

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617108#comment-14617108 ] Kuhu Shukla commented on YARN-2410: --- [~airbots] Are you working on this JIRA? If not, I

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660496#comment-14660496 ] Kuhu Shukla commented on YARN-2410: --- Requesting [~nroberts] and [~jlowe] to review the

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v5.patch This is the latest revised patch. A messageReceived() call uses two

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v4.patch Revamped patch that uses a Map to store the number of openfiles per

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v1.patch The ShuffleHandler messageReceived calls sendMapOutput only if the number

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v3.patch Nodemanager ShuffleHandler can possible exhaust file descriptors

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v2.patch Patch without no-prefix as git apply works without no-prefix.

[jira] [Commented] (YARN-4186) Make WebAppUtils a public API for yarn

[ https://issues.apache.org/jira/browse/YARN-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967453#comment-14967453 ] Kuhu Shukla commented on YARN-4186: --- [~jeagles], Request for review/comments. Thanks! > Make WebAppUtils

[jira] [Created] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

Kuhu Shukla created YARN-4311: - Summary: Removing nodes from include and exclude lists will not remove them from decommissioned nodes list Key: YARN-4311 URL: https://issues.apache.org/jira/browse/YARN-4311

[jira] [Commented] (YARN-4130) Duplicate declaration of ApplicationId in RMAppManager

[ https://issues.apache.org/jira/browse/YARN-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979317#comment-14979317 ] Kuhu Shukla commented on YARN-4130: --- +1 (non-binding). > Duplicate declaration of ApplicationId in

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997366#comment-14997366 ] Kuhu Shukla commented on YARN-4311: --- Thank you [~jlowe] for the comments. For graceful refresh nodes, I

[jira] [Assigned] (YARN-4365) FileSystemNodeLabelStore should check for root dir existence on startup

[ https://issues.apache.org/jira/browse/YARN-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-4365: - Assignee: Kuhu Shukla > FileSystemNodeLabelStore should check for root dir existence on startup >

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997655#comment-14997655 ] Kuhu Shukla commented on YARN-4311: --- Thanks [~jlowe]. Will rework my patch accordingly. > Removing nodes

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v1.patch This is a preliminary proposal patch. Through this change, any node is

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989697#comment-14989697 ] Kuhu Shukla commented on YARN-4311: --- [~jlowe], [~leftnoteasy], request for comments. Thanks a lot. >

[jira] [Created] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

Kuhu Shukla created YARN-4280: - Summary: CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster Key: YARN-4280 URL: https://issues.apache.org/jira/browse/YARN-4280

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v6.patch Thank you so much [~jlowe] for the detailed feedback. I have made all but

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v7.patch Modified ShuffleHandler to not use channel attachments. Moved MockNetty

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727927#comment-14727927 ] Kuhu Shukla commented on YARN-2410: --- Requesting [~nroberts] , [~jlowe] , [~jeagles] for their

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v8.patch Correcting 80 character line limit for test > Nodemanager ShuffleHandler

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736960#comment-14736960 ] Kuhu Shukla commented on YARN-2410: --- [~jlowe] Thank you so much for the comments. I have updated the

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v11.patch Adding documentation comments. > Nodemanager ShuffleHandler can

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: (was: YARN-2410-v11.patch) > Nodemanager ShuffleHandler can possible exhaust file

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v11.patch > Nodemanager ShuffleHandler can possible exhaust file descriptors >

[jira] [Updated] (YARN-4186) Make WebAppUtils a public API for yarn

[ https://issues.apache.org/jira/browse/YARN-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4186: -- Attachment: YARN-4186-v1.patch Made private class as public. Took out an unused method and other small

[jira] [Assigned] (YARN-162) nodemanager log aggregation has scaling issues with namenode

[ https://issues.apache.org/jira/browse/YARN-162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-162: Assignee: Kuhu Shukla (was: Siddharth Seth) > nodemanager log aggregation has scaling issues with

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v10.patch Fixing whitespace and checkstyle issues. > Nodemanager ShuffleHandler

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v9.patch sendMap should have only reduceContext as an argument. Test refactored to

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737470#comment-14737470 ] Kuhu Shukla commented on YARN-2410: --- [~jlowe], thank you for your comments. I regret the oversight.

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906412#comment-14906412 ] Kuhu Shukla commented on YARN-3456: --- Hello [~varun_saxena] , are you currently working on this issue? >

[jira] [Commented] (YARN-162) nodemanager log aggregation has scaling issues with namenode

[ https://issues.apache.org/jira/browse/YARN-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908237#comment-14908237 ] Kuhu Shukla commented on YARN-162: -- [~sseth] If you are not working on this, may I assign it to myself?

[jira] [Commented] (YARN-3417) AM to be able to exit with a request saying "restart me with these (possibly updated) resource requirements"

[ https://issues.apache.org/jira/browse/YARN-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908122#comment-14908122 ] Kuhu Shukla commented on YARN-3417: --- [~varun_saxena] Are you working on this JIRA currently? If not may I

[jira] [Assigned] (YARN-4186) Make WebAppUtils a public API for yarn

[ https://issues.apache.org/jira/browse/YARN-4186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-4186: - Assignee: Kuhu Shukla > Make WebAppUtils a public API for yarn >

[jira] [Commented] (YARN-2024) IOException in AppLogAggregatorImpl does not give stacktrace and leaves aggregated TFile in a bad state.

[ https://issues.apache.org/jira/browse/YARN-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908224#comment-14908224 ] Kuhu Shukla commented on YARN-2024: --- [~xgong] Are you still working on this JIRA? Thanks! > IOException

[jira] [Commented] (YARN-4198) CapacityScheduler locking / synchronization improvements

[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908136#comment-14908136 ] Kuhu Shukla commented on YARN-4198: --- [~curino] May I assign this JIRA to myself in case its not taken. >

[jira] [Assigned] (YARN-342) RM doesn't retry token renewals

[ https://issues.apache.org/jira/browse/YARN-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-342: Assignee: Kuhu Shukla > RM doesn't retry token renewals > --- > >

[jira] [Assigned] (YARN-3638) Yarn Resource Manager Scheduler page - show percentage of total cluster that each queue is using

[ https://issues.apache.org/jira/browse/YARN-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-3638: - Assignee: Kuhu Shukla > Yarn Resource Manager Scheduler page - show percentage of total cluster

[jira] [Commented] (YARN-1427) yarn-env.cmd should have the analog comments that are in yarn-env.sh

[ https://issues.apache.org/jira/browse/YARN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905671#comment-14905671 ] Kuhu Shukla commented on YARN-1427: --- +1 (non-binding) > yarn-env.cmd should have the analog comments

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045329#comment-15045329 ] Kuhu Shukla commented on YARN-4413: --- [~templedf] Also, YARN-4386 would still be needed since currently

[jira] [Commented] (YARN-4406) RM Web UI continues to show decommissioned nodes even after RM restart

[ https://issues.apache.org/jira/browse/YARN-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036336#comment-15036336 ] Kuhu Shukla commented on YARN-4406: --- Yes that is right, the issue is present on trunk. We could during

[jira] [Commented] (YARN-4406) RM Web UI continues to show decommissioned nodes even after RM restart

[ https://issues.apache.org/jira/browse/YARN-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036186#comment-15036186 ] Kuhu Shukla commented on YARN-4406: --- Thank you [~Naganarasimha]. Asking [~rchiang] if its alright for me

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v2.patch This patch addresses graceful and other versions of refreshNodes and also

[jira] [Assigned] (YARN-3102) Decommisioned Nodes not listed in Web UI

[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned YARN-3102: - Assignee: Kuhu Shukla (was: Naganarasimha G R) > Decommisioned Nodes not listed in Web UI >

[jira] [Commented] (YARN-4406) RM Web UI continues to show decommissioned nodes even after RM restart

[ https://issues.apache.org/jira/browse/YARN-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034480#comment-15034480 ] Kuhu Shukla commented on YARN-4406: --- [~rchiang] thank you for reporting this. I think the root cause is:

[jira] [Commented] (YARN-4406) RM Web UI continues to show decommissioned nodes even after RM restart

[ https://issues.apache.org/jira/browse/YARN-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034482#comment-15034482 ] Kuhu Shukla commented on YARN-4406: --- Spoke too soon. on trunk {{updateMetricsForRejoinedNode}} should

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036643#comment-15036643 ] Kuhu Shukla commented on YARN-4413: --- Thanks for reporting this [~templedf]. Was a node refresh done after

[jira] [Commented] (YARN-4406) RM Web UI continues to show decommissioned nodes even after RM restart

[ https://issues.apache.org/jira/browse/YARN-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036616#comment-15036616 ] Kuhu Shukla commented on YARN-4406: --- I agree. I was thinking about that too. During {{registerwithRM()}}

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042363#comment-15042363 ] Kuhu Shukla commented on YARN-4413: --- I agree. However, from the discussions with Junping and Sunil on

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v3.patch Fixed one test failure in TestYarnConfigurationFields by adding the new

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038265#comment-15038265 ] Kuhu Shukla commented on YARN-4413: --- YARN-4386 tracks the RECOMMISSION check. The current patch does not

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038269#comment-15038269 ] Kuhu Shukla commented on YARN-4413: --- The current patch for YARN-4386* > Nodes in the includes list

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045370#comment-15045370 ] Kuhu Shukla commented on YARN-4413: --- I see, so that answers my transition query, thanks [~templedf]. But

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045333#comment-15045333 ] Kuhu Shukla commented on YARN-4413: --- Small comment on the patch, {code} new

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045420#comment-15045420 ] Kuhu Shukla commented on YARN-4311: --- {code}

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038283#comment-15038283 ] Kuhu Shukla commented on YARN-4386: --- [~sunilg], [~djp]. Request for comments on how to test this since

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051542#comment-15051542 ] Kuhu Shukla commented on YARN-4311: --- [~eepayne], request for comments and review. Thanks a lot. >

[jira] [Commented] (YARN-3102) Decommisioned Nodes not listed in Web UI

[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051121#comment-15051121 ] Kuhu Shukla commented on YARN-3102: --- Following the discussion from YARN-4402: Given that we consider

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v4.patch Thanks [~templedf]. Attaching an updated patch. I removed the null check

[jira] [Updated] (YARN-3102) Decommisioned Nodes not listed in Web UI

[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-3102: -- Attachment: YARN-3102-v1.patch This patch adds semi-dummy entries to active RMNodes map

[jira] [Updated] (YARN-3102) Decommisioned Nodes not listed in Web UI

[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-3102: -- Attachment: YARN-3102-v2.patch Updating patch after addressing findbugs warning, failed test case and

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086256#comment-15086256 ] Kuhu Shukla commented on YARN-4311: --- bq. Do note that with this solution, if a user does a node refresh

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v5.patch Added a check before setting the timestamp of an untracked node such that

[jira] [Commented] (YARN-4365) FileSystemNodeLabelStore should check for root dir existence on startup

[ https://issues.apache.org/jira/browse/YARN-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025325#comment-15025325 ] Kuhu Shukla commented on YARN-4365: --- [~jlowe], Request for comments/review. Thanks a lot. >

[jira] [Updated] (YARN-4365) FileSystemNodeLabelStore should check for root dir existence on startup

[ https://issues.apache.org/jira/browse/YARN-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4365: -- Attachment: YARN-4365-3.patch Thank you [~jlowe]. Updated the patch. > FileSystemNodeLabelStore should

[jira] [Updated] (YARN-4365) FileSystemNodeLabelStore should check for root dir existence on startup

[ https://issues.apache.org/jira/browse/YARN-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4365: -- Attachment: YARN-4365-2.patch Attaching revised patch, with a better test case and changing the scope of

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026916#comment-15026916 ] Kuhu Shukla commented on YARN-4386: --- Sure that would help. I will update with revised patch soon. Thank

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026926#comment-15026926 ] Kuhu Shukla commented on YARN-4386: --- [~djp], without the patch, the decommissioned node is looked up in

[jira] [Created] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

Kuhu Shukla created YARN-4386: - Summary: refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes Key: YARN-4386 URL: https://issues.apache.org/jira/browse/YARN-4386

[jira] [Commented] (YARN-4365) FileSystemNodeLabelStore should check for root dir existence on startup

[ https://issues.apache.org/jira/browse/YARN-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022816#comment-15022816 ] Kuhu Shukla commented on YARN-4365: --- Test failure is irreproducible locally and is unrelated to the patch

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022866#comment-15022866 ] Kuhu Shukla commented on YARN-4386: --- Yes I agree. Missed correlating the DECOMMISSIONED state transition

[jira] [Updated] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4386: -- Priority: Minor (was: Major) > refreshNodesGracefully() looks at active RMNode list for recommissioning

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027332#comment-15027332 ] Kuhu Shukla commented on YARN-4318: --- Although locally the tests pass, I see that the failure is coming

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027565#comment-15027565 ] Kuhu Shukla commented on YARN-4318: --- Thank you Steve. I have updated the fields. Yes, it is seen on

[jira] [Updated] (YARN-4318) Test failure: TestAMAuthorization

[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4318: -- Affects Version/s: 3.0.0 Environment: jenkins Component/s: test > Test failure:

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026890#comment-15026890 ] Kuhu Shukla commented on YARN-4386: --- Thank you [~djp] for your comments. TestClientRMTokens is failing

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026895#comment-15026895 ] Kuhu Shukla commented on YARN-4318: --- [~ozawa], are you looking at this test failure? I can work on it if

[jira] [Commented] (YARN-4365) FileSystemNodeLabelStore should check for root dir existence on startup

[ https://issues.apache.org/jira/browse/YARN-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024847#comment-15024847 ] Kuhu Shukla commented on YARN-4365: --- Thanks a lot Jason. Will update revised patch shorty. >

[jira] [Updated] (YARN-4365) FileSystemNodeLabelStore should check for root dir existence on startup

[ https://issues.apache.org/jira/browse/YARN-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4365: -- Attachment: YARN-4365-1.patch Checks whether path exists before calling mkdir() for root path. Unit Test

[jira] [Updated] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4386: -- Attachment: YARN-4386-v1.patch refreshNodesGracefully() : if condition only checks for decommissioning

[jira] [Updated] (YARN-3102) Decommisioned Nodes not listed in Web UI

[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-3102: -- Attachment: YARN-4311-v7.patch While updating the test for YARN-3102, I modified the

[jira] [Updated] (YARN-3102) Decommisioned Nodes not listed in Web UI

[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-3102: -- Attachment: YARN-3102-v3.patch Thank you very much [~templedf] and [~jlowe] for the review. I have

[jira] [Updated] (YARN-3102) Decommisioned Nodes not listed in Web UI

[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-3102: -- Attachment: (was: YARN-4311-v7.patch) > Decommisioned Nodes not listed in Web UI >

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v7.patch While updating the test for YARN-3102, I modified the

[jira] [Commented] (YARN-3102) Decommisioned Nodes not listed in Web UI

[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095319#comment-15095319 ] Kuhu Shukla commented on YARN-3102: --- Please ignore, updated the wrong JIRA. > Decommisioned Nodes not

[jira] [Created] (YARN-5173) Enable Token Support for AHSClient

Kuhu Shukla created YARN-5173: - Summary: Enable Token Support for AHSClient Key: YARN-5173 URL: https://issues.apache.org/jira/browse/YARN-5173 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: YARN-4280.004.patch Updated ParentQueue to use summed up blockedLimits across its child

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343248#comment-15343248 ] Kuhu Shukla commented on YARN-4280: --- Thank you so much [~leftnoteasy], [~jlowe]. I am updating the patch

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: (was: YARN-4280.002.patch) > CapacityScheduler reservations may not prevent indefinite

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: YARN-4280.002.patch Attaching a patch that does not add 'blocked' resource to

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: YARN-4280.003.patch > CapacityScheduler reservations may not prevent indefinite postponement

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15336745#comment-15336745 ] Kuhu Shukla commented on YARN-4280: --- TestAMRestart passes locally with the patch. The checkstyle issue is

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: YARN-4280.001.patch A preliminary patch that adds 'blocked' resource to assignments and

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: YARN-4280.005.patch Revised patch to address comments by Jason. This approach eliminates the

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348222#comment-15348222 ] Kuhu Shukla commented on YARN-4280: --- Requesting [~jlowe], [~leftnoteasy], [~sunilg] for more

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: YARN-4280.002.patch Updated patch for failing test which was due to my patch using addTo()

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: (was: YARN-4280.005.patch) > CapacityScheduler reservations may not prevent indefinite

  1   2   3   4   >