[jira] [Commented] (YARN-9941) Opportunistic scheduler metrics should be reset during fail-over.

2020-07-20 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161710#comment-17161710 ] Abhishek Modi commented on YARN-9941: - Sure [~BilwaST]. Feel free to take over. Thanks >

[jira] [Assigned] (YARN-8859) Add audit logs for router service

2020-01-17 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-8859: --- Assignee: Minni Mittal (was: Abhishek Modi) > Add audit logs for router service >

[jira] [Assigned] (YARN-8529) Add timeout to RouterWebServiceUtil#invokeRMWebService

2020-01-10 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-8529: --- Assignee: Minni Mittal (was: Giovanni Matteo Fumarola) > Add timeout to

[jira] [Assigned] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2020-01-10 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-7898: --- Assignee: Minni Mittal (was: Giovanni Matteo Fumarola) > [FederationStateStore] Create a

[jira] [Commented] (YARN-10080) Support show app id on localizer thread pool

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011518#comment-17011518 ] Abhishek Modi commented on YARN-10080: -- Thanks [~cane] for working on this. Changes looks good to

[jira] [Commented] (YARN-5542) Scheduling of opportunistic containers

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011357#comment-17011357 ] Abhishek Modi commented on YARN-5542: - [~brahmareddy] [~kkaranasos] - I have moved remaining open

[jira] [Updated] (YARN-2886) Estimating waiting time in NM container queues

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-2886: Parent Issue: YARN-10079 (was: YARN-5542) > Estimating waiting time in NM container queues >

[jira] [Updated] (YARN-7604) Fix some minor typos in the opportunistic container logging

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-7604: Parent Issue: YARN-10079 (was: YARN-5542) > Fix some minor typos in the opportunistic container

[jira] [Updated] (YARN-5414) Integrate NodeQueueLoadMonitor with ClusterNodeTracker

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-5414: Parent Issue: YARN-10079 (was: YARN-5542) > Integrate NodeQueueLoadMonitor with ClusterNodeTracker

[jira] [Updated] (YARN-5688) Make allocation of opportunistic containers asynchronous

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-5688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-5688: Parent Issue: YARN-10079 (was: YARN-5542) > Make allocation of opportunistic containers

[jira] [Updated] (YARN-9941) Opportunistic scheduler metrics should be reset during fail-over.

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9941: Parent Issue: YARN-10079 (was: YARN-5542) > Opportunistic scheduler metrics should be reset during

[jira] [Updated] (YARN-9390) Add support for configurable Resource Calculator in Opportunistic Scheduler.

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9390: Parent Issue: YARN-10079 (was: YARN-5542) > Add support for configurable Resource Calculator in

[jira] [Created] (YARN-10079) Scheduling of opportunistic containers - Phase 2

2020-01-08 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-10079: Summary: Scheduling of opportunistic containers - Phase 2 Key: YARN-10079 URL: https://issues.apache.org/jira/browse/YARN-10079 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5542) Scheduling of opportunistic containers

2020-01-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011350#comment-17011350 ] Abhishek Modi commented on YARN-5542: - [~kkaranasos] [~brahmareddy] I will move remaining open jiras

[jira] [Commented] (YARN-10040) DistributedShell test failure on X86 and ARM

2019-12-31 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006070#comment-17006070 ] Abhishek Modi commented on YARN-10040: -- I looked into it and Opportunistic Scheduling is working

[jira] [Assigned] (YARN-10040) DistributedShell test failure on X86 and ARM

2019-12-31 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-10040: Assignee: Abhishek Modi > DistributedShell test failure on X86 and ARM >

[jira] [Commented] (YARN-10040) DistributedShell test failure on X86 and ARM

2019-12-30 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005953#comment-17005953 ] Abhishek Modi commented on YARN-10040: -- Thanks [~ayushtkn] [~bzhaoopenstack]. I will take a look. >

[jira] [Commented] (YARN-9990) Testcase fails with "Insufficient configured threads: required=16 < max=10"

2019-11-28 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984753#comment-16984753 ] Abhishek Modi commented on YARN-9990: - Committed to trunk. Thanks [~prabhujoseph] for the patch. >

[jira] [Commented] (YARN-9990) Testcase fails with "Insufficient configured threads: required=16 < max=10"

2019-11-27 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983526#comment-16983526 ] Abhishek Modi commented on YARN-9990: - Thanks [~prabhujoseph] for the patch. LGTM. Will commit it

[jira] [Commented] (YARN-9965) Fix NodeManager failing to start on subsequent times when Hdfs Auxillary Jar is set

2019-11-18 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977073#comment-16977073 ] Abhishek Modi commented on YARN-9965: - Thanks [~prabhujoseph]. Latest addendum patch looks good to me.

[jira] [Commented] (YARN-9965) Fix NodeManager failing to start on subsequent times when Hdfs Auxillary Jar is set

2019-11-14 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974033#comment-16974033 ] Abhishek Modi commented on YARN-9965: - Thanks [~prabhujoseph] - I will review it by today. > Fix

[jira] [Commented] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-11-12 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972296#comment-16972296 ] Abhishek Modi commented on YARN-9697: - Thanks [~bibinchundatt] and [~elgoiri] for review. Committed to

[jira] [Commented] (YARN-9965) Fix NodeManager failing to start when Hdfs Auxillary Jar is set

2019-11-11 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972086#comment-16972086 ] Abhishek Modi commented on YARN-9965: - [~vinodkv] - I think that's a mistake from my end - I should

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-11-11 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.009.patch > Efficient allocation of Opportunistic containers. >

[jira] [Commented] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-11-11 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971480#comment-16971480 ] Abhishek Modi commented on YARN-9697: - Thanks [~bibinchundatt] for the review. {code:java} private

[jira] [Commented] (YARN-9965) Fix NodeManager failing to start when Hdfs Auxillary Jar is set

2019-11-10 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971356#comment-16971356 ] Abhishek Modi commented on YARN-9965: - Thanks [~prabhujoseph] for working on this. LGTM. I will commit

[jira] [Commented] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-30 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962868#comment-16962868 ] Abhishek Modi commented on YARN-9697: - Filed  YARN-9941 for fixing Opportunistic scheduler metrics

[jira] [Created] (YARN-9941) Opportunistic scheduler metrics should be reset during fail-over.

2019-10-30 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9941: --- Summary: Opportunistic scheduler metrics should be reset during fail-over. Key: YARN-9941 URL: https://issues.apache.org/jira/browse/YARN-9941 Project: Hadoop YARN

[jira] [Commented] (YARN-2442) ResourceManager JMX UI does not give HA State

2019-10-29 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961868#comment-16961868 ] Abhishek Modi commented on YARN-2442: - Thanks [~cyrusjackson25] for the patch and [~bibinchundatt] for

[jira] [Commented] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-22 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957250#comment-16957250 ] Abhishek Modi commented on YARN-9697: - Thanks [~bibinchundatt] for the review. I have addressed most

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-22 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.008.patch > Efficient allocation of Opportunistic containers. >

[jira] [Created] (YARN-9910) Make private localizer download resources in parallel

2019-10-17 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9910: --- Summary: Make private localizer download resources in parallel Key: YARN-9910 URL: https://issues.apache.org/jira/browse/YARN-9910 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-16 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.007.patch > Efficient allocation of Opportunistic containers. >

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-16 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.006.patch > Efficient allocation of Opportunistic containers. >

[jira] [Created] (YARN-9908) Make ZK calls in parallel to load application states.

2019-10-16 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9908: --- Summary: Make ZK calls in parallel to load application states. Key: YARN-9908 URL: https://issues.apache.org/jira/browse/YARN-9908 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-16 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.005.patch > Efficient allocation of Opportunistic containers. >

[jira] [Commented] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-04 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944825#comment-16944825 ] Abhishek Modi commented on YARN-9697: - Thanks [~elgoiri] for review. I have addressed all the comments

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-04 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.004.patch > Efficient allocation of Opportunistic containers. >

[jira] [Commented] (YARN-9782) Avoid DNS resolution while running SLS.

2019-10-04 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944342#comment-16944342 ] Abhishek Modi commented on YARN-9782: - Thanks [~elgoiri] for review. Committed to trunk. > Avoid DNS

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-04 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.003.patch > Efficient allocation of Opportunistic containers. >

[jira] [Commented] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-03 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943809#comment-16943809 ] Abhishek Modi commented on YARN-9697: - [~elgoiri] could you please review Yarn-9697.002.patch whenever

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-03 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.002.patch > Efficient allocation of Opportunistic containers. >

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-10-03 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.001.patch > Efficient allocation of Opportunistic containers. >

[jira] [Commented] (YARN-9870) Remove unused function from OpportunisticContainerAllocatorAMService

2019-10-02 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942849#comment-16942849 ] Abhishek Modi commented on YARN-9870: - Thanks [~elgoiri] for review. Committed to trunk. > Remove

[jira] [Updated] (YARN-9870) Remove unused function from OpportunisticContainerAllocatorAMService

2019-10-01 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9870: Attachment: YARN-9870.002.patch > Remove unused function from

[jira] [Updated] (YARN-9782) Avoid DNS resolution while running SLS.

2019-10-01 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9782: Attachment: YARN-9782.005.patch > Avoid DNS resolution while running SLS. >

[jira] [Commented] (YARN-9870) Remove unused function from OpportunisticContainerAllocatorAMService

2019-10-01 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941776#comment-16941776 ] Abhishek Modi commented on YARN-9870: - [~elgoiri] could you please review it. Thanks. > Remove unused

[jira] [Created] (YARN-9870) Remove unused function from OpportunisticContainerAllocatorAMService

2019-09-30 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9870: --- Summary: Remove unused function from OpportunisticContainerAllocatorAMService Key: YARN-9870 URL: https://issues.apache.org/jira/browse/YARN-9870 Project: Hadoop YARN

[jira] [Commented] (YARN-9859) Refactor OpportunisticContainerAllocator

2019-09-30 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941221#comment-16941221 ] Abhishek Modi commented on YARN-9859: - Thanks [~elgoiri] for review. Committed to trunk. > Refactor

[jira] [Commented] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-30 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940982#comment-16940982 ] Abhishek Modi commented on YARN-9782: - Thanks [~elgoiri] for the review. Attached 004 patch with

[jira] [Updated] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-30 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9782: Attachment: YARN-9782.004.patch > Avoid DNS resolution while running SLS. >

[jira] [Commented] (YARN-9859) Refactor OpportunisticContainerAllocator

2019-09-30 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940955#comment-16940955 ] Abhishek Modi commented on YARN-9859: - Thanks [~elgoiri]. I have done all the suggested changes. Could

[jira] [Updated] (YARN-9859) Refactor OpportunisticContainerAllocator

2019-09-30 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9859: Attachment: YARN-9859.003.patch > Refactor OpportunisticContainerAllocator >

[jira] [Updated] (YARN-9859) Refactor OpportunisticContainerAllocator

2019-09-26 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9859: Attachment: YARN-9859.002.patch > Refactor OpportunisticContainerAllocator >

[jira] [Commented] (YARN-9859) Refactor OpportunisticContainerAllocator

2019-09-26 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939113#comment-16939113 ] Abhishek Modi commented on YARN-9859: - Thanks [~elgoiri] for review. Changed the title of the jira.

[jira] [Updated] (YARN-9859) Refactor OpportunisticContainerAllocator

2019-09-26 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9859: Summary: Refactor OpportunisticContainerAllocator (was: Code cleanup of

[jira] [Commented] (YARN-9859) Code cleanup of OpportunisticContainerAllocator

2019-09-26 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938613#comment-16938613 ] Abhishek Modi commented on YARN-9859: - [~elgoiri] could you please review this whenever you get some

[jira] [Updated] (YARN-9859) Code cleanup of OpportunisticContainerAllocator

2019-09-26 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9859: Attachment: YARN-9859.001.patch > Code cleanup of OpportunisticContainerAllocator >

[jira] [Created] (YARN-9859) Code cleanup of OpportunisticContainerAllocator

2019-09-26 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9859: --- Summary: Code cleanup of OpportunisticContainerAllocator Key: YARN-9859 URL: https://issues.apache.org/jira/browse/YARN-9859 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-9853) Add number of paused containers in NodeInfo page.

2019-09-24 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9853: --- Summary: Add number of paused containers in NodeInfo page. Key: YARN-9853 URL: https://issues.apache.org/jira/browse/YARN-9853 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-09-19 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933658#comment-16933658 ] Abhishek Modi commented on YARN-9697: - [~elgoiri] could you please review the approach of

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-09-19 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.wip2.patch > Efficient allocation of Opportunistic containers. >

[jira] [Commented] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-19 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933270#comment-16933270 ] Abhishek Modi commented on YARN-9782: - Thanks [~elgoiri] for review. Filed YARN-9843 for making 

[jira] [Created] (YARN-9843) Test TestAMSimulator.testAMSimulator fails intermittently.

2019-09-19 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9843: --- Summary: Test TestAMSimulator.testAMSimulator fails intermittently. Key: YARN-9843 URL: https://issues.apache.org/jira/browse/YARN-9843 Project: Hadoop YARN

[jira] [Created] (YARN-9842) Port YARN-9608 DecommissioningNodesWatcher should get lists of running applications on node from RMNode to branch-3.0/branch-2

2019-09-19 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9842: --- Summary: Port YARN-9608 DecommissioningNodesWatcher should get lists of running applications on node from RMNode to branch-3.0/branch-2 Key: YARN-9842 URL:

[jira] [Commented] (YARN-9794) RM crashes due to runtime errors in TimelineServiceV2Publisher

2019-09-15 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929935#comment-16929935 ] Abhishek Modi commented on YARN-9794: - Thanks [~tarunparimi]. Latest patch looks good to me. Thanks

[jira] [Updated] (YARN-9816) EntityGroupFSTimelineStore#scanActiveLogs fails when undesired files are present under /ats/active.

2019-09-12 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9816: Summary: EntityGroupFSTimelineStore#scanActiveLogs fails when undesired files are present under

[jira] [Commented] (YARN-9816) EntityGroupFSTimelineStore#scanActiveLogs fails with StackOverflowError

2019-09-12 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928231#comment-16928231 ] Abhishek Modi commented on YARN-9816: - Sure.. committing it shortly. Thanks. >

[jira] [Created] (YARN-9828) Add log line for app submission in RouterWebServices.

2019-09-12 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9828: --- Summary: Add log line for app submission in RouterWebServices. Key: YARN-9828 URL: https://issues.apache.org/jira/browse/YARN-9828 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-9819) Make TestOpportunisticContainerAllocatorAMService more resilient.

2019-09-11 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928147#comment-16928147 ] Abhishek Modi commented on YARN-9819: - Thanks [~elgoiri] for review. Committed to trunk. > Make

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2019-09-11 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927813#comment-16927813 ] Abhishek Modi commented on YARN-8972: - [~giovanni.fumarola] are you still working on it. Thanks. >

[jira] [Created] (YARN-9827) Fix Http Response code in GenericExceptionHandler.

2019-09-11 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9827: --- Summary: Fix Http Response code in GenericExceptionHandler. Key: YARN-9827 URL: https://issues.apache.org/jira/browse/YARN-9827 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-10 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926479#comment-16926479 ] Abhishek Modi commented on YARN-9782: - Test failure is not related to this patch and is happening

[jira] [Updated] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-10 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9782: Attachment: YARN-9782.003.patch > Avoid DNS resolution while running SLS. >

[jira] [Commented] (YARN-9819) Make TestOpportunisticContainerAllocatorAMService more resilient.

2019-09-09 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925922#comment-16925922 ] Abhishek Modi commented on YARN-9819: - Thanks [~elgoiri] for review.  Attached v3 patch with javadocs

[jira] [Updated] (YARN-9819) Make TestOpportunisticContainerAllocatorAMService more resilient.

2019-09-09 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9819: Attachment: YARN-9819.003.patch > Make TestOpportunisticContainerAllocatorAMService more resilient.

[jira] [Commented] (YARN-9821) NM hangs at serviceStop when ATSV2 Backend Hbase is Down

2019-09-09 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925490#comment-16925490 ] Abhishek Modi commented on YARN-9821: - Sure [~rohithsharma]. I am leaving this Jira as unresolved and

[jira] [Commented] (YARN-9816) EntityGroupFSTimelineStore#scanActiveLogs fails with StackOverflowError

2019-09-09 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925484#comment-16925484 ] Abhishek Modi commented on YARN-9816: - Thanks [~Prabhu Joseph]. changes looks good to me. will commit

[jira] [Commented] (YARN-9821) NM hangs at serviceStop when ATSV2 Backend Hbase is Down

2019-09-09 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925481#comment-16925481 ] Abhishek Modi commented on YARN-9821: - Thanks [~Prabhu Joseph] for the patch and [~rohithsharma] for

[jira] [Commented] (YARN-9821) NM hangs at serviceStop when ATSV2 Backend Hbase is Down

2019-09-08 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925331#comment-16925331 ] Abhishek Modi commented on YARN-9821: - Thanks [~Prabhu Joseph] for the patch. Some minor comments: #

[jira] [Commented] (YARN-9819) Make TestOpportunisticContainerAllocatorAMService more resilient.

2019-09-07 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925081#comment-16925081 ] Abhishek Modi commented on YARN-9819: - [~elgoiri] could you please review it. Unit test failure is not

[jira] [Updated] (YARN-9819) Make TestOpportunisticContainerAllocatorAMService more resilient.

2019-09-07 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9819: Attachment: YARN-9819.002.patch > Make TestOpportunisticContainerAllocatorAMService more resilient.

[jira] [Commented] (YARN-9784) org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestLeafQueue is flaky

2019-09-07 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924852#comment-16924852 ] Abhishek Modi commented on YARN-9784: - Thanks [~kmarton] for the patch. LGTM. Thanks [~sunilg] and

[jira] [Updated] (YARN-9819) Make TestOpportunisticContainerAllocatorAMService more resilient.

2019-09-07 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9819: Attachment: YARN-9819.001.patch > Make TestOpportunisticContainerAllocatorAMService more resilient.

[jira] [Created] (YARN-9819) Make TestOpportunisticContainerAllocatorAMService more resilient.

2019-09-07 Thread Abhishek Modi (Jira)
Abhishek Modi created YARN-9819: --- Summary: Make TestOpportunisticContainerAllocatorAMService more resilient. Key: YARN-9819 URL: https://issues.apache.org/jira/browse/YARN-9819 Project: Hadoop YARN

[jira] [Commented] (YARN-9812) mvn javadoc:javadoc fails in hadoop-sls

2019-09-07 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924757#comment-16924757 ] Abhishek Modi commented on YARN-9812: - Thanks [~elgoiri] for review. Committed to trunk. > mvn

[jira] [Commented] (YARN-7604) Fix some minor typos in the opportunistic container logging

2019-09-07 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924747#comment-16924747 ] Abhishek Modi commented on YARN-7604: - Thanks [~cheersyang] for the patch. Could you please move this

[jira] [Updated] (YARN-9812) mvn javadoc:javadoc fails in hadoop-sls

2019-09-06 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9812: Attachment: YARN-9812.002.patch > mvn javadoc:javadoc fails in hadoop-sls >

[jira] [Commented] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-06 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924455#comment-16924455 ] Abhishek Modi commented on YARN-9782: - [~elgoiri] I found a potential issue with this unit test. Since

[jira] [Commented] (YARN-9812) mvn javadoc:javadoc fails in hadoop-sls

2019-09-06 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924361#comment-16924361 ] Abhishek Modi commented on YARN-9812: - [~aajisaka] [~elgoiri] could you please review it. Thanks. >

[jira] [Commented] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-06 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924327#comment-16924327 ] Abhishek Modi commented on YARN-9782: - Thanks [~elgoiri] for review. Updated patch. > Avoid DNS

[jira] [Commented] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-09-06 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924326#comment-16924326 ] Abhishek Modi commented on YARN-9697: - [~elgoiri] could you please review the approach taken in poc

[jira] [Updated] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-06 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9782: Attachment: YARN-9782.002.patch > Avoid DNS resolution while running SLS. >

[jira] [Updated] (YARN-9697) Efficient allocation of Opportunistic containers.

2019-09-06 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9697: Attachment: YARN-9697.wip1.patch > Efficient allocation of Opportunistic containers. >

[jira] [Assigned] (YARN-9812) mvn javadoc:javadoc fails in hadoop-sls

2019-09-04 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-9812: --- Assignee: Abhishek Modi > mvn javadoc:javadoc fails in hadoop-sls >

[jira] [Commented] (YARN-9804) Update ATSv2 document for latest feature supports

2019-09-02 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921170#comment-16921170 ] Abhishek Modi commented on YARN-9804: - Thanks [~rohithsharma]. New patch looks good to me. +1 from my

[jira] [Resolved] (YARN-8139) Skip node hostname resolution when running SLS.

2019-09-02 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi resolved YARN-8139. - Resolution: Duplicate > Skip node hostname resolution when running SLS. >

[jira] [Commented] (YARN-9804) Update ATSv2 document for latest feature supports

2019-09-01 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920634#comment-16920634 ] Abhishek Modi commented on YARN-9804: - Thanks [~rohithsharma] for working on it. Some minor comments:

[jira] [Commented] (YARN-9400) Remove unnecessary if at EntityGroupFSTimelineStore#parseApplicationId

2019-09-01 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920624#comment-16920624 ] Abhishek Modi commented on YARN-9400: - Thanks [~Prabhu Joseph]. lgtm. will commit to trunk. > Remove

[jira] [Commented] (YARN-8174) Add containerId to ResourceLocalizationService fetch failure log statement

2019-09-01 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920619#comment-16920619 ] Abhishek Modi commented on YARN-8174: - v3 patch lgtm. Committed to trunk. > Add containerId to

  1   2   3   4   5   6   7   >