[jira] [Commented] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-05-24 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489024#comment-16489024 ] Tarun Parimi commented on YARN-8279: This issue occurs since LogAggregationIndexedFileController

[jira] [Commented] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-05-24 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489074#comment-16489074 ] Tarun Parimi commented on YARN-8279: [~jlowe] YARN-7072 seems to have been backported in HDP

[jira] [Commented] (YARN-8356) yarn.log-aggregation why can auto clean

2018-05-24 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489028#comment-16489028 ] Tarun Parimi commented on YARN-8356: This issue seems to be the same as the one raised in YARN-8279 >

[jira] [Created] (YARN-7943) testCSReservationWithRootUnblocked() and testCSQueueBlocked() in TestCapacityScheduler are flaky

2018-02-16 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-7943: -- Summary: testCSReservationWithRootUnblocked() and testCSQueueBlocked() in TestCapacityScheduler are flaky Key: YARN-7943 URL: https://issues.apache.org/jira/browse/YARN-7943

[jira] [Commented] (YARN-7943) testCSReservationWithRootUnblocked() and testCSQueueBlocked() in TestCapacityScheduler are flaky

2018-02-16 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367829#comment-16367829 ] Tarun Parimi commented on YARN-7943: Attached a trivial patch which increases the 

[jira] [Updated] (YARN-7943) testCSReservationWithRootUnblocked() and testCSQueueBlocked() in TestCapacityScheduler are flaky

2018-02-16 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-7943: --- Attachment: YARN-7943.001.patch > testCSReservationWithRootUnblocked() and testCSQueueBlocked() in >

[jira] [Created] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-08-06 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-8627: -- Summary: EntityGroupFSTimelineStore hdfs done directory keeps on accumulating Key: YARN-8627 URL: https://issues.apache.org/jira/browse/YARN-8627 Project: Hadoop YARN

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-08-06 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16571043#comment-16571043 ] Tarun Parimi commented on YARN-8627: Adding a test case in 

[jira] [Updated] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-08-06 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8627: --- Attachment: YARN-8627.002.patch > EntityGroupFSTimelineStore hdfs done directory keeps on

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-08-06 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569873#comment-16569873 ] Tarun Parimi commented on YARN-8627: On further analysis, I found that this error occurs for

[jira] [Updated] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-08-06 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8627: --- Attachment: YARN-8627.001.patch > EntityGroupFSTimelineStore hdfs done directory keeps on

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-08-13 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578293#comment-16578293 ] Tarun Parimi commented on YARN-8627: [~rohithsharma] , please review the patch when free. >

[jira] [Updated] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-08-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8720: --- Attachment: YARN-8720.002.patch > CapacityScheduler does not enforce >

[jira] [Commented] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-08-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594760#comment-16594760 ] Tarun Parimi commented on YARN-8720: Fixed unit test failures. TestAMRestart failure is probably due

[jira] [Commented] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-08-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595951#comment-16595951 ] Tarun Parimi commented on YARN-8720: [~sunilg] Can you help review this? Thanks > CapacityScheduler

[jira] [Commented] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-08-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594528#comment-16594528 ] Tarun Parimi commented on YARN-8720: Spark for example does checking on AM side based only on the 

[jira] [Updated] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-08-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8720: --- Attachment: YARN-8720.001.patch > CapacityScheduler does not enforce >

[jira] [Assigned] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-08-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi reassigned YARN-8720: -- Assignee: Tarun Parimi > CapacityScheduler does not enforce >

[jira] [Commented] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-08-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593755#comment-16593755 ] Tarun Parimi commented on YARN-8720: This issue applies to all applications and ResourceManager should

[jira] [Created] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-08-27 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-8720: -- Summary: CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured Key: YARN-8720 URL: https://issues.apache.org/jira/browse/YARN-8720

[jira] [Created] (YARN-8567) Fetching yarn logs fails for long running application if it is not present in timeline store

2018-07-23 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-8567: -- Summary: Fetching yarn logs fails for long running application if it is not present in timeline store Key: YARN-8567 URL: https://issues.apache.org/jira/browse/YARN-8567

[jira] [Updated] (YARN-8567) Fetching yarn logs fails for long running application if it is not present in timeline store

2018-07-23 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8567: --- Attachment: YARN-8567.001.patch > Fetching yarn logs fails for long running application if it is not

[jira] [Commented] (YARN-8567) Fetching yarn logs fails for long running application if it is not present in timeline store

2018-07-23 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552958#comment-16552958 ] Tarun Parimi commented on YARN-8567: {{AHSClientImpl#getContainers}} failed because the application

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-12 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394977#comment-16394977 ] Tarun Parimi commented on YARN-8022: [~rohithsharma] Looks like callerUgi null check before the revert

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-12 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395015#comment-16395015 ] Tarun Parimi commented on YARN-8022: YARN-6991 depends on running 

[jira] [Updated] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-12 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8022: --- Attachment: YARN-8022.002.patch > ResourceManager UI cluster/app/ page fails to render >

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-12 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395060#comment-16395060 ] Tarun Parimi commented on YARN-8022: Thanks for the clarification [~rohithsharma] . Attached a patch as

[jira] [Created] (YARN-7989) Yarn ui2 configuration tables have the same search and pagination instances

2018-03-01 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-7989: -- Summary: Yarn ui2 configuration tables have the same search and pagination instances Key: YARN-7989 URL: https://issues.apache.org/jira/browse/YARN-7989 Project: Hadoop

[jira] [Commented] (YARN-7989) Yarn ui2 configuration tables have the same search and pagination instances

2018-03-01 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381683#comment-16381683 ] Tarun Parimi commented on YARN-7989: All the configuration tables are passed the same tableDefinition

[jira] [Updated] (YARN-7989) Yarn ui2 configuration tables have the same search and pagination instances

2018-03-01 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-7989: --- Attachment: YARN-7989.001.patch > Yarn ui2 configuration tables have the same search and pagination

[jira] [Commented] (YARN-7989) Yarn ui2 configuration tables have the same search and pagination instances

2018-03-01 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381722#comment-16381722 ] Tarun Parimi commented on YARN-7989: [~sunilg] Checked that the search is local to each table now.

[jira] [Updated] (YARN-7989) Yarn ui2 configuration tables have the same search and pagination instances

2018-03-01 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-7989: --- Attachment: Screen Shot 2018-03-01 at 2.47.30 PM.png > Yarn ui2 configuration tables have the same

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-13 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396604#comment-16396604 ] Tarun Parimi commented on YARN-8022: I tested the patch manually on trunk. The application page now

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-13 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396715#comment-16396715 ] Tarun Parimi commented on YARN-8022: Managed to check the patch with spnego auth as well. The

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394321#comment-16394321 ] Tarun Parimi commented on YARN-8022: Attached a patch which undoes the changes made by the revert of

[jira] [Updated] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8022: --- Attachment: YARN-8022.001.patch > ResourceManager UI cluster/app/ page fails to render >

[jira] [Comment Edited] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394321#comment-16394321 ] Tarun Parimi edited comment on YARN-8022 at 3/10/18 8:22 PM: - Attached a patch

[jira] [Created] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-10 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-8022: -- Summary: ResourceManager UI cluster/app/ page fails to render Key: YARN-8022 URL: https://issues.apache.org/jira/browse/YARN-8022 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394312#comment-16394312 ] Tarun Parimi commented on YARN-8022: Looks like this NPE occurs due to the revert of HADOOP-14077 .

[jira] [Updated] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8022: --- Component/s: webapp > ResourceManager UI cluster/app/ page fails to render >

[jira] [Updated] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8022: --- Affects Version/s: 3.1.0 > ResourceManager UI cluster/app/ page fails to render >

[jira] [Updated] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8022: --- Affects Version/s: 3.2.0 > ResourceManager UI cluster/app/ page fails to render >

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-10-08 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641422#comment-16641422 ] Tarun Parimi commented on YARN-8627: Had a discussion with [~rohithsharma] offline. Summarizing our

[jira] [Updated] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-10-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8627: --- Attachment: app-domain-logs.zip > EntityGroupFSTimelineStore hdfs done directory keeps on

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-10-10 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645983#comment-16645983 ] Tarun Parimi commented on YARN-8627: [~rohithsharma] Attached the domain log files for three such

[jira] [Resolved] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-10-11 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi resolved YARN-8279. Resolution: Workaround Release Note: This issue affects only when IndexedFormat is used for

[jira] [Updated] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-10-11 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8279: --- Release Note: This issue affects only when IndexedFormat is used for log-aggregation by setting

[jira] [Updated] (YARN-8567) Fetching yarn logs fails for long running application if it is not present in timeline store

2019-01-03 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8567: --- Attachment: YARN-8567.002.patch > Fetching yarn logs fails for long running application if it is not

[jira] [Commented] (YARN-8567) Fetching yarn logs fails for long running application if it is not present in timeline store

2019-01-03 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732945#comment-16732945 ] Tarun Parimi commented on YARN-8567: Thanks for the review [~rohithsharma] . Attached a new patch

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-22 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748714#comment-16748714 ] Tarun Parimi commented on YARN-9209: Thanks [~cheersyang] . I tried relaxing the check by patching the

[jira] [Updated] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-22 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9209: --- Description: When application sets a placement constraint without specifying a nodePartition, the

[jira] [Created] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-23 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-9224: -- Summary: TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation Key: YARN-9224 URL: https://issues.apache.org/jira/browse/YARN-9224

[jira] [Updated] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-17 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9209: --- Description: When application sets a placement constraint without specifying a nodePartition, the

[jira] [Created] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-17 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-9209: -- Summary: When nodePartition is not set in Placement Constraints, containers are allocated only in default partition Key: YARN-9209 URL:

[jira] [Updated] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-17 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9209: --- Description: When application sets a placement constraint without specifying a nodePartition, the

[jira] [Commented] (YARN-9040) LevelDBCacheTimelineStore in ATS 1.5 leaks native memory

2018-12-16 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722720#comment-16722720 ] Tarun Parimi commented on YARN-9040: Thanks [~csingh] for your review. Yeah, I was not sure how to

[jira] [Commented] (YARN-9040) LevelDBCacheTimelineStore in ATS 1.5 leaks native memory

2018-11-29 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702860#comment-16702860 ] Tarun Parimi commented on YARN-9040: [~rohithsharma] Can you please review this ? >

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-11-29 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704328#comment-16704328 ] Tarun Parimi commented on YARN-8627: [~rohithsharma] , I was unable to reproduce locally. Still cant 

[jira] [Updated] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-11-29 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8627: --- Attachment: YARN-8627.003.patch > EntityGroupFSTimelineStore hdfs done directory keeps on

[jira] [Created] (YARN-9040) LevelDBCacheTimelineStore in ATS 1.5 leaks native memory

2018-11-20 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-9040: -- Summary: LevelDBCacheTimelineStore in ATS 1.5 leaks native memory Key: YARN-9040 URL: https://issues.apache.org/jira/browse/YARN-9040 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-11-20 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8279: --- Release Note: This issue affects only when IndexedFormat is used for log-aggregation by setting

[jira] [Updated] (YARN-9040) LevelDBCacheTimelineStore in ATS 1.5 leaks native memory

2018-11-20 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9040: --- Attachment: YARN-9040.001.patch > LevelDBCacheTimelineStore in ATS 1.5 leaks native memory >

[jira] [Commented] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694156#comment-16694156 ] Tarun Parimi commented on YARN-9027: Thanks [~Prabhu Joseph] for the patch. I have one comment on the

[jira] [Updated] (YARN-9040) LevelDBCacheTimelineStore in ATS 1.5 leaks native memory

2018-11-21 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9040: --- Attachment: YARN-9040.002.patch > LevelDBCacheTimelineStore in ATS 1.5 leaks native memory >

[jira] [Created] (YARN-9063) ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing

2018-11-27 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-9063: -- Summary: ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing Key: YARN-9063 URL: https://issues.apache.org/jira/browse/YARN-9063 Project: Hadoop YARN

[jira] [Assigned] (YARN-9063) ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing

2018-11-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi reassigned YARN-9063: -- Assignee: Tarun Parimi > ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing

[jira] [Commented] (YARN-8567) Fetching yarn logs fails for long running application if it is not present in timeline store

2019-01-03 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733033#comment-16733033 ] Tarun Parimi commented on YARN-8567: Test failure is unrelated to the patch and YARN-9162 has been

[jira] [Commented] (YARN-8720) CapacityScheduler does not enforce yarn.scheduler.capacity..maximum-allocation-mb/vcores when configured

2018-09-13 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614334#comment-16614334 ] Tarun Parimi commented on YARN-8720: Hi [~sunilg], [~cheersyang]  Thanks a lot for taking a look at

[jira] [Commented] (YARN-8720) CapacityScheduler does not enforce max resource allocation check at queue level

2018-09-14 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614534#comment-16614534 ] Tarun Parimi commented on YARN-8720: [~cheersyang], [~sunilg] . Do you think we also need patch for

[jira] [Updated] (YARN-8720) CapacityScheduler does not enforce max resource allocation check at queue level

2018-09-14 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8720: --- Attachment: YARN-8720-branch-2.8.001.patch > CapacityScheduler does not enforce max resource

[jira] [Commented] (YARN-8720) CapacityScheduler does not enforce max resource allocation check at queue level

2018-09-14 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614529#comment-16614529 ] Tarun Parimi commented on YARN-8720: Thanks for the reviews [~cheersyang] and [~sunilg] >

[jira] [Commented] (YARN-8720) CapacityScheduler does not enforce max resource allocation check at queue level

2018-09-14 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614560#comment-16614560 ] Tarun Parimi commented on YARN-8720: Attached a patch for branch-2.8 > CapacityScheduler does not

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-09-19 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620464#comment-16620464 ] Tarun Parimi commented on YARN-8627: Thanks for the review [~rohithsharma].  I tested for folder path

[jira] [Updated] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-24 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9209: --- Attachment: YARN-9209.001.patch > When nodePartition is not set in Placement Constraints, containers

[jira] [Assigned] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-24 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi reassigned YARN-9209: -- Assignee: Tarun Parimi > When nodePartition is not set in Placement Constraints, containers

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-22 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748891#comment-16748891 ] Tarun Parimi commented on YARN-9209: Hi [~cheersyang], {quote}What if we set it to

[jira] [Updated] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9224: --- Attachment: YARN-9224.002.patch > TimelineDelegationTokenIdentifier.Renewer contacts KDC for every

[jira] [Updated] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9224: --- Attachment: YARN-9224.001.patch > TimelineDelegationTokenIdentifier.Renewer contacts KDC for every

[jira] [Commented] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754031#comment-16754031 ] Tarun Parimi commented on YARN-9224: Attaching a new patch, since I missed handling client.close() in

[jira] [Updated] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-04-01 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9336: --- Attachment: YARN-9336-branch-2.9.001.patch > JobHistoryServer leaks CLOSE_WAIT tcp connections when

[jira] [Reopened] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-04-01 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi reopened YARN-9336: Reopening to submit patch for branch-2.9 again > JobHistoryServer leaks CLOSE_WAIT tcp connections

[jira] [Updated] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-04-02 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9336: --- Attachment: YARN-9336-branch-2.9.003.patch > JobHistoryServer leaks CLOSE_WAIT tcp connections when

[jira] [Updated] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-04-02 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9336: --- Attachment: YARN-9336-branch-2.9.002.patch > JobHistoryServer leaks CLOSE_WAIT tcp connections when

[jira] [Commented] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-04-02 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807440#comment-16807440 ] Tarun Parimi commented on YARN-9336: Reattaching same patch as the build failed due to a maven issue

[jira] [Updated] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-04-02 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9336: --- Attachment: YARN-9336-branch-2.001.patch > JobHistoryServer leaks CLOSE_WAIT tcp connections when

[jira] [Commented] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-04-02 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807607#comment-16807607 ] Tarun Parimi commented on YARN-9336: Hi [~rohithsharma] , I have attached a branch-2.9 patch for

[jira] [Commented] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-04-02 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808365#comment-16808365 ] Tarun Parimi commented on YARN-9336: The build seems to run in branch-2 properly for the same patch.

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-03-26 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801553#comment-16801553 ] Tarun Parimi commented on YARN-9209: Hi [~cheersyang] , Sorry for getting back quite a bit late to

[jira] [Created] (YARN-9458) Yarn logs command should be able to fetch logs of service applications with just app name

2019-04-08 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-9458: -- Summary: Yarn logs command should be able to fetch logs of service applications with just app name Key: YARN-9458 URL: https://issues.apache.org/jira/browse/YARN-9458

[jira] [Updated] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-02-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9336: --- Attachment: YARN-9336.001.patch > JobHistoryServer leaks CLOSE_WAIT tcp connections when using >

[jira] [Updated] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-02-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9336: --- Description: The JobHistoryServer is leaking CLOSE_WAIT connections to DataNodes whenever viewing a

[jira] [Created] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-02-28 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-9336: -- Summary: JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController Key: YARN-9336 URL: https://issues.apache.org/jira/browse/YARN-9336

[jira] [Commented] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-02-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780584#comment-16780584 ] Tarun Parimi commented on YARN-9336: Fixed checkstyle issue. I don't think we can add a unit test for

[jira] [Updated] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-02-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9336: --- Attachment: YARN-9336.002.patch > JobHistoryServer leaks CLOSE_WAIT tcp connections when using >

[jira] [Created] (YARN-9334) YARN Service Client does not work with SPNEGO when knox is configured

2019-02-26 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-9334: -- Summary: YARN Service Client does not work with SPNEGO when knox is configured Key: YARN-9334 URL: https://issues.apache.org/jira/browse/YARN-9334 Project: Hadoop YARN

[jira] [Updated] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-02-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9224: --- Attachment: YARN-9224.003.patch > TimelineDelegationTokenIdentifier.Renewer contacts KDC for every

[jira] [Commented] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-02-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780172#comment-16780172 ] Tarun Parimi commented on YARN-9224: [~rohithsharma], attached a new patch which synchronizes the

[jira] [Assigned] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-02-27 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi reassigned YARN-9224: -- Assignee: Tarun Parimi > TimelineDelegationTokenIdentifier.Renewer contacts KDC for every

[jira] [Commented] (YARN-8617) Aggregated Application Logs accumulates for long running jobs

2019-03-12 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790508#comment-16790508 ] Tarun Parimi commented on YARN-8617: Hi [~bibinchundatt], I was also facing this issue and on testing

[jira] [Commented] (YARN-9336) JobHistoryServer leaks CLOSE_WAIT tcp connections when using LogAggregationIndexedFileController

2019-03-12 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790703#comment-16790703 ] Tarun Parimi commented on YARN-9336: Thanks for the review and commit [~rohithsharma] >

  1   2   3   >