[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660264#comment-14660264 ] Hudson commented on YARN-3992: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660260#comment-14660260 ] Hudson commented on YARN-3961: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660256#comment-14660256 ] Hudson commented on YARN-3736: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660265#comment-14660265 ] Hudson commented on YARN-3983: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660826#comment-14660826 ] Li Lu commented on YARN-3906: - Hi [~sjlee0], sorry about the delay. The latest patch LGTM,

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660787#comment-14660787 ] Siqi Li commented on YARN-3176: --- One example could be queueMaxAppsDefault is set to 50, and

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660851#comment-14660851 ] Wangda Tan commented on YARN-4003: -- [~curino], sorry for confusing you. +1 for attached

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660853#comment-14660853 ] Zhijie Shen commented on YARN-3049: --- Here's a quick example: {code} @Test public void

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660852#comment-14660852 ] Wangda Tan commented on YARN-4003: -- And do you think we need add a max-am-percent to

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660689#comment-14660689 ] Siqi Li commented on YARN-2414: --- The latest patch can be applied to 2.6.0 branch cleanly RM

[jira] [Commented] (YARN-3641) NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services.

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660704#comment-14660704 ] Siqi Li commented on YARN-3641: --- The latest patch can be applied to 2.6.0 branch cleanly

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660760#comment-14660760 ] Ashwin Shankar commented on YARN-3176: -- [~l201514], Just trying to understand, what is

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660768#comment-14660768 ] Jian He commented on YARN-3966: --- I went through the code path and cleaned up some logs as

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660895#comment-14660895 ] Siqi Li commented on YARN-3176: --- Considering an other example, grandparent - parent - child

[jira] [Commented] (YARN-3526) ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660686#comment-14660686 ] Siqi Li commented on YARN-3526: --- The latest patch can be applied to 2.6.0 branch cleanly

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660770#comment-14660770 ] Xuan Gong commented on YARN-3966: - Instead of removing the logs, change the log level from

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660790#comment-14660790 ] Carlo Curino commented on YARN-4003: [~leftnoteasy], just to be clear with it makes

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660820#comment-14660820 ] Wangda Tan commented on YARN-3966: -- Patch LGTM, +1. Fix excessive loggings in

[jira] [Commented] (YARN-2997) NM keeps sending already-sent completed containers to RM until containers are removed from context

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660692#comment-14660692 ] Siqi Li commented on YARN-2997: --- The latest patch can be applied to 2.6.0 branch cleanly NM

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660694#comment-14660694 ] Siqi Li commented on YARN-3094: --- The latest patch can be applied to 2.6.0 branch cleanly

[jira] [Updated] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3966: -- Attachment: YARN-3966.1.patch Fix excessive loggings in CapacityScheduler

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660859#comment-14660859 ] Ashwin Shankar commented on YARN-3176: -- bq. In this case, MaxRunningAppEnforcer could

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660867#comment-14660867 ] Vrushali C commented on YARN-3049: -- Hi [~zjshen] In my experience, that kind of conversion

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660877#comment-14660877 ] Li Lu commented on YARN-3049: - Hi [~vrushalic], I think the conversion to string happens on the

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660902#comment-14660902 ] Li Lu commented on YARN-3049: - A little bit more investigation shows that we're using Strings

[jira] [Created] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-08-06 Thread forrestchen (JIRA)
forrestchen created YARN-4022: - Summary: queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml Key: YARN-4022 URL: https://issues.apache.org/jira/browse/YARN-4022

[jira] [Updated] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-08-06 Thread forrestchen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] forrestchen updated YARN-4022: -- Description: When I delete an existing queue by modify the xxx-schedule.xml, I can still see the queue

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660701#comment-14660701 ] Siqi Li commented on YARN-3485: --- The latest patch can be applied to 2.6.0 branch cleanly

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.008.patch v008 patch, rebase to latest YARN-2928 branch. Refactor

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660819#comment-14660819 ] Jian He commented on YARN-3966: --- The logs I removed are redundant logs with others. Apart

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661251#comment-14661251 ] Siqi Li commented on YARN-3176: --- That makes sense. If you feel like this change is

[jira] [Created] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-06 Thread Vrushali C (JIRA)
Vrushali C created YARN-4025: Summary: Deal with byte representations of Longs in writer code Key: YARN-4025 URL: https://issues.apache.org/jira/browse/YARN-4025 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661312#comment-14661312 ] Rohith Sharma K S commented on YARN-4023: - Thats fine.. YARN-4013 ticket can be

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661314#comment-14661314 ] Rohith Sharma K S commented on YARN-4023: - I mean Jira summary and description.

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661313#comment-14661313 ] Vrushali C commented on YARN-3049: -- Filed https://issues.apache.org/jira/browse/YARN-4025

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661345#comment-14661345 ] Rohith Sharma K S commented on YARN-3948: - Thanks [~jianhe] for review!! Display

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Summary: FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource

[jira] [Created] (YARN-4026) FiCaSchedulerApp: Revisit ContainerAllocator interface design

2015-08-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4026: Summary: FiCaSchedulerApp: Revisit ContainerAllocator interface design Key: YARN-4026 URL: https://issues.apache.org/jira/browse/YARN-4026 Project: Hadoop YARN

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: Revisit ContainerAllocator interface design

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Description: After YARN-3983, we have an extensible ContainerAllocator which can be used by

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661286#comment-14661286 ] Rohith Sharma K S commented on YARN-3948: - latest patch looks good to me.. I will

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661298#comment-14661298 ] Rohith Sharma K S commented on YARN-4023: - [~sunilg] Does this JIRA handles for V1

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661315#comment-14661315 ] Jian He commented on YARN-3948: --- looks good to me too. thanks [~sunilg] and [~rohithsharma] !

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661343#comment-14661343 ] Hudson commented on YARN-3948: -- FAILURE: Integrated in Hadoop-trunk-Commit #8277 (See

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Description: After YARN-3983, we have an extensible ContainerAllocator which can be used by

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661310#comment-14661310 ] Sunil G commented on YARN-4023: --- Thanks [~rohithsharma]. I planned this one for Timeline V1.

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660952#comment-14660952 ] Zhijie Shen commented on YARN-3049: --- As the issue is not blocking the whole reader

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661012#comment-14661012 ] Sangjin Lee commented on YARN-3049: --- Yes, +1 with proceeding with this patch and

[jira] [Commented] (YARN-221) NM should provide a way for AM to tell it not to aggregate logs.

2015-08-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661140#comment-14661140 ] Ming Ma commented on YARN-221: -- My main motivation of reusing ContainerTerminationContext is to

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661153#comment-14661153 ] Ashwin Shankar commented on YARN-3176: -- It depends on the use case, if a user has lots

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661186#comment-14661186 ] Sunil G commented on YARN-4003: --- HI [~curino] [~leftnoteasy] Sorry for coming in this late.

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660935#comment-14660935 ] Li Lu commented on YARN-3049: - bq. Also, to Li Lu's point, we should provide an additional api

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661007#comment-14661007 ] Li Lu commented on YARN-3049: - I checked EntityRowKey.java and seems like we never convert

[jira] [Commented] (YARN-221) NM should provide a way for AM to tell it not to aggregate logs.

2015-08-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661122#comment-14661122 ] Xuan Gong commented on YARN-221: Looks like ContainerTerminationContext is for

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660923#comment-14660923 ] Vrushali C commented on YARN-3049: -- It looks like the conversion back to String was done

[jira] [Commented] (YARN-3962) If we change node manager identity to run as virtual account, then resource localization service fails to start with incorrect permission

2015-08-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661004#comment-14661004 ] Chris Nauroth commented on YARN-3962: - This looks good to me. I agree with Xuan that

[jira] [Resolved] (YARN-4016) docker container is still running when app is killed

2015-08-06 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved YARN-4016. Resolution: Duplicate Hong! Please reopen if you find that it hasn't been fixed in trunk docker

[jira] [Updated] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3906: -- Attachment: YARN-3906-YARN-2928.005.patch v.5 patch posted. Adjusted for YARN-3984. Also updated the

[jira] [Commented] (YARN-3223) Resource update during NM graceful decommission

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660930#comment-14660930 ] Junping Du commented on YARN-3223: -- Hi [~brookz], I think [~varun_saxena] hasn't start

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660948#comment-14660948 ] Siqi Li commented on YARN-3176: --- for that, we can maybe introduce something like a default as

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660991#comment-14660991 ] Vrushali C commented on YARN-3049: -- bq. I'm worried that Bytes.toString() doesn't make the

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661106#comment-14661106 ] Sangjin Lee commented on YARN-3906: --- I'll update the patch shortly. However, I think

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660925#comment-14660925 ] Ashwin Shankar commented on YARN-3176: -- Yes, this is valid case when inheriting would

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660987#comment-14660987 ] Vrushali C commented on YARN-3049: -- Yes I will take that jira up. [Storage

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661124#comment-14661124 ] Hadoop QA commented on YARN-3966: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661086#comment-14661086 ] Hadoop QA commented on YARN-3904: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661154#comment-14661154 ] Hadoop QA commented on YARN-3906: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3961: -- Affects Version/s: 2.7.2 Expose pending, running and reserved containers of a queue in REST api and

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659551#comment-14659551 ] Arun Suresh commented on YARN-3961: --- +1, Thanks for the patch [~adhoot] Committing this

[jira] [Updated] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3961: -- Summary: Expose pending, running and reserved containers of a queue in REST api and yarn top (was:

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659559#comment-14659559 ] Hudson commented on YARN-3961: -- FAILURE: Integrated in Hadoop-trunk-Commit #8271 (See

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659937#comment-14659937 ] Junping Du commented on YARN-3045: -- bq. The first patch was put up in April and later

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659989#comment-14659989 ] Hudson commented on YARN-3961: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659985#comment-14659985 ] Hudson commented on YARN-3736: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659993#comment-14659993 ] Hudson commented on YARN-3992: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659994#comment-14659994 ] Hudson commented on YARN-3983: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659829#comment-14659829 ] Junping Du commented on YARN-3045: -- The Jenkins test wasn't triggered for some reason.

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659943#comment-14659943 ] Hadoop QA commented on YARN-3948: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660326#comment-14660326 ] Sunil G commented on YARN-3948: --- When I open the FindBugs report, its shows 0 warning. Hence

[jira] [Created] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Sunil G (JIRA)
Sunil G created YARN-4023: - Summary: Publish Application Priority to TimelineServer Key: YARN-4023 URL: https://issues.apache.org/jira/browse/YARN-4023 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660457#comment-14660457 ] Sunil G commented on YARN-2098: --- Hi [~ashwinshankar77] Yes. YARN-2003 is committed. It has

[jira] [Commented] (YARN-3974) Refactor the reservation system test cases to use parameterized base test

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660538#comment-14660538 ] Hudson commented on YARN-3974: -- FAILURE: Integrated in Hadoop-trunk-Commit #8275 (See

[jira] [Commented] (YARN-3974) Refactor the reservation system test cases to use parameterized base test

2015-08-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660541#comment-14660541 ] Subru Krishnan commented on YARN-3974: -- Thanks [~adhoot] for all the feedback and

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660595#comment-14660595 ] Wangda Tan commented on YARN-4024: -- [~zhiguohong], I noticed YARN-4001 after filed

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660651#comment-14660651 ] Siqi Li commented on YARN-3176: --- [~ashwinshankar77], I don't think the sample alloc is a good

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660295#comment-14660295 ] Hudson commented on YARN-3961: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660291#comment-14660291 ] Hudson commented on YARN-3736: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660306#comment-14660306 ] Junping Du commented on YARN-3011: -- Thanks [~varun_saxena] and all for fixing this issue.

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660415#comment-14660415 ] Bikas Saha commented on YARN-3736: -- Sounds good! Add RMStateStore apis to store and load

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-08-06 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660496#comment-14660496 ] Kuhu Shukla commented on YARN-2410: --- Requesting [~nroberts] and [~jlowe] to review the

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660570#comment-14660570 ] zhihai xu commented on YARN-4024: - Does this issue duplicate with YARN-4001? YARN RM

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660299#comment-14660299 ] Hudson commented on YARN-3992: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See

[jira] [Commented] (YARN-4024) YARN RM should avoid resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660546#comment-14660546 ] Wangda Tan commented on YARN-4024: -- Actually, there're two problems we need to solve: 1.

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660607#comment-14660607 ] Wangda Tan commented on YARN-4024: -- Thanks for sharing your thoughts, [~sunilg]. I think

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660619#comment-14660619 ] Sunil G commented on YARN-4024: --- +1. Yes. That will be fine. I feel we can keep unit as mins

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660626#comment-14660626 ] Wei Yan commented on YARN-2098: --- [~sunilg], [~ashwinshankar77]. Sure, will rebase a new one.

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660300#comment-14660300 ] Hudson commented on YARN-3983: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See

[jira] [Created] (YARN-4024) YARN RM should avoid resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4024: Summary: YARN RM should avoid resolving IP when NMs doing heartbeat Key: YARN-4024 URL: https://issues.apache.org/jira/browse/YARN-4024 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660587#comment-14660587 ] Wangda Tan commented on YARN-4024: -- Thanks for pointing YARN-4001, yes, they're same

[jira] [Assigned] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4003: -- Assignee: Carlo Curino ReservationQueue inherit getAMResourceLimit() from LeafQueue, but

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660621#comment-14660621 ] Ashwin Shankar commented on YARN-2098: -- Thanks [~sunilg] ! Hey [~ywskycn], when you

  1   2   >