[jira] [Commented] (YARN-4795) ContainerMetrics drops records

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202571#comment-15202571 ] Hadoop QA commented on YARN-4795: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

2016-03-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202592#comment-15202592 ] Wangda Tan commented on YARN-4002: -- [~rohithsharma], [~zhiguohong], Thanks for working on this patch,

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198733#comment-15198733 ] Li Lu commented on YARN-4815: - Fine... My concern is that we do not need to have separate caches for each use

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200536#comment-15200536 ] Karthik Kambatla commented on YARN-4686: bq. Currently it is in the RM start method, but if you

[jira] [Commented] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199400#comment-15199400 ] Steve Loughran commented on YARN-4746: -- looks reasonable. Given all uses of the conversion in these

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197218#comment-15197218 ] Steve Loughran commented on YARN-4820: -- What about 307 redirects? Even if they aren't generated in any

[jira] [Created] (YARN-4835) [YARN-3368] REST API related changes for new Web UI

2016-03-19 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-4835: -- Summary: [YARN-3368] REST API related changes for new Web UI Key: YARN-4835 URL: https://issues.apache.org/jira/browse/YARN-4835 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-4833) For Queue AccessControlException client retries multiple times on both RM

2016-03-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4833: --- Description: Submit application to queue where ACL is enabled and submitted user is not

[jira] [Commented] (YARN-4825) Remove redundant code in ClientRMService::listReservations

2016-03-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200854#comment-15200854 ] Subru Krishnan commented on YARN-4825: -- The test case failures are consistent and unrelated and are

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201868#comment-15201868 ] Varun Saxena commented on YARN-4712: I have committed this to branch YARN-2928. Thanks [~Naganarasimha]

[jira] [Commented] (YARN-4822) Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200526#comment-15200526 ] Hadoop QA commented on YARN-4822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199449#comment-15199449 ] Junping Du commented on YARN-4820: -- Hi [~ste...@apache.org], I think the redirect logic now is return 307

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

2016-03-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198600#comment-15198600 ] Hudson commented on YARN-4108: -- FAILURE: Integrated in Hadoop-trunk-Commit #9470 (See

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202664#comment-15202664 ] Varun Vasudev commented on YARN-4576: - bq. No. DISKS_FAILED mark on bad disks are transient status for

[jira] [Created] (YARN-4834) ProcfsBasedProcessTree doesn't track daemonized processes

2016-03-19 Thread Nathan Roberts (JIRA)
Nathan Roberts created YARN-4834: Summary: ProcfsBasedProcessTree doesn't track daemonized processes Key: YARN-4834 URL: https://issues.apache.org/jira/browse/YARN-4834 Project: Hadoop YARN

[jira] [Assigned] (YARN-4743) ResourceManager crash because TimSort

2016-03-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-4743: -- Assignee: Yufei Gu > ResourceManager crash because TimSort > - > >

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-19 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197925#comment-15197925 ] Lei Guo commented on YARN-3926: --- Another topic related to rm-nm protocol is constraint label. It's not a

[jira] [Updated] (YARN-4825) Remove redundant code in ClientRMService::listReservations

2016-03-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4825: - Attachment: YARN-4825-v1.patch Attaching a patch that removes redundant code. Note: the patch

[jira] [Created] (YARN-4838) TestLogAggregationService. testLocalFileDeletionOnDiskFull failed

2016-03-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-4838: Summary: TestLogAggregationService. testLocalFileDeletionOnDiskFull failed Key: YARN-4838 URL: https://issues.apache.org/jira/browse/YARN-4838 Project: Hadoop YARN

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197956#comment-15197956 ] Vinod Kumar Vavilapalli commented on YARN-2915: --- One thing that occurred to me in an offline

[jira] [Updated] (YARN-4595) Add support for configurable read-only mounts

2016-03-19 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-4595: - Attachment: YARN-4595.2.patch Rebased patch. > Add support for configurable read-only mounts >

[jira] [Commented] (YARN-4839) ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt

2016-03-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201680#comment-15201680 ] Jason Lowe commented on YARN-4839: -- This appears to have been fixed as a side-effect of YARN-3361 which

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200490#comment-15200490 ] Vinod Kumar Vavilapalli commented on YARN-4837: --- Here are my concerns - First up the feature

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.003.patch Good catch. Updated both of them. > Add support for

[jira] [Commented] (YARN-4790) Per user blacklist node for user specific error for container launch failure.

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201156#comment-15201156 ] Vinod Kumar Vavilapalli commented on YARN-4790: --- bq. when enabling LinuxContainerExecutor,

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2016-03-19 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197300#comment-15197300 ] Yi Zhou commented on YARN-796: -- Thanks [~Naganarasimha] > Allow for (admin) labels on nodes and

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197388#comment-15197388 ] Junping Du commented on YARN-4785: -- Thanks [~vvasudev] for explanation. I verified it in branch-2.7 that

[jira] [Updated] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-03-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4062: - Attachment: YARN-4062-YARN-2928.08.patch Attaching patch v8 to address Sangjin’s review comments. bq.

[jira] [Commented] (YARN-4831) Recovered containers will be killed after NM stateful restart

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198512#comment-15198512 ] Hadoop QA commented on YARN-4831: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4595) Add support for configurable read-only mounts

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1518#comment-1518 ] Vinod Kumar Vavilapalli commented on YARN-4595: --- Can this also be the general solution for

[jira] [Commented] (YARN-4839) ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt

2016-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201884#comment-15201884 ] Sunil G commented on YARN-4839: --- I feel that a call to {{RMAppAttemptImpl.getMasterContainer }} is not very

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200138#comment-15200138 ] Hadoop QA commented on YARN-4767: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199611#comment-15199611 ] Junping Du commented on YARN-4815: -- The patch seems out of sync with trunk. [~xgong], can you rebase the

[jira] [Created] (YARN-4836) [YARN-3368] Add AM related pages

2016-03-19 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-4836: -- Summary: [YARN-3368] Add AM related pages Key: YARN-4836 URL: https://issues.apache.org/jira/browse/YARN-4836 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197668#comment-15197668 ] Sunil G commented on YARN-4751: --- Yes, agreeing to the point that we have to aggregate and peek into multiple

[jira] [Commented] (YARN-4839) ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt

2016-03-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201578#comment-15201578 ] Jason Lowe commented on YARN-4839: -- Stack trace of the relevant threads: {noformat} "IPC Server handler 32

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Jayesh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197781#comment-15197781 ] Jayesh commented on YARN-4785: -- +1 ( thanks for explaining the solution in code comment ) > inconsistent

[jira] [Updated] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-4686: -- Attachment: YARN-4686-branch-2.7.006.patch [~eepayne] Attaching the branch-2.7 patch. It passed all of

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197845#comment-15197845 ] Hadoop QA commented on YARN-4686: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200326#comment-15200326 ] Hadoop QA commented on YARN-4829: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-03-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198218#comment-15198218 ] Daniel Templeton commented on YARN-4311: I don't have any further comments. LGTM. > Removing nodes

[jira] [Updated] (YARN-4831) Recovered containers will be killed after NM stateful restart

2016-03-19 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-4831: -- Description: {code} 2016-03-04 19:43:48,130 INFO

[jira] [Commented] (YARN-4517) [YARN-3368] Add nodes page

2016-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199784#comment-15199784 ] Sunil G commented on YARN-4517: --- [~varun_saxena] bq.Regarding node labels, we can add it in REST response

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197345#comment-15197345 ] Junping Du commented on YARN-998: - Thanks Jian for review and comments. bq.

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201139#comment-15201139 ] Vinod Kumar Vavilapalli commented on YARN-4576: --- Please read my comments on YARN-4837, this

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200116#comment-15200116 ] Hudson commented on YARN-4785: -- FAILURE: Integrated in Hadoop-trunk-Commit #9473 (See

[jira] [Updated] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4746: --- Attachment: 0003-YARN-4746.patch [~ste...@apache.org] Thanks you for review.Uploading patch

[jira] [Reopened] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-4390: -- Assignee: Wangda Tan (was: Eric Payne) {quote} Since YARN-4108 doesn't solve all the issues. (I

[jira] [Commented] (YARN-4517) [YARN-3368] Add nodes page

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200211#comment-15200211 ] Varun Saxena commented on YARN-4517: Filed YARN-4835 > [YARN-3368] Add nodes page >

[jira] [Commented] (YARN-4736) Issues with HBaseTimelineWriterImpl

2016-03-19 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198862#comment-15198862 ] Anoop Sam John commented on YARN-4736: -- When one RS is down, those regions in that would get moved to

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198456#comment-15198456 ] Hadoop QA commented on YARN-4829: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-03-19 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201747#comment-15201747 ] Zephyr Guo commented on YARN-4743: -- I am trying to solve the issue, but I am failed. In my opinion, the

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199987#comment-15199987 ] Wangda Tan commented on YARN-4390: -- Thanks [~eepayne]/[~sunilg]. Will add implementation soon. > Consider

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198171#comment-15198171 ] Hadoop QA commented on YARN-4829: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4593) Deadlock in AbstractService.getConfig()

2016-03-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197504#comment-15197504 ] Hudson commented on YARN-4593: -- FAILURE: Integrated in Hadoop-trunk-Commit #9469 (See

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200374#comment-15200374 ] Hadoop QA commented on YARN-4820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-1508) Document Dynamic Resource Configuration feature

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1508: - Summary: Document Dynamic Resource Configuration feature (was: Rename ResourceOption and document

[jira] [Commented] (YARN-4595) Add support for configurable read-only mounts

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200385#comment-15200385 ] Hadoop QA commented on YARN-4595: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201546#comment-15201546 ] Sunil G commented on YARN-4837: --- Thanks [~vinodkv] for pitching in. YARN-2005 blacklists nodes if AM

[jira] [Commented] (YARN-4502) Fix two AM containers get allocated when AM restart

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200423#comment-15200423 ] Vinod Kumar Vavilapalli commented on YARN-4502: --- [~zxu] / [~djp] bq. It looks like the

[jira] [Commented] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201265#comment-15201265 ] Hadoop QA commented on YARN-4746: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4828) Create a pull request template for github

2016-03-19 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-4828: Summary: Create a pull request template for github Key: YARN-4828 URL: https://issues.apache.org/jira/browse/YARN-4828 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201146#comment-15201146 ] Vinod Kumar Vavilapalli commented on YARN-2005: --- -1 for backporting this, while I understand

[jira] [Created] (YARN-4832) NM side resource value should get updated if change applied in RM side

2016-03-19 Thread Junping Du (JIRA)
Junping Du created YARN-4832: Summary: NM side resource value should get updated if change applied in RM side Key: YARN-4832 URL: https://issues.apache.org/jira/browse/YARN-4832 Project: Hadoop YARN

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197561#comment-15197561 ] Hadoop QA commented on YARN-4820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4390: - Attachment: YARN-4390-design.1.pdf Uploaded ver.1 design doc for review. You can jump to "Proposal" part

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197440#comment-15197440 ] Varun Vasudev commented on YARN-3926: - [~asuresh] - I was speaking with [~leftnoteasy] offline. I

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200170#comment-15200170 ] Varun Saxena commented on YARN-2962: bq. Could you also explain in the parameter description why one

[jira] [Updated] (YARN-4336) YARN NodeManager - Container Initialization - Excessive load on NSS/LDAP

2016-03-19 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-4336: Description: Hi folks after performing some debug for our Unix Engineering and Active Directory teams it

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.002.patch Thanks for the review [~asuresh]! Uploaded a new patch

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.004.patch Uploaded a new patch fixing the test failure. > Add

[jira] [Resolved] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2016-03-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-4783. -- Resolution: Won't Fix Resolving as Won't Fix per the above discussion since we don't want to keep an

[jira] [Updated] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4820: Attachment: YARN-4820.002.patch Uploaded a new patch to address the findbugs warnings. >

[jira] [Created] (YARN-4830) Add support for resource types in the nodemanager

2016-03-19 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4830: --- Summary: Add support for resource types in the nodemanager Key: YARN-4830 URL: https://issues.apache.org/jira/browse/YARN-4830 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198410#comment-15198410 ] Karthik Kambatla commented on YARN-4686: On a cursory look, the patch looks reasonable. One thing

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199584#comment-15199584 ] Junping Du commented on YARN-998: - Hi [~jianhe], would you kindly review the patch again? Thanks! >

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199865#comment-15199865 ] Hadoop QA commented on YARN-4785: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4823) Refactor the nested reservation id field in listReservation to simple string field

2016-03-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200852#comment-15200852 ] Subru Krishnan commented on YARN-4823: -- The test case failures are consistent and unrelated and are

[jira] [Updated] (YARN-4835) [YARN-3368] REST API related changes for new Web UI

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4835: --- Description: Following things need to be added for AM related web pages. 1. Support task state query

[jira] [Updated] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-19 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4815: Attachment: YARN-4815.2.patch rebase the patch > ATS 1.5 timelineclinet impl try to create attempt

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202938#comment-15202938 ] Karthik Kambatla commented on YARN-4808: [~leftnoteasy] - will you be able to review this? >

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-03-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200736#comment-15200736 ] Hadoop QA commented on YARN-4062: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4517) [YARN-3368] Add nodes page

2016-03-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199761#comment-15199761 ] Varun Saxena commented on YARN-4517: [~gtCarrera9], as per discussion with Wangda, unification of

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

2016-03-19 Thread Srikanth Kandula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198204#comment-15198204 ] Srikanth Kandula commented on YARN-2965: Go for it :-) We have some dummy code that was good

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197235#comment-15197235 ] Varun Vasudev commented on YARN-4820: - [~steve_l] - sorry I didn't understand the case you mentioned.

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-03-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200414#comment-15200414 ] Sangjin Lee commented on YARN-4062: --- LGTM pending jenkins. I'll commit it once the jenkins comes back

[jira] [Created] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-19 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-4837: - Summary: User facing aspects of 'AM blacklisting' feature need fixing Key: YARN-4837 URL: https://issues.apache.org/jira/browse/YARN-4837 Project:

[jira] [Updated] (YARN-4823) Refactor the nested reservation id field in listReservation to simple string field

2016-03-19 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4823: - Attachment: YARN-4823-v1.patch Attaching a patch that refactors the nested reservation id field in

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200204#comment-15200204 ] Steve Loughran commented on YARN-4820: -- ok, I'm wrong, this is a 307, not a 302 ... ignore everything

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197795#comment-15197795 ] Arun Suresh commented on YARN-4829: --- The patch looks mostly good. Thanks [~vvasudev] Couplo minor nits:

[jira] [Commented] (YARN-4839) ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt

2016-03-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201669#comment-15201669 ] Sangjin Lee commented on YARN-4839: --- Could this be the same issue as pointed out by YARN-4247? We did see

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4830: Component/s: (was: resourcemanager) > Add support for resource types in the nodemanager >

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2016-03-19 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197237#comment-15197237 ] Naganarasimha G R commented on YARN-796: Hi [~jameszhouyi], In 2.6.0 label exclusivity is not

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199809#comment-15199809 ] Junping Du commented on YARN-4785: -- Thanks [~vvasudev], the patch for branch-2.6 and branch-2.7 LGTM. Will

[jira] [Updated] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4746: --- Attachment: 0003-YARN-4746.patch Attaching patch after testcase fix > yarn web services

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198795#comment-15198795 ] Wangda Tan commented on YARN-4390: -- Hi [~eepayne], Since YARN-4108 doesn't solve all the issues. (I

  1   2   >