[jira] [Created] (YARN-2055) Preemtion: Jobs are failing due to AMs are getting launched and killed multiple times

Mayank Bansal created YARN-2055: --- Summary: Preemtion: Jobs are failing due to AMs are getting launched and killed multiple times Key: YARN-2055 URL: https://issues.apache.org/jira/browse/YARN-2055 Proje

[jira] [Updated] (YARN-1986) In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE

[ https://issues.apache.org/jira/browse/YARN-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1986: - Assignee: Hong Zhiguo (was: Sandy Ryza) > In Fifo Scheduler, node heartbeat in between creating app and a

[jira] [Commented] (YARN-2042) String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp()

[ https://issues.apache.org/jira/browse/YARN-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997334#comment-13997334 ] Sandy Ryza commented on YARN-2042: -- +1 > String shouldn't be compared using == in > Queu

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997351#comment-13997351 ] Sunil G commented on YARN-2022: --- Thank you Carlo for the clarifications on am-priority and us

[jira] [Updated] (YARN-2055) Preemption: Jobs are failing due to AMs are getting launched and killed multiple times

[ https://issues.apache.org/jira/browse/YARN-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2055: -- Summary: Preemption: Jobs are failing due to AMs are getting launched and killed multiple times (was: Preemtion

[jira] [Commented] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996965#comment-13996965 ] Jason Lowe commented on YARN-2014: -- HADOOP-7549 added service loading of filesystems, and

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1809: -- Target Version/s: 2.5.0 > Synchronize RM and Generic History Service Web-UIs > -

[jira] [Commented] (YARN-1981) Nodemanager version is not updated when a node reconnects

[ https://issues.apache.org/jira/browse/YARN-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996825#comment-13996825 ] Jonathan Eagles commented on YARN-1981: --- +1. lgtm. Committing to branch-2 and trunk.

[jira] [Created] (YARN-2053) Slider AM fails to restart

Sumit Mohanty created YARN-2053: --- Summary: Slider AM fails to restart Key: YARN-2053 URL: https://issues.apache.org/jira/browse/YARN-2053 Project: Hadoop YARN Issue Type: Bug Componen

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1408: -- Issue Type: Sub-task (was: Bug) Parent: YARN-45 > Preemption caused Inv

[jira] [Commented] (YARN-2055) Preemption: Jobs are failing due to AMs are getting launched and killed multiple times

[ https://issues.apache.org/jira/browse/YARN-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997328#comment-13997328 ] Sunil G commented on YARN-2055: --- Hi Mayank, Is this issue same as YARN-2022 ? > Preemption:

[jira] [Updated] (YARN-1049) ContainerExistStatus should define a status for preempted containers

[ https://issues.apache.org/jira/browse/YARN-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1049: -- Issue Type: Sub-task (was: Bug) Parent: YARN-45 > ContainerExistStatus

[jira] [Commented] (YARN-2053) Slider AM fails to restart

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997461#comment-13997461 ] Steve Loughran commented on YARN-2053: -- {code} {noformat} 14/05/10 17:02:17 INFO appma

[jira] [Updated] (YARN-2053) Slider AM fails to restart: NPE in

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2053: - Summary: Slider AM fails to restart: NPE in (was: Slider AM fails to restart) > Slider AM fails

[jira] [Commented] (YARN-1302) Add AHSDelegationTokenSecretManager for ApplicationHistoryProtocol

[ https://issues.apache.org/jira/browse/YARN-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996627#comment-13996627 ] Zhijie Shen commented on YARN-1302: --- Anyway, leave it open to see whether it is required

[jira] [Updated] (YARN-2056) Disable preemption at Queue level

[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2056: Description: We need to be able to disable preemption at individual queue level (was: If Queue A do

[jira] [Commented] (YARN-2027) YARN ignores host-specific resource requests

[ https://issues.apache.org/jira/browse/YARN-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992900#comment-13992900 ] Chris Riccomini commented on YARN-2027: --- Dug into this a bit more. Not entirely convi

[jira] [Updated] (YARN-2053) Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2053: - Summary: Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllN

[jira] [Updated] (YARN-1368) Common work to re-populate containers’ state into scheduler

[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1368: -- Attachment: YARN-1368.2.patch > Common work to re-populate containers’ state into scheduler > --

[jira] [Updated] (YARN-2053) Slider AM fails to restart

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Mohanty updated YARN-2053: Attachment: yarn-yarn-nodemanager-c6403.ambari.apache.org.log.bak yarn-yarn-resourcem

[jira] [Commented] (YARN-1368) Common work to re-populate containers’ state into scheduler

[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997144#comment-13997144 ] Jian He commented on YARN-1368: --- New patch fixed Wangda's comments and also implemented the s

[jira] [Updated] (YARN-1366) ApplicationMasterService should Resync with the AM upon allocate call after restart

[ https://issues.apache.org/jira/browse/YARN-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-1366: - Attachment: YARN-1366.2.patch Synched up offline with Anubhav for doubts mentioned in previous comment. I made

[jira] [Commented] (YARN-2053) Slider AM fails to restart

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997459#comment-13997459 ] Steve Loughran commented on YARN-2053: -- Note that this AM requests container retention

[jira] [Updated] (YARN-2053) Slider AM fails to restart

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2053: - Description: Slider AppMaster restart fails with the following: {code} org.apache.hadoop.yarn.prot

[jira] [Updated] (YARN-570) Time strings are formated in different timezone

[ https://issues.apache.org/jira/browse/YARN-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-570: --- Component/s: webapp > Time strings are formated in different timezone > ---

[jira] [Commented] (YARN-1515) Ability to dump the container threads and stop the containers in a single RPC

[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997266#comment-13997266 ] Gera Shegalov commented on YARN-1515: - Ok, I can work on CMP.signalContainer and replac

[jira] [Created] (YARN-2057) NPE in RM handling node update while app submission in progress

Steve Loughran created YARN-2057: Summary: NPE in RM handling node update while app submission in progress Key: YARN-2057 URL: https://issues.apache.org/jira/browse/YARN-2057 Project: Hadoop YARN

[jira] [Commented] (YARN-2016) Yarn getApplicationRequest start time range is not honored

[ https://issues.apache.org/jira/browse/YARN-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997114#comment-13997114 ] Junping Du commented on YARN-2016: -- bq. Sorry for missing those merge-backs. A simple unit

[jira] [Commented] (YARN-2057) NPE in RM handling node update while app submission in progress

[ https://issues.apache.org/jira/browse/YARN-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997557#comment-13997557 ] Steve Loughran commented on YARN-2057: -- Stack trace. This is a transient failure -and

[jira] [Created] (YARN-2054) Poor defaults for YARN ZK configs for retries and retry-inteval

Karthik Kambatla created YARN-2054: -- Summary: Poor defaults for YARN ZK configs for retries and retry-inteval Key: YARN-2054 URL: https://issues.apache.org/jira/browse/YARN-2054 Project: Hadoop YARN

[jira] [Commented] (YARN-1938) Kerberos authentication for the timeline server

[ https://issues.apache.org/jira/browse/YARN-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995745#comment-13995745 ] Hadoop QA commented on YARN-1938: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2057) NPE in RM handling node update while app submission in progress

[ https://issues.apache.org/jira/browse/YARN-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997635#comment-13997635 ] Wangda Tan commented on YARN-2057: -- [~ste...@apache.org], I think this is a same issue whi

[jira] [Commented] (YARN-2011) Typo in TestLeafQueue

[ https://issues.apache.org/jira/browse/YARN-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13993395#comment-13993395 ] Junping Du commented on YARN-2011: -- Nice catch, [~airbots]! There is also a warning that f

[jira] [Commented] (YARN-2027) YARN ignores host-specific resource requests

[ https://issues.apache.org/jira/browse/YARN-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997708#comment-13997708 ] Chris Riccomini commented on YARN-2027: --- relaxLocality was set to false. {noformat}

[jira] [Commented] (YARN-1474) Make schedulers services

[ https://issues.apache.org/jira/browse/YARN-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992698#comment-13992698 ] Hadoop QA commented on YARN-1474: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1366) ApplicationMasterService should Resync with the AM upon allocate call after restart

[ https://issues.apache.org/jira/browse/YARN-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997722#comment-13997722 ] Bikas Saha commented on YARN-1366: -- Is there any value in combining the re-register and re

[jira] [Commented] (YARN-2048) List all of the containers of an application from the yarn web

[ https://issues.apache.org/jira/browse/YARN-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996577#comment-13996577 ] Zhijie Shen commented on YARN-2048: --- bq. the only implementation of ApplcationContext is

[jira] [Commented] (YARN-1474) Make schedulers services

[ https://issues.apache.org/jira/browse/YARN-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997792#comment-13997792 ] Tsuyoshi OZAWA commented on YARN-1474: -- Could someone help to start Jenkins job? It se

[jira] [Commented] (YARN-667) Data persisted in RM should be versioned

[ https://issues.apache.org/jira/browse/YARN-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996610#comment-13996610 ] Zhijie Shen commented on YARN-667: -- bq. do you have sense on how possibility it could happe

[jira] [Commented] (YARN-2016) Yarn getApplicationRequest start time range is not honored

[ https://issues.apache.org/jira/browse/YARN-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997187#comment-13997187 ] Venkat Ranganathan commented on YARN-2016: -- [~djp] It would be good to have a uni

[jira] [Updated] (YARN-2036) Document yarn.resourcemanager.hostname in ClusterSetup

[ https://issues.apache.org/jira/browse/YARN-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2036: - Attachment: YARN2036-02.patch First revision based on comments. > Document yarn.resourcemanager.hostname

[jira] [Commented] (YARN-2053) Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997621#comment-13997621 ] Wangda Tan commented on YARN-2053: -- Took a look at related code, I think this problem is c

[jira] [Updated] (YARN-2050) Fix LogCLIHelpers to create the correct FileContext

[ https://issues.apache.org/jira/browse/YARN-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated YARN-2050: -- Attachment: YARN-2050-2.patch Thanks, Jason. You are right. remoteAppLogDir could point to a different type of

[jira] [Commented] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996494#comment-13996494 ] Jason Lowe commented on YARN-2014: -- I did a bit of investigation on this, and the problem

[jira] [Commented] (YARN-2016) Yarn getApplicationRequest start time range is not honored

[ https://issues.apache.org/jira/browse/YARN-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996780#comment-13996780 ] Karthik Kambatla commented on YARN-2016: Sorry for missing those merge-backs. A sim

[jira] [Commented] (YARN-1861) Both RM stuck in standby mode when automatic failover is enabled

[ https://issues.apache.org/jira/browse/YARN-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994014#comment-13994014 ] Karthik Kambatla commented on YARN-1861: I am obviously a +1 because I wrote the pa

[jira] [Commented] (YARN-2016) Yarn getApplicationRequest start time range is not honored

[ https://issues.apache.org/jira/browse/YARN-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994162#comment-13994162 ] Hadoop QA commented on YARN-2016: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1368) Common work to re-populate containers’ state into scheduler

[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997386#comment-13997386 ] Wangda Tan commented on YARN-1368: -- Hi Jian, Thanks for updating your patch, I took a look

[jira] [Updated] (YARN-2055) Preemtion: Jobs are failing due to AMs are getting launched and killed multiple times

[ https://issues.apache.org/jira/browse/YARN-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2055: Description: If Queue A does not have enough capacity to run AM, then AM will borrow capacity from q

[jira] [Resolved] (YARN-2057) NPE in RM handling node update while app submission in progress

[ https://issues.apache.org/jira/browse/YARN-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-2057. -- Resolution: Duplicate > NPE in RM handling node update while app submission in progress > --

[jira] [Commented] (YARN-2057) NPE in RM handling node update while app submission in progress

[ https://issues.apache.org/jira/browse/YARN-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997762#comment-13997762 ] Steve Loughran commented on YARN-2057: -- you're right, the stack trace and scenario -"h

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992711#comment-13992711 ] Hadoop QA commented on YARN-2022: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1976) Tracking url missing http protocol for FAILED application

[ https://issues.apache.org/jira/browse/YARN-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994158#comment-13994158 ] Junping Du commented on YARN-1976: -- Hi [~jianhe], would you mind to review it again? Thx!

[jira] [Commented] (YARN-1368) Common work to re-populate containers’ state into scheduler

[ https://issues.apache.org/jira/browse/YARN-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997132#comment-13997132 ] Jian He commented on YARN-1368: --- New patch uploaded. > Common work to re-populate containers

[jira] [Created] (YARN-2041) Hard to co-locate MR2 and Spark jobs on the same cluster in YARN

Nishkam Ravi created YARN-2041: -- Summary: Hard to co-locate MR2 and Spark jobs on the same cluster in YARN Key: YARN-2041 URL: https://issues.apache.org/jira/browse/YARN-2041 Project: Hadoop YARN

[jira] [Commented] (YARN-2053) Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997804#comment-13997804 ] Jian He commented on YARN-2053: --- Thanks for catching this ! Patch looks good to me, Wangda,

[jira] [Created] (YARN-2061) Revisit logging levels in ZKRMStateStore

Karthik Kambatla created YARN-2061: -- Summary: Revisit logging levels in ZKRMStateStore Key: YARN-2061 URL: https://issues.apache.org/jira/browse/YARN-2061 Project: Hadoop YARN Issue Type: I

[jira] [Commented] (YARN-1975) Used resources shows escaped html in CapacityScheduler and FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13998172#comment-13998172 ] Hudson commented on YARN-1975: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1779 (See [htt

[jira] [Created] (YARN-2062) Too many InvalidStateTransitionExceptions from NodeState.NEW on RM failover

Karthik Kambatla created YARN-2062: -- Summary: Too many InvalidStateTransitionExceptions from NodeState.NEW on RM failover Key: YARN-2062 URL: https://issues.apache.org/jira/browse/YARN-2062 Project:

[jira] [Commented] (YARN-2053) Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts

[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13998324#comment-13998324 ] Wangda Tan commented on YARN-2053: -- Sure, I'll do that, thanks for review! > Slider AM fa

[jira] [Commented] (YARN-2054) Poor defaults for YARN ZK configs for retries and retry-inteval

[ https://issues.apache.org/jira/browse/YARN-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13998337#comment-13998337 ] Sandy Ryza commented on YARN-2054: -- +1 > Poor defaults for YARN ZK configs for retries an