[jira] [Commented] (YARN-6395) Integrate service app master to write data into ATSv2.

[ https://issues.apache.org/jira/browse/YARN-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948451#comment-15948451 ] Rohith Sharma K S commented on YARN-6395: - javadoc errors are not related to patch. > Integrate

[jira] [Commented] (YARN-6342) Make TimelineV2Client's drain timeout after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948450#comment-15948450 ] Rohith Sharma K S commented on YARN-6342: - +1 for the patch. would you look at the build failure

[jira] [Updated] (YARN-5468) Scheduling of long-running applications

[ https://issues.apache.org/jira/browse/YARN-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5468: - Attachment: LRA-scheduling-design.v1.pdf Attaching latest design document,

[jira] [Updated] (YARN-6395) Integrate service app master to write data into ATSv2.

[ https://issues.apache.org/jira/browse/YARN-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6395: Attachment: YARN-6395.yarn-native-services.0002.patch updated the patch fixing some of the

[jira] [Issue Comment Deleted] (YARN-6276) Now container kill mechanism may lead process leak

[ https://issues.apache.org/jira/browse/YARN-6276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-6276: Comment: was deleted (was: Add this issue here.In this patch container signal operation will check current

[jira] [Commented] (YARN-6276) Now container kill mechanism may lead process leak

[ https://issues.apache.org/jira/browse/YARN-6276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948427#comment-15948427 ] Feng Yuan commented on YARN-6276: - Add this issue here.In this patch container signal operation will check

[jira] [Commented] (YARN-6277) Nodemanager heap memory leak

[ https://issues.apache.org/jira/browse/YARN-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948417#comment-15948417 ] Feng Yuan commented on YARN-6277: - I have attach a patch,this issue is due to ShuffleHandler and

[jira] [Updated] (YARN-6277) Nodemanager heap memory leak

[ https://issues.apache.org/jira/browse/YARN-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-6277: Attachment: YARN-6277.branch-2.8.001.patch > Nodemanager heap memory leak > > >

[jira] [Commented] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948390#comment-15948390 ] Sonia Garudi commented on YARN-6141: Any update ? > ppc64le on Linux doesn't trigger __linux

[jira] [Updated] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6403: --- Attachment: YARN-6403.002.patch [~jlowe] Thanks for correcting me. The last server-side change is not proper

[jira] [Commented] (YARN-6204) Set UncaughtExceptionHandler for event handling thread in AsyncDispatcher

[ https://issues.apache.org/jira/browse/YARN-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948259#comment-15948259 ] Hadoop QA commented on YARN-6204: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6413) Decouple Yarn Registry API from ZK

Ellen Hui created YARN-6413: --- Summary: Decouple Yarn Registry API from ZK Key: YARN-6413 URL: https://issues.apache.org/jira/browse/YARN-6413 Project: Hadoop YARN Issue Type: Improvement

[jira] [Created] (YARN-6412) aux-services classpath not documented

Miklos Szegedi created YARN-6412: Summary: aux-services classpath not documented Key: YARN-6412 URL: https://issues.apache.org/jira/browse/YARN-6412 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6202) Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded

[ https://issues.apache.org/jira/browse/YARN-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948153#comment-15948153 ] Hadoop QA commented on YARN-6202: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6342) Make TimelineV2Client's drain timeout after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948151#comment-15948151 ] Hadoop QA commented on YARN-6342: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948147#comment-15948147 ] Hadoop QA commented on YARN-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6411) Clean up the overwrite of createDispatcher() in subclass of MockRM

Yufei Gu created YARN-6411: -- Summary: Clean up the overwrite of createDispatcher() in subclass of MockRM Key: YARN-6411 URL: https://issues.apache.org/jira/browse/YARN-6411 Project: Hadoop YARN

[jira] [Commented] (YARN-6204) Set UncaughtExceptionHandler for event handling thread in AsyncDispatcher

[ https://issues.apache.org/jira/browse/YARN-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948139#comment-15948139 ] Yufei Gu commented on YARN-6204: Uploaded patch 001. Make {{RMCriticalThreadUncaughtExceptionHandler}}

[jira] [Updated] (YARN-6204) Set UncaughtExceptionHandler for event handling thread in AsyncDispatcher

[ https://issues.apache.org/jira/browse/YARN-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6204: --- Attachment: YARN-6204.001.patch > Set UncaughtExceptionHandler for event handling thread in AsyncDispatcher >

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948131#comment-15948131 ] Hadoop QA commented on YARN-5797: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler

[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948112#comment-15948112 ] Yufei Gu commented on YARN-5654: Great! Thanks [~rkanter] for the review and commit! > Not be able to run

[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler

[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948110#comment-15948110 ] Hudson commented on YARN-5654: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11493 (See

[jira] [Commented] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948109#comment-15948109 ] Hadoop QA commented on YARN-6004: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6356) Allow different values of yarn.log-aggregation.retain-seconds for succeeded and failed jobs

[ https://issues.apache.org/jira/browse/YARN-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6356: Assignee: Haibo Chen > Allow different values of yarn.log-aggregation.retain-seconds for succeeded

[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler

[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948070#comment-15948070 ] Robert Kanter commented on YARN-5654: - +1 > Not be able to run SLS with FairScheduler >

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948062#comment-15948062 ] Chris Trezzo commented on YARN-5797: Patch is now available for YARN-6004 as well. Thanks! > Add

[jira] [Updated] (YARN-6342) Make TimelineV2Client's drain timeout after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6342: - Attachment: YARN-6342.01.patch > Make TimelineV2Client's drain timeout after stop configurable >

[jira] [Commented] (YARN-6354) LeveldbRMStateStore can parse invalid keys when recovering reservations

[ https://issues.apache.org/jira/browse/YARN-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948050#comment-15948050 ] Hadoop QA commented on YARN-6354: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6342) Make TimelineV2Client's drain timeout after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6342: - Summary: Make TimelineV2Client's drain timeout after stop configurable (was: Make TimelineV2Client's

[jira] [Updated] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

[ https://issues.apache.org/jira/browse/YARN-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-6004: --- Attachment: YARN-6004-trunk.002.patch Attached is v2 for trunk to address checkstyle issues. >

[jira] [Commented] (YARN-6342) Make TimelineV2Client's drain period after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948024#comment-15948024 ] Haibo Chen commented on YARN-6342: -- Thanks for your review, [~varun_saxena]! bq. We need to add this

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948016#comment-15948016 ] Subru Krishnan commented on YARN-6363: -- Thanks [~curino] for working on this really useful extension

[jira] [Assigned] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-5106: -- Assignee: (was: Yufei Gu) > Provide a builder interface for FairScheduler allocations for use in

[jira] [Updated] (YARN-6202) Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded

[ https://issues.apache.org/jira/browse/YARN-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6202: --- Description: Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY (yarn.dispatcher.exit-on-error) always be true no matter

[jira] [Commented] (YARN-6202) Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded

[ https://issues.apache.org/jira/browse/YARN-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948001#comment-15948001 ] Yufei Gu commented on YARN-6202: Uploaded patch v1. Remove configuration items:

[jira] [Updated] (YARN-6202) Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded

[ https://issues.apache.org/jira/browse/YARN-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6202: --- Attachment: YARN-6202.001.patch > Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded >

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947980#comment-15947980 ] Carlo Curino commented on YARN-6363: v4 of the patch contains correct command-line scripts to run the

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363.v4.patch > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: YARN-6363 overview.pdf Minor fix in doc (commandline param) > Extending SLS: Synthetic

[jira] [Updated] (YARN-6363) Extending SLS: Synthetic Load Generator

[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6363: --- Attachment: (was: YARN-6363 overview.pdf) > Extending SLS: Synthetic Load Generator >

[jira] [Updated] (YARN-6354) LeveldbRMStateStore can parse invalid keys when recovering reservations

[ https://issues.apache.org/jira/browse/YARN-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6354: - Attachment: YARN-6354.001.patch Patch that adds a termination check for the reservation key traversal loop

[jira] [Assigned] (YARN-6354) LeveldbRMStateStore can parse invalid keys when recovering reservations

[ https://issues.apache.org/jira/browse/YARN-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-6354: Assignee: Jason Lowe > LeveldbRMStateStore can parse invalid keys when recovering reservations >

[jira] [Commented] (YARN-5301) NM mount cpu cgroups failed on some systems

[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947957#comment-15947957 ] Miklos Szegedi commented on YARN-5301: -- [~bibinchundatt], do you have time to take a look? > NM mount

[jira] [Commented] (YARN-6407) Improve and fix locks of RM scheduler

[ https://issues.apache.org/jira/browse/YARN-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947955#comment-15947955 ] Karthik Kambatla commented on YARN-6407: On large clusters, we have been recommending our customers

[jira] [Commented] (YARN-6342) Make TimelineV2Client's drain period after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947892#comment-15947892 ] Varun Saxena commented on YARN-6342: Thanks [~haibochen] for the patch. It looks good to me in

[jira] [Commented] (YARN-5301) NM mount cpu cgroups failed on some systems

[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947891#comment-15947891 ] Hadoop QA commented on YARN-5301: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947886#comment-15947886 ] Xuan Gong commented on YARN-6109: - Thanks for the comments. [~subru]. After carefully investigation, I

[jira] [Commented] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947841#comment-15947841 ] Daniel Templeton commented on YARN-6302: LGTM. Can you please post a patch to the JIRA so that

[jira] [Commented] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947838#comment-15947838 ] ASF GitHub Bot commented on YARN-6302: -- Github user szegedim commented on a diff in the pull request:

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some systems

[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Attachment: YARN-5301.001.patch Fixing checkstyle issues. > NM mount cpu cgroups failed on some

[jira] [Commented] (YARN-5301) NM mount cpu cgroups failed on some systems

[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947816#comment-15947816 ] Hadoop QA commented on YARN-5301: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6246) Identifying starved apps does not need the scheduler writelock

[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947815#comment-15947815 ] Daniel Templeton commented on YARN-6246: Thanks, [~kasha]. Looking at the patch, I'm concerned

[jira] [Commented] (YARN-6342) Make TimelineV2Client's drain period after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947809#comment-15947809 ] Hadoop QA commented on YARN-6342: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5685) RM configuration allows all failover methods to disabled when automatic failover is enabled

[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947797#comment-15947797 ] Hudson commented on YARN-5685: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11491 (See

[jira] [Updated] (YARN-6200) Revert YARN-5068

[ https://issues.apache.org/jira/browse/YARN-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6200: - Fix Version/s: (was: 2.8.1) > Revert YARN-5068 > > > Key: YARN-6200 >

[jira] [Commented] (YARN-3427) Remove deprecated methods from ResourceCalculatorProcessTree

[ https://issues.apache.org/jira/browse/YARN-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947789#comment-15947789 ] Daniel Templeton commented on YARN-3427: The methods were made public in 2.7 specifically for Tez,

[jira] [Created] (YARN-6410) FSContext.scheduler should be final

Daniel Templeton created YARN-6410: -- Summary: FSContext.scheduler should be final Key: YARN-6410 URL: https://issues.apache.org/jira/browse/YARN-6410 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3427) Remove deprecated methods from ResourceCalculatorProcessTree

[ https://issues.apache.org/jira/browse/YARN-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947786#comment-15947786 ] Siddharth Seth commented on YARN-3427: -- >From a Tez perspective, would prefer if the methods were left

[jira] [Moved] (YARN-6409) RM does not blacklist node for AM launch failures

[ https://issues.apache.org/jira/browse/YARN-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen moved MAPREDUCE-6872 to YARN-6409: - Affects Version/s: (was: 3.0.0-alpha2)

[jira] [Updated] (YARN-5685) RM configuration allows all failover methods to disabled when automatic failover is enabled

[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5685: --- Summary: RM configuration allows all failover methods to disabled when automatic failover is

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some systems

[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Summary: NM mount cpu cgroups failed on some systems (was: NM mount cpu cgroups failed on some

[jira] [Updated] (YARN-5685) RM allows all failover methods to disabled when automatic failover is enabled

[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5685: --- Summary: RM allows all failover methods to disabled when automatic failover is enabled (was:

[jira] [Updated] (YARN-5301) NM mount cpu cgroups failed on some system

[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5301: - Attachment: YARN-5301.000.patch The attached patch fixes the issue by identifying any premounted

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947763#comment-15947763 ] Hadoop QA commented on YARN-5952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947730#comment-15947730 ] Jason Lowe commented on YARN-6195: -- Latest patch lgtm, with the caveat that I don't think we can really

[jira] [Commented] (YARN-6376) Exceptions caused by synchronous putEntities requests can be swallowed

[ https://issues.apache.org/jira/browse/YARN-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947723#comment-15947723 ] Hadoop QA commented on YARN-6376: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6342) Make TimelineV2Client's drain period after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947719#comment-15947719 ] Haibo Chen commented on YARN-6342: -- Upload a simple patch to make the drain period configurable. We could

[jira] [Updated] (YARN-6342) Make TimelineV2Client's drain period after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6342: - Attachment: YARN-6342.00.patch > Make TimelineV2Client's drain period after stop configurable >

[jira] [Updated] (YARN-6342) Make TimelineV2Client's drain period after stop configurable

[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6342: - Summary: Make TimelineV2Client's drain period after stop configurable (was: Issues in async API of

[jira] [Commented] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947706#comment-15947706 ] ASF GitHub Bot commented on YARN-6302: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-6302) Fail the node, if Linux Container Executor is not configured properly

[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947687#comment-15947687 ] ASF GitHub Bot commented on YARN-6302: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5478) [YARN-4902] Define Java API for generalized & unified scheduling-strategies.

[ https://issues.apache.org/jira/browse/YARN-5478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947674#comment-15947674 ] Naganarasimha G R commented on YARN-5478: - Had offline discussion with the above two points with

[jira] [Commented] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947664#comment-15947664 ] Hadoop QA commented on YARN-3760: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6361) FairScheduler: FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6361: --- Description: FSLeafQueue.fetchAppsWithDemand sorts the applications by the current policy. Most of the time is

[jira] [Commented] (YARN-6401) terminating signal should be able to specify per application to support graceful-stop

[ https://issues.apache.org/jira/browse/YARN-6401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947656#comment-15947656 ] Jason Lowe commented on YARN-6401: -- Ah, sorry. I was thinking it was ignoring SIGTERM and thus not

[jira] [Commented] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

[ https://issues.apache.org/jira/browse/YARN-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947652#comment-15947652 ] Carlo Curino commented on YARN-6408: It looks like the userName was probably removed (last app for this

[jira] [Commented] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

[ https://issues.apache.org/jira/browse/YARN-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947650#comment-15947650 ] Sunil G commented on YARN-6408: --- I will help to take a look. It seems we got NPE from here

[jira] [Updated] (YARN-6376) Exceptions caused by synchronous putEntities requests can be swallowed

[ https://issues.apache.org/jira/browse/YARN-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6376: - Attachment: YARN-6376.00.patch > Exceptions caused by synchronous putEntities requests can be swallowed >

[jira] [Assigned] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

[ https://issues.apache.org/jira/browse/YARN-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6382: Assignee: Haibo Chen > Address race condition on TimelineWriter.flush() caused by buffer-sized

[jira] [Updated] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

[ https://issues.apache.org/jira/browse/YARN-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6408: --- Attachment: YARN-6408.v0.patch > NPE in handling NODE_UPDATE (while running SLS) >

[jira] [Updated] (YARN-6376) Exceptions caused by synchronous putEntities requests can be swallowed

[ https://issues.apache.org/jira/browse/YARN-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6376: - Summary: Exceptions caused by synchronous putEntities requests can be swallowed (was: Exceptions caused

[jira] [Commented] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

[ https://issues.apache.org/jira/browse/YARN-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947638#comment-15947638 ] Carlo Curino commented on YARN-6408: After a 2 hours running SLS (with YARN-6363 synth generator), I

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947633#comment-15947633 ] Jonathan Hung commented on YARN-5952: - 008 patch preserves the capacity-scheduler.xml in the

[jira] [Created] (YARN-6408) NPE in handling NODE_UPDATE (while running SLS)

Carlo Curino created YARN-6408: -- Summary: NPE in handling NODE_UPDATE (while running SLS) Key: YARN-6408 URL: https://issues.apache.org/jira/browse/YARN-6408 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5952) Create REST API for changing YARN scheduler configurations

[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5952: Attachment: YARN-5952-YARN-5734.008.patch > Create REST API for changing YARN scheduler

[jira] [Updated] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-3760: - Attachment: YARN-3760.00.patch > FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close() >

[jira] [Updated] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-3760: - Target Version/s: 2.8.1, 3.0.0-alpha3 (was: 2.8.0) > FSDataOutputStream leak in

[jira] [Updated] (YARN-3760) FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close()

[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-3760: - Summary: FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close() (was: Log aggregation failures

[jira] [Commented] (YARN-3760) Log aggregation failures

[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947608#comment-15947608 ] Haibo Chen commented on YARN-3760: -- bq. the ctor creates the fs data stream then a TFile.Writer w/o a

[jira] [Assigned] (YARN-3760) Log aggregation failures

[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-3760: Assignee: Haibo Chen > Log aggregation failures > - > >

[jira] [Commented] (YARN-6407) Improve and fix locks of RM scheduler

[ https://issues.apache.org/jira/browse/YARN-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947594#comment-15947594 ] Yufei Gu commented on YARN-6407: Hi [~zhengchenyu], thanks for filing this jira. IIUC, you reduced

[jira] [Commented] (YARN-6407) Improve and fix locks of RM scheduler

[ https://issues.apache.org/jira/browse/YARN-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947567#comment-15947567 ] Daniel Templeton commented on YARN-6407: YARN-3091 just replaced {{synchronized}} with a read/write

[jira] [Reopened] (YARN-3760) Log aggregation failures

[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reopened YARN-3760: --- Line numbers are from an old release but the error is evident. {code} java.lang.IllegalStateException:

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947326#comment-15947326 ] Jason Lowe commented on YARN-6168: -- This sounds like the RM isn't waiting long enough for all the live NMs

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947305#comment-15947305 ] Billie Rinaldi commented on YARN-6168: -- Yes. In my case, the AM requested new containers immediately

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947283#comment-15947283 ] Jason Lowe commented on YARN-6403: -- Sorry, I completely missed the server-side change in ContainerImpl.

[jira] [Commented] (YARN-6400) Remove some unneeded code after YARN-6255

[ https://issues.apache.org/jira/browse/YARN-6400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947260#comment-15947260 ] Billie Rinaldi commented on YARN-6400: -- +1 for cleanup > Remove some unneeded code after YARN-6255 >

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947251#comment-15947251 ] Jason Lowe commented on YARN-6403: -- Thanks for the patch! This patch is changing the client code but not

[jira] [Updated] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6403: --- Attachment: YARN-6403.001.patch Attach a patch for review. * Add local resources check in

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946975#comment-15946975 ] Hadoop QA commented on YARN-2113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >