[jira] [Updated] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-03-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6382: - Description: YARN-6376 fixes the race condition between putEntities() and periodical flush() by

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939379#comment-15939379 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939380#comment-15939380 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939384#comment-15939384 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939369#comment-15939369 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939371#comment-15939371 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939374#comment-15939374 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939377#comment-15939377 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939372#comment-15939372 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939376#comment-15939376 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939382#comment-15939382 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939370#comment-15939370 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939383#comment-15939383 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939373#comment-15939373 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939375#comment-15939375 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939378#comment-15939378 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939381#comment-15939381 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939207#comment-15939207 ] Carlo Curino commented on YARN-6363: [~wangda], that is definitely something I plan to do. I will post

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939146#comment-15939146 ] Karthik Kambatla commented on YARN-6050: +1 pending Jenkins. [~leftnoteasy] - do you want to take

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-23 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939392#comment-15939392 ] Jonathan Hung commented on YARN-5952: - Thanks [~xgong]. 005 patch changes 'name' to 'queueName' when

[jira] [Updated] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-23 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5952: Attachment: YARN-5952-YARN-5734.005.patch > Create REST API for changing YARN scheduler

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-03-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939235#comment-15939235 ] Eric Payne commented on YARN-5892: -- Thanks for your comments, [~sunilg]. bq. Is it possible to keep

[jira] [Updated] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6050: Attachment: YARN-6050.014.patch The 014 patch addresses [~kasha]'s minor changes from RB. > AMs

[jira] [Commented] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-23 Thread Sonia Garudi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937959#comment-15937959 ] Sonia Garudi commented on YARN-6141: Any update on this ? > ppc64le on Linux doesn't trigger __linux

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939408#comment-15939408 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939405#comment-15939405 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939427#comment-15939427 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler

2017-03-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939440#comment-15939440 ] Yufei Gu commented on YARN-5654: Uploaded patch v2. # Remove class {{ResourceSchedulerWrapper}}. We

[jira] [Commented] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939497#comment-15939497 ] Miklos Szegedi commented on YARN-6246: -- Thank you for the patch [~kasha]. shouldAttemptPreemption()

[jira] [Updated] (YARN-6385) Fix warnings caused by TestFileSystemApplicationHistoryStore

2017-03-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated YARN-6385: Attachment: YARN-6385.001.patch > Fix warnings caused by TestFileSystemApplicationHistoryStore >

[jira] [Updated] (YARN-6385) Fix warnings caused by TestFileSystemApplicationHistoryStore

2017-03-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated YARN-6385: Attachment: (was: YARN-6385.001.patch) > Fix warnings caused by TestFileSystemApplicationHistoryStore >

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939400#comment-15939400 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Created] (YARN-6383) Not be able to run SLS with FifoScheduler

2017-03-23 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6383: -- Summary: Not be able to run SLS with FifoScheduler Key: YARN-6383 URL: https://issues.apache.org/jira/browse/YARN-6383 Project: Hadoop YARN Issue Type: New Feature

[jira] [Updated] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6352: Affects Version/s: (was: 3.0.0-alpha2) > Header injections are possible in the

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939428#comment-15939428 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Updated] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6352: Attachment: YARN-6352-branch-2.002.patch Thanks [~varun_saxena], bq. Apps#toAppId looks

[jira] [Commented] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939541#comment-15939541 ] Hadoop QA commented on YARN-6352: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939413#comment-15939413 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Updated] (YARN-5654) Not be able to run SLS with FairScheduler

2017-03-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5654: --- Attachment: YARN-5654.002.patch > Not be able to run SLS with FairScheduler >

[jira] [Updated] (YARN-6383) Not be able to run SLS with FifoScheduler

2017-03-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6383: --- Issue Type: Sub-task (was: New Feature) Parent: YARN-5065 > Not be able to run SLS with FifoScheduler

[jira] [Updated] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-03-23 Thread dengkai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dengkai updated YARN-6384: -- Description: When using cgroups on yarn, if

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939404#comment-15939404 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-5654) Not be able to run SLS with FairScheduler

2017-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939463#comment-15939463 ] Hadoop QA commented on YARN-5654: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939471#comment-15939471 ] Hadoop QA commented on YARN-5952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939544#comment-15939544 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-6385) Fix warnings caused by TestFileSystemApplicationHistoryStore

2017-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939739#comment-15939739 ] Hadoop QA commented on YARN-6385: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2113: -- Attachment: YARN-2113.0001.patch Attaching updated patch. > Add cross-user preemption within

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939394#comment-15939394 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939424#comment-15939424 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939419#comment-15939419 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Comment Edited] (YARN-5654) Not be able to run SLS with FairScheduler

2017-03-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939440#comment-15939440 ] Yufei Gu edited comment on YARN-5654 at 3/23/17 11:38 PM: -- Uploaded patch v2. #

[jira] [Comment Edited] (YARN-5654) Not be able to run SLS with FairScheduler

2017-03-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939440#comment-15939440 ] Yufei Gu edited comment on YARN-5654 at 3/23/17 11:57 PM: -- Uploaded patch v2. #

[jira] [Created] (YARN-6385) Fix warnings caused by TestFileSystemApplicationHistoryStore

2017-03-23 Thread Yiqun Lin (JIRA)
Yiqun Lin created YARN-6385: --- Summary: Fix warnings caused by TestFileSystemApplicationHistoryStore Key: YARN-6385 URL: https://issues.apache.org/jira/browse/YARN-6385 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939430#comment-15939430 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939437#comment-15939437 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939470#comment-15939470 ] Robert Kanter commented on YARN-6050: - Test failures unrelated. > AMs can't be scheduled on racks or

[jira] [Commented] (YARN-6372) Add default value for NM disk validator

2017-03-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939502#comment-15939502 ] Miklos Szegedi commented on YARN-6372: -- Thank you for the patch [~yufeigu]. It is not related to the

[jira] [Created] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-03-23 Thread dengkai (JIRA)
dengkai created YARN-6384: - Summary: Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups Key: YARN-6384 URL: https://issues.apache.org/jira/browse/YARN-6384 Project: Hadoop

[jira] [Updated] (YARN-6385) Fix warnings caused by TestFileSystemApplicationHistoryStore

2017-03-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated YARN-6385: Attachment: YARN-6385.001.patch > Fix warnings caused by TestFileSystemApplicationHistoryStore >

[jira] [Commented] (YARN-6380) FSAppAttempt keeps redundant copy of the queue

2017-03-23 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939735#comment-15939735 ] Tao Jie commented on YARN-6380: --- [~templedf], in current FSAppAttempt constructor: {code} public

[jira] [Commented] (YARN-6372) Add default value for NM disk validator

2017-03-23 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939766#comment-15939766 ] Yufei Gu commented on YARN-6372: Good catch! I'll update patch soon. > Add default value for NM disk

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939423#comment-15939423 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939426#comment-15939426 ] Wangda Tan commented on YARN-5952: -- [~jhung], thanks for the patch, plz give me a few days to try and

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939466#comment-15939466 ] Hadoop QA commented on YARN-6050: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6385) Fix warnings caused by TestFileSystemApplicationHistoryStore

2017-03-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated YARN-6385: Description: There are two warnings generated in {{TestFileSystemApplicationHistoryStore}}. {code}

[jira] [Updated] (YARN-6379) Remove unused argument in ClientRMService

2017-03-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6379: Labels: newbie (was: ) > Remove unused argument in ClientRMService >

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939839#comment-15939839 ] Hadoop QA commented on YARN-2113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6255) Refactor yarn-native-services framework

2017-03-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6255: -- Attachment: YARN-6255.yarn-native-services.06.patch fixed some comments from Billie > Refactor

[jira] [Comment Edited] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-23 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937580#comment-15937580 ] Konstantinos Karanasos edited comment on YARN-6344 at 3/23/17 5:35 PM:

[jira] [Updated] (YARN-6377) NMTimelinePublisher#serviceStop does not stop timeline clients

2017-03-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6377: - Attachment: YARN-6377.02.patch > NMTimelinePublisher#serviceStop does not stop timeline clients >

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938932#comment-15938932 ] Wangda Tan commented on YARN-6344: -- +1 for the proposal, and thanks [~kkaranasos] for sharing detailed

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938855#comment-15938855 ] Sunil G commented on YARN-6344: --- Thanks [~kkaranasos]. Its a much needed effort to fast up or correct the

[jira] [Commented] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938910#comment-15938910 ] Haibo Chen commented on YARN-6357: -- bq. We can merely implement the async API here. Sure. Will update the

[jira] [Created] (YARN-6380) FSAppAttempt keeps redundant copy of the queue

2017-03-23 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6380: -- Summary: FSAppAttempt keeps redundant copy of the queue Key: YARN-6380 URL: https://issues.apache.org/jira/browse/YARN-6380 Project: Hadoop YARN Issue

[jira] [Created] (YARN-6381) FSAppAttempt has several variables that should be final

2017-03-23 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6381: -- Summary: FSAppAttempt has several variables that should be final Key: YARN-6381 URL: https://issues.apache.org/jira/browse/YARN-6381 Project: Hadoop YARN

[jira] [Commented] (YARN-6376) Exceptions caused by synchronous putEntities requests can be swallowed in TimelineCollector

2017-03-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938859#comment-15938859 ] Varun Saxena commented on YARN-6376: As discussed in the call, let's just synchronize on writer object.

[jira] [Updated] (YARN-6380) FSAppAttempt keeps redundant copy of the queue

2017-03-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6380: --- Attachment: YARN-6380.001.patch > FSAppAttempt keeps redundant copy of the queue >

[jira] [Commented] (YARN-6146) Add Builder methods for TimelineEntityFilters

2017-03-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938182#comment-15938182 ] Varun Saxena commented on YARN-6146: Committed to YARN-5355 and YARN-5355-branch-2. Thanks Rohith for

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938790#comment-15938790 ] Wangda Tan commented on YARN-6363: -- [~curino], could you add more details of this JIRA, for example, how

[jira] [Created] (YARN-6379) Remove unused argument in ClientRMService

2017-03-23 Thread Kai Sasaki (JIRA)
Kai Sasaki created YARN-6379: Summary: Remove unused argument in ClientRMService Key: YARN-6379 URL: https://issues.apache.org/jira/browse/YARN-6379 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2017-03-23 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938333#comment-15938333 ] Kai Sasaki commented on YARN-5956: -- [~ajisakaa] Thanks. I filed a JIRA as followup.

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2017-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938360#comment-15938360 ] Sunil G commented on YARN-5956: --- Thanks folks. Committing shortly. > Refactor ClientRMService >

[jira] [Commented] (YARN-6377) NMTimelinePublisher#serviceStop does not stop timeline clients

2017-03-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938701#comment-15938701 ] Haibo Chen commented on YARN-6377: -- Thanks for pointing it out, [~varun_saxena]! Will upload a new patch

[jira] [Commented] (YARN-5331) Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem

2017-03-23 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939094#comment-15939094 ] Sean Po commented on YARN-5331: --- Thanks [~ajsangeetha] for the update, a few more comments: * It may be more

[jira] [Commented] (YARN-6376) Exceptions caused by synchronous putEntities requests can be swallowed in TimelineCollector

2017-03-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939093#comment-15939093 ] Haibo Chen commented on YARN-6376: -- Will upload a patch once YARN-6357 is committed > Exceptions caused

[jira] [Updated] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-03-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6382: - Labels: yarn-5355-merge-blocker (was: ) > Address race condition on TimelineWriter.flush() caused by

[jira] [Created] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-03-23 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6382: Summary: Address race condition on TimelineWriter.flush() caused by buffer-sized flush Key: YARN-6382 URL: https://issues.apache.org/jira/browse/YARN-6382 Project: Hadoop

[jira] [Updated] (YARN-6382) Address race condition on TimelineWriter.flush() caused by buffer-sized flush

2017-03-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6382: - Issue Type: Sub-task (was: Bug) Parent: YARN-5355 > Address race condition on

[jira] [Commented] (YARN-6377) NMTimelinePublisher#serviceStop does not stop timeline clients

2017-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938974#comment-15938974 ] Hadoop QA commented on YARN-6377: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-23 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938973#comment-15938973 ] Konstantinos Karanasos commented on YARN-6344: -- Thank you for the input, [~sunilg] and

[jira] [Updated] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6357: - Attachment: YARN-6357.03.patch > Implement TimelineCollector#putEntitiesAsync >

[jira] [Commented] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939031#comment-15939031 ] Hadoop QA commented on YARN-6357: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2017-03-23 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937784#comment-15937784 ] Akira Ajisaka commented on YARN-5956: - +1 LGTM. I found the argument of checkReservationSystem method

[jira] [Assigned] (YARN-6375) App level aggregation should not consider metric values reported in the previous aggregation cycle

2017-03-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-6375: -- Assignee: Varun Saxena > App level aggregation should not consider metric values reported in

[jira] [Commented] (YARN-6342) Issues in async API of TimelineClient

2017-03-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937839#comment-15937839 ] Varun Saxena commented on YARN-6342: bq. I'll leave this jira open to make the wait period configurable

[jira] [Commented] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937850#comment-15937850 ] Varun Saxena commented on YARN-6357: bq. I propose, we replace TimelineResponse with void as the return