[jira] [Updated] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5035: --- Attachment: yarn-5035-3.patch Updated patch to use fitsIn. Note that fitsIn checks <= and not

[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301562#comment-15301562 ] Hudson commented on YARN-4866: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9864 (See

[jira] [Comment Edited] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301525#comment-15301525 ] Arun Suresh edited comment on YARN-5035 at 5/26/16 4:52 AM: [~kasha], the patch

[jira] [Commented] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301525#comment-15301525 ] Arun Suresh commented on YARN-5035: --- [~kasha], the patch looks pretty straightforward. Minor comments: #

[jira] [Commented] (YARN-4459) container-executor should only kill process groups

2016-05-25 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301522#comment-15301522 ] Jun Gong commented on YARN-4459: Thanks [~jlowe] for the patch, review and commit! Thanks [~Naganarasimha],

[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301521#comment-15301521 ] Karthik Kambatla commented on YARN-4866: +1. Checking this in. > FairScheduler: AMs can consume

[jira] [Commented] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301516#comment-15301516 ] Karthik Kambatla commented on YARN-5035: The unit test failures are unrelated. [~templedf] - are

[jira] [Commented] (YARN-5082) ContainerId rapidly increased in fair scheduler if the num of node app reserved reached the limit

2016-05-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301514#comment-15301514 ] Arun Suresh commented on YARN-5082: --- LGTM, Will commit it tomorrow if there are no objections.. >

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301512#comment-15301512 ] Arun Suresh commented on YARN-5127: --- Thanks for the patch [~hrsharma] It looks good generally.. Couple

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301503#comment-15301503 ] Hadoop QA commented on YARN-4757: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4271) Make the NodeManager's health checker service pluggable

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301492#comment-15301492 ] Karthik Kambatla commented on YARN-4271: As I see things, YARN-5137 and this JIRA are slightly

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301491#comment-15301491 ] Varun Saxena commented on YARN-5105: bq. Given that we already have the concept of limit to limit the #

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301486#comment-15301486 ] Varun Saxena commented on YARN-5095: Thanks [~sjlee0] for the review and commit. > flow activities and

[jira] [Commented] (YARN-4271) Make the NodeManager's health checker service pluggable

2016-05-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301482#comment-15301482 ] Robert Kanter commented on YARN-4271: - [~rmohan], I think you're mixing up the disk checker with the

[jira] [Updated] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-05-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4757: Attachment: YARN-4757-YARN-4757.001.patch Uploaded the same patch as [~jmaron] with the right naming

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2016-05-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301472#comment-15301472 ] Varun Vasudev commented on YARN-2233: - [~raviprak] - the initial design of delegation tokens required

[jira] [Commented] (YARN-5151) [YARN-3368] Support kill application from new YARN UI

2016-05-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301447#comment-15301447 ] Sunil G commented on YARN-5151: --- I could help on this work item. pls reassign if you have planned on this. >

[jira] [Assigned] (YARN-5151) [YARN-3368] Support kill application from new YARN UI

2016-05-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-5151: - Assignee: Sunil G > [YARN-3368] Support kill application from new YARN UI >

[jira] [Commented] (YARN-5157) TestZKRMStateStore randomly fail

2016-05-25 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301439#comment-15301439 ] Jun Gong commented on YARN-5157: Thanks [~sandflee] for reporting the issue. It seems caused by that ZK

[jira] [Assigned] (YARN-5157) TestZKRMStateStore randomly fail

2016-05-25 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong reassigned YARN-5157: -- Assignee: Jun Gong > TestZKRMStateStore randomly fail > > >

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable

2016-05-25 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301396#comment-15301396 ] Ray Chiang commented on YARN-5137: -- I'm a little confused by the above statement. If we want more places

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301393#comment-15301393 ] Li Lu commented on YARN-5111: - I think I forgot this part in the original patch... My bad. {code} /** *

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301343#comment-15301343 ] Hadoop QA commented on YARN-4957: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301321#comment-15301321 ] Naganarasimha G R commented on YARN-5111: - need to inspect that how better to do it ? > YARN

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable

2016-05-25 Thread Raghav Mohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301304#comment-15301304 ] Raghav Mohan commented on YARN-5137: Certain environments and systems require pluggable DiskChecker

[jira] [Commented] (YARN-4271) Make the NodeManager's health checker service pluggable

2016-05-25 Thread Raghav Mohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301293#comment-15301293 ] Raghav Mohan commented on YARN-4271: There are cases where certain systems and environments require

[jira] [Commented] (YARN-4322) local framwork + io.ReadaheadPool is throwing Failed readahead on ifile EBADF: Bad file descriptor

2016-05-25 Thread liyongjia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301275#comment-15301275 ] liyongjia commented on YARN-4322: - I have encountered this problem. > local framwork + io.ReadaheadPool is

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301268#comment-15301268 ] Hadoop QA commented on YARN-5127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301263#comment-15301263 ] Hadoop QA commented on YARN-5035: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301264#comment-15301264 ] Sangjin Lee commented on YARN-5111: --- Is it possible that the {{realtimeAggregatorOp}} bit was not

[jira] [Created] (YARN-5158) [YARN-3368] Update doc for YARN-UI

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5158: Summary: [YARN-3368] Update doc for YARN-UI Key: YARN-5158 URL: https://issues.apache.org/jira/browse/YARN-5158 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable

2016-05-25 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301234#comment-15301234 ] Ray Chiang commented on YARN-5137: -- [~subru] NodeStatusHealthChecker already has the capability to change

[jira] [Resolved] (YARN-5137) Make DiskChecker pluggable

2016-05-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-5137. -- Resolution: Duplicate I am closing this as a duplicate of YARN-4271 as that covers the pluggable

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-25 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301193#comment-15301193 ] Joep Rottinghuis commented on YARN-5105: While I agree that we can postpone the decision whether to

[jira] [Updated] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5035: --- Hadoop Flags: Incompatible change Release Note: Introducing a new configuration

[jira] [Updated] (YARN-5088) Improve "yarn log" command-line to read the last K bytes for the log files

2016-05-25 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5088: Attachment: YARN-5088.2.patch > Improve "yarn log" command-line to read the last K bytes for the log files >

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-05-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301186#comment-15301186 ] Hudson commented on YARN-4957: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9863 (See

[jira] [Updated] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5035: --- Attachment: yarn-5035-2.patch Updated patch that improves the test and the docs. >

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301177#comment-15301177 ] Hadoop QA commented on YARN-5127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-05-25 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301174#comment-15301174 ] Carlo Curino commented on YARN-4957: Thanks [~seanpo03] for contributing this, and to [~subru] for help

[jira] [Comment Edited] (YARN-5132) Exclude generated protobuf sources from YARN Javadoc build

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301173#comment-15301173 ] Karthik Kambatla edited comment on YARN-5132 at 5/26/16 12:06 AM: -- I see

[jira] [Commented] (YARN-5132) Exclude generated protobuf sources from YARN Javadoc build

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301173#comment-15301173 ] Karthik Kambatla commented on YARN-5132: I see several reasons to get this in: # As Subru, Chris

[jira] [Commented] (YARN-5089) Improve "yarn log" command-line "logFiles" option to support regex

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301164#comment-15301164 ] Hadoop QA commented on YARN-5089: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5127: Attachment: YARN-5127.002.patch > Expose ExecutionType in Container api record >

[jira] [Commented] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301158#comment-15301158 ] Karthik Kambatla commented on YARN-5035: bq. Looks to me like you can never assign the last

[jira] [Commented] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

2016-05-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301156#comment-15301156 ] Sangjin Lee commented on YARN-5095: --- The unit test failures are unrelated (one JIRA here: YARN-5091).

[jira] [Commented] (YARN-5156) YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state

2016-05-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301120#comment-15301120 ] Naganarasimha G R commented on YARN-5156: - seems to be a bug will have a look @ it. >

[jira] [Commented] (YARN-5082) ContainerId rapidly increased in fair scheduler if the num of node app reserved reached the limit

2016-05-25 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301106#comment-15301106 ] sandflee commented on YARN-5082: TestZKRMStateStore could run locally, seems not related to this issue,

[jira] [Created] (YARN-5157) TestZKRMStateStore randomly fail

2016-05-25 Thread sandflee (JIRA)
sandflee created YARN-5157: -- Summary: TestZKRMStateStore randomly fail Key: YARN-5157 URL: https://issues.apache.org/jira/browse/YARN-5157 Project: Hadoop YARN Issue Type: Bug Reporter:

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1 in REST output

2016-05-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5094: Attachment: YARN-5094-YARN-2928.001.patch First draft to resolve the problem. Note that I still decide to put

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301078#comment-15301078 ] Naganarasimha G R commented on YARN-5111: - My Bad ... even after document pointing out the hdfs rpc

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301066#comment-15301066 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3876) get_executable() assumes everything is Linux

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301059#comment-15301059 ] Hadoop QA commented on YARN-3876: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301055#comment-15301055 ] Daniel Templeton commented on YARN-5035: Thanks for the patch, [~kasha]. Looks to me like you can

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301039#comment-15301039 ] Hadoop QA commented on YARN-5127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-25 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301051#comment-15301051 ] Joep Rottinghuis commented on YARN-5109: [~varun_saxena] please go ahead with the patch. I was

[jira] [Updated] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5127: Attachment: YARN-5127.v1.patch > Expose ExecutionType in Container api record >

[jira] [Commented] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301031#comment-15301031 ] Sangjin Lee commented on YARN-5097: --- +1. Committing it shortly. > NPE in Separator.joinEncoded() >

[jira] [Updated] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5127: Attachment: (was: YARN-5127.0001.patch) > Expose ExecutionType in Container api record >

[jira] [Commented] (YARN-3876) get_executable() assumes everything is Linux

2016-05-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301016#comment-15301016 ] Allen Wittenauer commented on YARN-3876: Is there any reason to not just call realpath(argv[0] from

[jira] [Updated] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5127: Attachment: YARN-5127.0001.patch > Expose ExecutionType in Container api record >

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2016-05-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300984#comment-15300984 ] Daniel Templeton commented on YARN-4767: The full trace looks like this: # Thread 1) Proxy

[jira] [Created] (YARN-5155) [YARN-3368] Show pending resource requests on application-attempt page

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5155: Summary: [YARN-3368] Show pending resource requests on application-attempt page Key: YARN-5155 URL: https://issues.apache.org/jira/browse/YARN-5155 Project: Hadoop YARN

[jira] [Created] (YARN-5151) [YARN-3368] Support kill application from new YARN UI

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5151: Summary: [YARN-3368] Support kill application from new YARN UI Key: YARN-5151 URL: https://issues.apache.org/jira/browse/YARN-5151 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5154) DelayedProcessKiller can kill the wrong process if pid is recycled

2016-05-25 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-5154: Summary: DelayedProcessKiller can kill the wrong process if pid is recycled Key: YARN-5154 URL: https://issues.apache.org/jira/browse/YARN-5154 Project: Hadoop YARN

[jira] [Created] (YARN-5156) YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state

2016-05-25 Thread Li Lu (JIRA)
Li Lu created YARN-5156: --- Summary: YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state Key: YARN-5156 URL: https://issues.apache.org/jira/browse/YARN-5156 Project: Hadoop YARN

[jira] [Updated] (YARN-5089) Improve "yarn log" command-line "logFiles" option to support regex

2016-05-25 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5089: Attachment: YARN-5089.8.patch > Improve "yarn log" command-line "logFiles" option to support regex >

[jira] [Created] (YARN-5152) [YARN-3368] Avoid reloading web page after selecting different queues in scheduler page

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5152: Summary: [YARN-3368] Avoid reloading web page after selecting different queues in scheduler page Key: YARN-5152 URL: https://issues.apache.org/jira/browse/YARN-5152 Project:

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300963#comment-15300963 ] Hadoop QA commented on YARN-5105: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5089) Improve "yarn log" command-line "logFiles" option to support regex

2016-05-25 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300966#comment-15300966 ] Xuan Gong commented on YARN-5089: - [~vvasudev] Thanks for the review. I do not have any particular

[jira] [Created] (YARN-5153) [YARN-3368] Add a toggle to switch timeline view / table view for containers information inside application-attempt page

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5153: Summary: [YARN-3368] Add a toggle to switch timeline view / table view for containers information inside application-attempt page Key: YARN-5153 URL:

[jira] [Created] (YARN-5150) [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5150: Summary: [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI Key: YARN-5150 URL: https://issues.apache.org/jira/browse/YARN-5150

[jira] [Created] (YARN-5149) [YARN-3368] Supports application table pagination in scheduler's page.

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5149: Summary: [YARN-3368] Supports application table pagination in scheduler's page. Key: YARN-5149 URL: https://issues.apache.org/jira/browse/YARN-5149 Project: Hadoop YARN

[jira] [Created] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5148: Summary: [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics Key: YARN-5148 URL: https://issues.apache.org/jira/browse/YARN-5148 Project:

[jira] [Created] (YARN-5144) [YARN-3368] Make new YARN UI work under HA cluster

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5144: Summary: [YARN-3368] Make new YARN UI work under HA cluster Key: YARN-5144 URL: https://issues.apache.org/jira/browse/YARN-5144 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5146: Summary: [YARN-3368] Supports Fair Scheduler in new YARN UI Key: YARN-5146 URL: https://issues.apache.org/jira/browse/YARN-5146 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4459) container-executor should only kill process groups

2016-05-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300927#comment-15300927 ] Hudson commented on YARN-4459: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9861 (See

[jira] [Created] (YARN-5143) [YARN-3368] Make new YARN UI work under secure cluster

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5143: Summary: [YARN-3368] Make new YARN UI work under secure cluster Key: YARN-5143 URL: https://issues.apache.org/jira/browse/YARN-5143 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5145: Summary: [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR Key: YARN-5145 URL: https://issues.apache.org/jira/browse/YARN-5145 Project: Hadoop YARN

[jira] [Assigned] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-05-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-5077: -- Assignee: Yufei Gu (was: Karthik Kambatla) > Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[jira] [Commented] (YARN-5138) fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300920#comment-15300920 ] Hadoop QA commented on YARN-5138: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300934#comment-15300934 ] Hadoop QA commented on YARN-5035: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5147) [YARN-3368] Showing JMX metrics for YARN servers on new YARN UI

2016-05-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5147: Summary: [YARN-3368] Showing JMX metrics for YARN servers on new YARN UI Key: YARN-5147 URL: https://issues.apache.org/jira/browse/YARN-5147 Project: Hadoop YARN

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2016-05-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300894#comment-15300894 ] Jian He commented on YARN-1942: --- looks good overall, few comments - No need to create a new API ? change the

[jira] [Commented] (YARN-5138) fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests

2016-05-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300876#comment-15300876 ] Varun Saxena commented on YARN-5138: [~vrushalic], you can use your apache username/password. > fix

[jira] [Commented] (YARN-5138) fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests

2016-05-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300873#comment-15300873 ] Li Lu commented on YARN-5138: - Let me kick Jenkins for you... > fix "no findbugs output file" error for >

[jira] [Updated] (YARN-4459) container-executor should only kill process groups

2016-05-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4459: - Hadoop Flags: Reviewed Summary: container-executor should only kill process groups (was:

[jira] [Updated] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-05-25 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4957: -- Attachment: YARN-4957.v10.patch YARN-4957.v10.patch fixes remaining Javadoc issues, and has been tested on a

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2016-05-25 Thread Vigith Maurice (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300850#comment-15300850 ] Vigith Maurice commented on YARN-4767: -- when we make the new connection, can't we put in the new

[jira] [Updated] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5105: --- Attachment: YARN-5105-YARN-2928.03.patch > entire time series is returned for YARN container system

[jira] [Updated] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5035: --- Attachment: yarn-5035-1.patch Patch that implements dynamic max assign. > FairScheduler:

[jira] [Updated] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-05-25 Thread Jonathan Maron (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Maron updated YARN-4757: - Attachment: 0001-YARN-4757-Initial-code-submission-for-DNS-Service.patch Updated patch

[jira] [Updated] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-05-25 Thread Jonathan Maron (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Maron updated YARN-4757: - Attachment: (was: 0001-YARN-4757-Initial-code-submission-for-DNS-Service.patch) > [Umbrella]

[jira] [Commented] (YARN-5138) fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests

2016-05-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300830#comment-15300830 ] Vrushali C commented on YARN-5138: -- Okay, filed YARN-5142 for fixing the findbugs reported

[jira] [Commented] (YARN-5132) Exclude generated protobuf sources from YARN Javadoc build

2016-05-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300822#comment-15300822 ] Chris Douglas commented on YARN-5132: - >From the bug [~subru] cited, it looks like there's no solution

[jira] [Created] (YARN-5142) fix findbugs warnings/errors for hadoop-yarn-server-timelineservice-hbase-tests

2016-05-25 Thread Vrushali C (JIRA)
Vrushali C created YARN-5142: Summary: fix findbugs warnings/errors for hadoop-yarn-server-timelineservice-hbase-tests Key: YARN-5142 URL: https://issues.apache.org/jira/browse/YARN-5142 Project: Hadoop

[jira] [Updated] (YARN-5138) fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests

2016-05-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5138: - Summary: fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests (was: fix

[jira] [Comment Edited] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293816#comment-15293816 ] Daniel Templeton edited comment on YARN-4464 at 5/25/16 8:39 PM: - \*face

[jira] [Commented] (YARN-5116) Failed to execute "yarn application"

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300802#comment-15300802 ] Eric Payne commented on YARN-5116: -- Thanks, [~hex108], for reporting this issue and providing a patch. I

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2016-05-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300808#comment-15300808 ] Ravi Prakash commented on YARN-2233: Thanks for all the work Varun!

  1   2   >