[jira] [Commented] (YARN-6069) CORS support in timeline v2

2017-03-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904653#comment-15904653 ] Rohith Sharma K S commented on YARN-6069: - [~varun_saxena] We are facing issue in trunk integration

[jira] [Updated] (YARN-6304) Skip rm.transitionToActive call to RM if RM is already active.

2017-03-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6304: Description: When elector elects RM to become active, even though RM is already in ACTIVE

[jira] [Commented] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904595#comment-15904595 ] Karthik Kambatla commented on YARN-6264: +1. Committing this. > AM not launched when a single

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-09 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904584#comment-15904584 ] Tao Jie commented on YARN-5829: --- Thank you [~miklos.szeg...@cloudera.com] for sharing your thought. 1, It is

[jira] [Commented] (YARN-6318) timeline service schema creator fails if executed from a remote machine

2017-03-09 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904481#comment-15904481 ] Rohith Sharma K S commented on YARN-6318: - IIUC, hbase-site.xml is expected to be placed at

[jira] [Assigned] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-5829: Assignee: Miklos Szegedi (was: Karthik Kambatla) > FS preemption should reserve a node

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904453#comment-15904453 ] Miklos Szegedi commented on YARN-5829: -- [~Tao Jie], I like the idea that you described in YARN-5636.

[jira] [Commented] (YARN-6300) NULL_UPDATE_REQUESTS is redundant in TestFairScheduler

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904434#comment-15904434 ] Daniel Templeton commented on YARN-6300: Yeah, I accidentally pushed it into branch-2, but I made

[jira] [Updated] (YARN-6300) NULL_UPDATE_REQUESTS is redundant in TestFairScheduler

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6300: --- Fix Version/s: 2.9.0 > NULL_UPDATE_REQUESTS is redundant in TestFairScheduler >

[jira] [Commented] (YARN-6300) NULL_UPDATE_REQUESTS is redundant in TestFairScheduler

2017-03-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904329#comment-15904329 ] Yuanbo Liu commented on YARN-6300: -- [~templedf] Thanks for your commit !Selection_124.png! I've seen this

[jira] [Updated] (YARN-6300) NULL_UPDATE_REQUESTS is redundant in TestFairScheduler

2017-03-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated YARN-6300: - Attachment: Selection_124.png > NULL_UPDATE_REQUESTS is redundant in TestFairScheduler >

[jira] [Comment Edited] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-03-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903442#comment-15903442 ] Sunil G edited comment on YARN-2113 at 3/10/17 2:48 AM: Attaching v0 patch for

[jira] [Commented] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-09 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904296#comment-15904296 ] Huangkaixuan commented on YARN-6289: Thanks [~leftnoteasy] 1、MR can get the locations of a block

[jira] [Commented] (YARN-6301) Fair scheduler docs should explain the meaning of setting a queue's weight to zero

2017-03-09 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904277#comment-15904277 ] Tao Jie commented on YARN-6301: --- Thank you [~templedf]. It is almost clear to me now. One thing I'd like to

[jira] [Commented] (YARN-1047) Expose # of pre-emptions as a queue counter

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904269#comment-15904269 ] Daniel Templeton commented on YARN-1047: Committed branch-2 patch. > Expose # of pre-emptions as a

[jira] [Updated] (YARN-1047) Expose # of pre-emptions as a queue counter

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-1047: --- Fix Version/s: 2.9.0 > Expose # of pre-emptions as a queue counter >

[jira] [Commented] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904264#comment-15904264 ] Hadoop QA commented on YARN-6264: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1047) Expose # of pre-emptions as a queue counter

2017-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904262#comment-15904262 ] Hudson commented on YARN-1047: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11383 (See

[jira] [Updated] (YARN-1047) Expose # of pre-emptions as a queue counter

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-1047: --- Attachment: YARN-1047.branch-2.001.patch > Expose # of pre-emptions as a queue counter >

[jira] [Created] (YARN-6318) timeline service schema creator fails if executed from a remote machine

2017-03-09 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-6318: - Summary: timeline service schema creator fails if executed from a remote machine Key: YARN-6318 URL: https://issues.apache.org/jira/browse/YARN-6318 Project: Hadoop YARN

[jira] [Updated] (YARN-6301) Fair scheduler docs should explain the meaning of setting a queue's weight to zero

2017-03-09 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-6301: -- Attachment: YARN-6301.002.patch > Fair scheduler docs should explain the meaning of setting a queue's weight to

[jira] [Commented] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-09 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904237#comment-15904237 ] Tao Jie commented on YARN-6246: --- Thank you [~kasha] for working on this. It seems to me that checking

[jira] [Commented] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904199#comment-15904199 ] Xuan Gong commented on YARN-6314: - The testcase failure is not related > Potential infinite redirection on

[jira] [Commented] (YARN-6313) yarn logs cli does not provide logs for a completed container even when the nm address is provided

2017-03-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904198#comment-15904198 ] Xuan Gong commented on YARN-6313: - The testcase failure is not related > yarn logs cli does not provide

[jira] [Commented] (YARN-6310) OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904192#comment-15904192 ] Hadoop QA commented on YARN-6310: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5269) Bubble exceptions and errors all the way up the calls, including to clients.

2017-03-09 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904194#comment-15904194 ] Joep Rottinghuis commented on YARN-5269: After looking at the code I am indeed a little surprised

[jira] [Commented] (YARN-5669) Add support for Docker pull

2017-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904185#comment-15904185 ] Hudson commented on YARN-5669: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11381 (See

[jira] [Commented] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904172#comment-15904172 ] Hadoop QA commented on YARN-6042: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1047) Expose # of pre-emptions as a queue counter

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904171#comment-15904171 ] Hadoop QA commented on YARN-1047: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-09 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904168#comment-15904168 ] Jonathan Hung commented on YARN-5948: - Thanks, committed to YARN-5734. > Implement

[jira] [Commented] (YARN-6313) yarn logs cli does not provide logs for a completed container even when the nm address is provided

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904156#comment-15904156 ] Hadoop QA commented on YARN-6313: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904152#comment-15904152 ] Hadoop QA commented on YARN-5948: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6310) OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions

2017-03-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6310: - Attachment: YARN-6310.01.patch Upload a patch that replace explicit close calls with try clauses >

[jira] [Commented] (YARN-1047) Expose # of pre-emptions as a queue counter

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904139#comment-15904139 ] Daniel Templeton commented on YARN-1047: LGTM. I'll come back and do a more careful review in an

[jira] [Updated] (YARN-5669) Add support for Docker pull

2017-03-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-5669: Fix Version/s: 3.0.0-alpha3 2.9.0 > Add support for Docker pull >

[jira] [Commented] (YARN-5669) Add support for Docker pull

2017-03-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904134#comment-15904134 ] Sidharta Seethana commented on YARN-5669: - Committed to trunk and branch-2. Thanks, [~luhuichun] !

[jira] [Commented] (YARN-5669) Add support for Docker pull

2017-03-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904125#comment-15904125 ] Sidharta Seethana commented on YARN-5669: - The javac warning and the checkstyle issue don't seem to

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6264: --- Attachment: YARN-6264.006.patch > AM not launched when a single vcore is available on the cluster >

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6264: --- Attachment: (was: YARN-6264.006.patch) > AM not launched when a single vcore is available on the cluster >

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904101#comment-15904101 ] Wangda Tan commented on YARN-5948: -- +1, thanks [~jhung]. > Implement MutableConfigurationManager for

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6264: --- Attachment: YARN-6264.006.patch Upload patch v6 to fix unit test failure. > AM not launched when a single

[jira] [Commented] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904090#comment-15904090 ] Hadoop QA commented on YARN-6264: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904083#comment-15904083 ] Hadoop QA commented on YARN-6264: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-1047) Expose # of pre-emptions as a queue counter

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1047: --- Attachment: YARN-1047.001.patch Straight-forward patch. > Expose # of pre-emptions as a

[jira] [Commented] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904039#comment-15904039 ] Haibo Chen commented on YARN-6288: -- Looks like in LogWriter() we create a file and write to it, which

[jira] [Commented] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904034#comment-15904034 ] Hadoop QA commented on YARN-6264: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6313) yarn logs cli does not provide logs for a completed container even when the nm address is provided

2017-03-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6313: Attachment: YARN-6313.1.patch > yarn logs cli does not provide logs for a completed container even when the

[jira] [Commented] (YARN-5269) Bubble exceptions and errors all the way up the calls, including to clients.

2017-03-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904025#comment-15904025 ] Haibo Chen commented on YARN-5269: -- Thanks for reminding me of that [~vrushalic]! The time-based flush, in

[jira] [Commented] (YARN-5269) Bubble exceptions and errors all the way up the calls, including to clients.

2017-03-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904005#comment-15904005 ] Vrushali C commented on YARN-5269: -- Let me get back on the questions [~haibochen]. As such we have a

[jira] [Assigned] (YARN-6284) hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6284: -- Assignee: Laura Adams (was: Daniel Templeton) > hasAlreadyRun should be final in

[jira] [Commented] (YARN-5269) Bubble exceptions and errors all the way up the calls, including to clients.

2017-03-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903972#comment-15903972 ] Haibo Chen commented on YARN-5269: -- On the client side, putEntities() is a blocking call and

[jira] [Commented] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903960#comment-15903960 ] Yufei Gu commented on YARN-6042: Thanks [~rchiang] for the review. Right now the default update interval is

[jira] [Updated] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6042: --- Attachment: YARN-6042.010.patch > Dump scheduler and queue state information into FairScheduler DEBUG log >

[jira] [Comment Edited] (YARN-5269) Bubble exceptions and errors all the way up the calls, including to clients.

2017-03-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903540#comment-15903540 ] Haibo Chen edited comment on YARN-5269 at 3/9/17 10:08 PM: --- Based on today's

[jira] [Commented] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903941#comment-15903941 ] Karthik Kambatla commented on YARN-6264: +1, pending Jenkins. > AM not launched when a single

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6264: --- Description: In method {{canRunAppAM()}}, we will get a zero vcore if there is only one vcores, and the

[jira] [Updated] (YARN-6298) Metric preemptCall is not used in new preemption.

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6298: --- Priority: Blocker (was: Major) > Metric preemptCall is not used in new preemption. >

[jira] [Updated] (YARN-6298) Metric preemptCall is not used in new preemption.

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6298: --- Target Version/s: 3.0.0-beta1 Hadoop Flags: Incompatible change > Metric preemptCall

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6264: --- Description: In method {{canRunAppAM()}}, we will get a zero vcore if there is only one vcores, and the

[jira] [Commented] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903923#comment-15903923 ] Yufei Gu commented on YARN-6264: Hi [~DjvuLee], changed the description to answer your question. > AM not

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6264: --- Description: In method {{canRunAppAM()}}, we will get a zero vcore if there is only one vcores, and the

[jira] [Comment Edited] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903873#comment-15903873 ] Yufei Gu edited comment on YARN-6264 at 3/9/17 9:27 PM: Thanks [~kasha] for the

[jira] [Updated] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6246: --- Attachment: YARN-6246.001.patch Straight-forward patch that keeps the starvation checks in the

[jira] [Updated] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6246: --- Description: Currently, the starvation checks are done holding the scheduler writelock. We are

[jira] [Updated] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6246: --- Summary: Identifying starved apps does not need the scheduler writelock (was: Move app

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6264: --- Attachment: YARN-6264.005.patch v5 changes the assert messages. > AM not launched when a single vcore is

[jira] [Commented] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-09 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903900#comment-15903900 ] Jonathan Hung commented on YARN-5948: - Thanks for the review [~leftnoteasy], uploaded a patch

[jira] [Updated] (YARN-5948) Implement MutableConfigurationManager for handling storage into configuration store

2017-03-09 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5948: Attachment: YARN-5948-YARN-5734.008.patch > Implement MutableConfigurationManager for handling

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6264: --- Attachment: YARN-6264.004.patch Thanks [~kasha] for the review. Uploaded patch v4 for your comments. > AM not

[jira] [Updated] (YARN-6317) Get rid of Resources#multiplyAndRoundDown since it duplicates Resources#multiply

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6317: --- Labels: newbie (was: ) > Get rid of Resources#multiplyAndRoundDown since it duplicates > Resources#multiply

[jira] [Created] (YARN-6317) Get rid of Resources#multiplyAndRoundDown since it duplicates Resources#multiply

2017-03-09 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6317: -- Summary: Get rid of Resources#multiplyAndRoundDown since it duplicates Resources#multiply Key: YARN-6317 URL: https://issues.apache.org/jira/browse/YARN-6317 Project: Hadoop

[jira] [Commented] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903855#comment-15903855 ] Karthik Kambatla commented on YARN-6264: Thanks for following up on this [~yufeigu]. Comments on

[jira] [Updated] (YARN-6264) AM not launched when a single vcore is available on the cluster

2017-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6264: --- Summary: AM not launched when a single vcore is available on the cluster (was: Resource

[jira] [Commented] (YARN-6300) NULL_UPDATE_REQUESTS is redundant in TestFairScheduler

2017-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903848#comment-15903848 ] Hudson commented on YARN-6300: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11380 (See

[jira] [Commented] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903800#comment-15903800 ] Ray Chiang commented on YARN-6042: -- Looks good so far. Another things occurs to me. The queue info is

[jira] [Commented] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903671#comment-15903671 ] Hadoop QA commented on YARN-6314: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6316) Provide help information and documentation for TimelineSchemaCreator

2017-03-09 Thread Li Lu (JIRA)
Li Lu created YARN-6316: --- Summary: Provide help information and documentation for TimelineSchemaCreator Key: YARN-6316 URL: https://issues.apache.org/jira/browse/YARN-6316 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5669) Add support for Docker pull

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903614#comment-15903614 ] Hadoop QA commented on YARN-5669: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-09 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created YARN-6315: - Summary: Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files Key: YARN-6315 URL: https://issues.apache.org/jira/browse/YARN-6315

[jira] [Assigned] (YARN-6284) hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6284: -- Assignee: Daniel Templeton > hasAlreadyRun should be final in

[jira] [Commented] (YARN-6300) NULL_UPDATE_REQUESTS is redundant in TestFairScheduler

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903604#comment-15903604 ] Daniel Templeton commented on YARN-6300: +1 LGTM. I'll commit when I get a chance. >

[jira] [Commented] (YARN-6301) Fair scheduler docs should explain the meaning of setting a queue's weight to zero

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903600#comment-15903600 ] Daniel Templeton commented on YARN-6301: Thanks, [~Tao Jie]. You're on the right track, but I'd

[jira] [Assigned] (YARN-6301) Fair scheduler docs should explain the meaning of setting a queue's weight to zero

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6301: -- Assignee: Tao Jie > Fair scheduler docs should explain the meaning of setting a queue's

[jira] [Commented] (YARN-5669) Add support for Docker pull

2017-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903590#comment-15903590 ] Hadoop QA commented on YARN-5669: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6314: Attachment: YARN-6314.1.patch > Potential infinite redirection on YARN log redirection web service >

[jira] [Commented] (YARN-5269) Bubble exceptions and errors all the way up the calls, including to clients.

2017-03-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903540#comment-15903540 ] Haibo Chen commented on YARN-5269: -- Based on today's discussion, questions we need to answer are 1) for

[jira] [Created] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-09 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-6314: --- Summary: Potential infinite redirection on YARN log redirection web service Key: YARN-6314 URL: https://issues.apache.org/jira/browse/YARN-6314 Project: Hadoop YARN

[jira] [Commented] (YARN-5669) Add support for Docker pull

2017-03-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903519#comment-15903519 ] Sidharta Seethana commented on YARN-5669: - I have launched a commit build again - I'll take a look

[jira] [Updated] (YARN-6307) Refactor FairShareComparator#compare

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6307: --- Description: The method does three things: check the min share ratio, check weight ratio, break tied by

[jira] [Assigned] (YARN-5269) Bubble exceptions and errors all the way up the calls, including to clients.

2017-03-09 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-5269: Assignee: Haibo Chen (was: Varun Saxena) > Bubble exceptions and errors all the way up the calls,

[jira] [Created] (YARN-6313) yarn logs cli does not provide logs for a completed container even when the nm address is provided

2017-03-09 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-6313: --- Summary: yarn logs cli does not provide logs for a completed container even when the nm address is provided Key: YARN-6313 URL: https://issues.apache.org/jira/browse/YARN-6313

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-03-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903443#comment-15903443 ] Daniel Templeton commented on YARN-6208: It's not like the log message is going to appear so often

[jira] [Commented] (YARN-6249) TestFairSchedulerPreemption is inconsistently failing on trunk

2017-03-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903439#comment-15903439 ] Yufei Gu commented on YARN-6249: +1 (non-binding). [~kasha], wanna take a look? >

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-03-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2113: -- Attachment: YARN-2113.v0.patch Attaching v0 patch for user-limit preemption. This patch is done on top of

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

2017-03-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903349#comment-15903349 ] Eric Payne commented on YARN-6165: -- Thanks Jason and Sunil. > Intra-queue preemption occurs even when

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2017-03-09 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903098#comment-15903098 ] Kai Sasaki commented on YARN-5956: -- [~rohithsharma] [~sunilg] Sorry I overlooked and thank you so much for

[jira] [Updated] (YARN-5956) Refactor ClientRMService

2017-03-09 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-5956: - Attachment: YARN-5956.14.patch > Refactor ClientRMService > > >

[jira] [Commented] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902868#comment-15902868 ] Akira Ajisaka commented on YARN-6288: - Thanks [~haibochen] for the comment. I tried to make LogWriter

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2017-03-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902833#comment-15902833 ] Sunil G commented on YARN-5956: --- Yes [~rohithsharma], Thanks for pointing out. in

[jira] [Commented] (YARN-6290) Capacity scheduler page broken

2017-03-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902828#comment-15902828 ] Léopold Boudard commented on YARN-6290: --- [~seaokcs] Indeed, it's capacity scheduler that's being used

  1   2   >