[jira] [Created] (YARN-4253) Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor

2015-10-12 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4253: --- Summary: Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor Key: YARN-4253 URL:

[jira] [Created] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-4254: -- Summary: ApplicationAttempt stuck for ever due to UnknowHostexception Key: YARN-4254 URL: https://issues.apache.org/jira/browse/YARN-4254 Project: Hadoop YARN

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952738#comment-14952738 ] zhihai xu commented on YARN-4201: - Committed it to branch-2 and trunk, thanks [~hex108] for the

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952740#comment-14952740 ] Hudson commented on YARN-4201: -- FAILURE: Integrated in Hadoop-trunk-Commit #8610 (See

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952750#comment-14952750 ] Hudson commented on YARN-4201: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #511 (See

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952783#comment-14952783 ] Hudson commented on YARN-4201: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2457 (See

[jira] [Updated] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4254: --- Attachment: 0001-YARN-4254.patch Attaching patch for review > ApplicationAttempt stuck for

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952876#comment-14952876 ] Hudson commented on YARN-4201: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1249 (See

[jira] [Commented] (YARN-4253) Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor

2015-10-12 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952908#comment-14952908 ] Sidharta Seethana commented on YARN-4253: - Pre-Patch failure : unrelated to this JIRA Tests : There

[jira] [Updated] (YARN-4253) Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor

2015-10-12 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-4253: Attachment: YARN-4253.001.patch Uploaded a patch > Standardize on using

[jira] [Commented] (YARN-4253) Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952905#comment-14952905 ] Hadoop QA commented on YARN-4253: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952833#comment-14952833 ] Jun Gong commented on YARN-4201: Thanks [~zxu] for the suggestion, review and commit! > AMBlacklist does

[jira] [Commented] (YARN-4130) Duplicate declaration of ApplicationId in RMAppManager

2015-10-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952942#comment-14952942 ] Kai Sasaki commented on YARN-4130: -- [~adhoot] Thank you so much for checking it? Can someone merge this?

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-10-12 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952900#comment-14952900 ] Rohith Sharma K S commented on YARN-2729: - Hi Naganarasinmha, thanks for delivering the patch. Some

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952830#comment-14952830 ] Hadoop QA commented on YARN-4254: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (YARN-4255) container-executor does not clean up docker operation command files.

2015-10-12 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4255: --- Summary: container-executor does not clean up docker operation command files. Key: YARN-4255 URL: https://issues.apache.org/jira/browse/YARN-4255 Project:

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952837#comment-14952837 ] Hudson commented on YARN-4201: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #523 (See

[jira] [Updated] (YARN-4252) Log container-executor invocation details when exit code is non-zero

2015-10-12 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-4252: Attachment: YARN-4252.001.patch Uploading a patch > Log container-executor invocation

[jira] [Updated] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-4201: Hadoop Flags: Reviewed > AMBlacklist does not work for minicluster >

[jira] [Commented] (YARN-2353) FairScheduler: Update demand asynchronously instead of in the Update Thread

2015-10-12 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953288#comment-14953288 ] Neelesh Srinivas Salian commented on YARN-2353: --- Thanks for assigning it to me

[jira] [Commented] (YARN-4243) Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit

2015-10-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953332#comment-14953332 ] Xuan Gong commented on YARN-4243: - [~rohithsharma] Thanks for the review. bq. And method

[jira] [Created] (YARN-4256) YARN fair scheduler vcores with decimal values

2015-10-12 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-4256: --- Summary: YARN fair scheduler vcores with decimal values Key: YARN-4256 URL: https://issues.apache.org/jira/browse/YARN-4256 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4252) Log container-executor invocation details when exit code is non-zero

2015-10-12 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953013#comment-14953013 ] Sidharta Seethana commented on YARN-4252: - Tests : this is only a logging change, no additional

[jira] [Commented] (YARN-4255) container-executor does not clean up docker operation command files.

2015-10-12 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953087#comment-14953087 ] Sidharta Seethana commented on YARN-4255: - Tests : The patch is trivial - manually tested with test

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953106#comment-14953106 ] Hudson commented on YARN-4201: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2422 (See

[jira] [Commented] (YARN-4255) container-executor does not clean up docker operation command files.

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953080#comment-14953080 ] Hadoop QA commented on YARN-4255: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-4255) container-executor does not clean up docker operation command files.

2015-10-12 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-4255: Attachment: YARN-4255.001.patch Uploading trivial patch to clean up docker command files.

[jira] [Commented] (YARN-4201) AMBlacklist does not work for minicluster

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953116#comment-14953116 ] Hudson commented on YARN-4201: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #484 (See

[jira] [Commented] (YARN-4252) Log container-executor invocation details when exit code is non-zero

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953011#comment-14953011 ] Hadoop QA commented on YARN-4252: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-4170) AM need to be notified with priority in AllocateResponse

2015-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4170: -- Attachment: 0004-YARN-4170.patch Reattaching the patch to get jenkins result correctly. [~jianhe],

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953076#comment-14953076 ] Jason Lowe commented on YARN-4254: -- Thanks for the report and patch, Bibin! The patch seems to be trying

[jira] [Updated] (YARN-4162) Scheduler info in REST, is currently not displaying partition specific queue information similar to UI

2015-10-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4162: Attachment: YARN-4162.v2.004.patch hi [~wangda] Attaching a patch with rework on review

[jira] [Commented] (YARN-4170) AM need to be notified with priority in AllocateResponse

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953150#comment-14953150 ] Hadoop QA commented on YARN-4170: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953202#comment-14953202 ] Jason Lowe commented on YARN-4254: -- True, registering could take significantly longer if DNS is slow.

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953146#comment-14953146 ] Bibin A Chundatt commented on YARN-4254: [~jlowe] Thanks for looking into issue Had cancelled the

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953176#comment-14953176 ] Sunil G commented on YARN-4254: --- bq.RM simply refused to accept nodemanagers into the cluster that are

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953496#comment-14953496 ] Sunil G commented on YARN-3216: --- Hi [~leftnoteasy] Thank you for confirming to use max-capacity also while

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953368#comment-14953368 ] Bibin A Chundatt commented on YARN-4254: {quote} Did it really try forever? {quote} It did get

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953437#comment-14953437 ] Jian He commented on YARN-4000: --- Hi [~varun_saxena], the patch not applying on trunk now, would you like to

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953415#comment-14953415 ] Sunil G commented on YARN-4254: --- RMAppAttempt will be registered to AMLivenessMonitor when AM container is

[jira] [Commented] (YARN-4243) Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit

2015-10-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953346#comment-14953346 ] Xuan Gong commented on YARN-4243: - Thanks for the review, [~djp] Will create a new patch to address your

[jira] [Commented] (YARN-4162) Scheduler info in REST, is currently not displaying partition specific queue information similar to UI

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953384#comment-14953384 ] Hadoop QA commented on YARN-4162: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953457#comment-14953457 ] Wangda Tan commented on YARN-3216: -- bq. now queueResourceLimitsInfo.getQueueCurrentLimit() is common per

[jira] [Updated] (YARN-4256) YARN fair scheduler vcores with decimal values

2015-10-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-4256: Priority: Minor (was: Critical) > YARN fair scheduler vcores with decimal values >

[jira] [Commented] (YARN-4230) Increasing container resource while there is no headroom left will cause ResourceManager to crash

2015-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953557#comment-14953557 ] Jian He commented on YARN-4230: --- looks good, committing. > Increasing container resource while there is no

[jira] [Commented] (YARN-4230) Increasing container resource while there is no headroom left will cause ResourceManager to crash

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953596#comment-14953596 ] Hudson commented on YARN-4230: -- FAILURE: Integrated in Hadoop-trunk-Commit #8612 (See

[jira] [Commented] (YARN-4230) Increasing container resource while there is no headroom left will cause ResourceManager to crash

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953617#comment-14953617 ] Hudson commented on YARN-4230: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #513 (See

[jira] [Commented] (YARN-4127) RM fail with noAuth error if switched from non-failover mode to failover mode

2015-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953646#comment-14953646 ] Jian He commented on YARN-4127: --- thanks Varun ! patch looks good to me overall,

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953655#comment-14953655 ] Hadoop QA commented on YARN-3216: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-4243) Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit

2015-10-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4243: Attachment: YARN-4243.2.patch > Add retry on establishing Zookeeper conenction in >

[jira] [Commented] (YARN-4230) Increasing container resource while there is no headroom left will cause ResourceManager to crash

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953682#comment-14953682 ] Hudson commented on YARN-4230: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2459 (See

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953688#comment-14953688 ] Jian He commented on YARN-4041: --- looks good to me overall, hold on committing in case any comments from

[jira] [Created] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-10-12 Thread Swapnil Daingade (JIRA)
Swapnil Daingade created YARN-4257: -- Summary: Move scheduler validateConf method to AbstractYarnScheduler and make it protected Key: YARN-4257 URL: https://issues.apache.org/jira/browse/YARN-4257

[jira] [Commented] (YARN-4230) Increasing container resource while there is no headroom left will cause ResourceManager to crash

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953614#comment-14953614 ] Hudson commented on YARN-4230: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1250 (See

[jira] [Updated] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3216: -- Attachment: 0006-YARN-3216.patch Attaching patch addressing the comments. Kindly help to check the same. >

[jira] [Commented] (YARN-4170) AM need to be notified with priority in AllocateResponse

2015-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953724#comment-14953724 ] Jian He commented on YARN-4170: --- - priority is per application, but this is a global variable in

[jira] [Commented] (YARN-4162) Scheduler info in REST, is currently not displaying partition specific queue information similar to UI

2015-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953733#comment-14953733 ] Wangda Tan commented on YARN-4162: -- [~Naganarasimha], thanks for update. Few comments: - Do you think is

[jira] [Commented] (YARN-4230) Increasing container resource while there is no headroom left will cause ResourceManager to crash

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953744#comment-14953744 ] Hudson commented on YARN-4230: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #525 (See

[jira] [Commented] (YARN-4162) Scheduler info in REST, is currently not displaying partition specific queue information similar to UI

2015-10-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953834#comment-14953834 ] Naganarasimha G R commented on YARN-4162: - hi [~wangda], Thanks for the review. bq.

[jira] [Commented] (YARN-4162) Scheduler info in REST, is currently not displaying partition specific queue information similar to UI

2015-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953962#comment-14953962 ] Wangda Tan commented on YARN-4162: -- bq. I was thinking in similar lines earlier like using square/flower

[jira] [Updated] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

2015-10-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4200: Attachment: YARN-4200-YARN-2928.001.patch Since YARN-4075 is in and we're relatively stable on the reader

[jira] [Commented] (YARN-4032) Corrupted state from a previous version can still cause RM to fail with NPE due to same reasons as YARN-2834

2015-10-12 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953924#comment-14953924 ] Anubhav Dhoot commented on YARN-4032: - This is a sample log {noformat} 2015-10-10 04:35:32,486 INFO

[jira] [Commented] (YARN-4230) Increasing container resource while there is no headroom left will cause ResourceManager to crash

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953973#comment-14953973 ] Hudson commented on YARN-4230: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #485 (See

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954006#comment-14954006 ] Wangda Tan commented on YARN-3216: -- Hi Sunil, Thanks for update, some questions/comments: 1)

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954227#comment-14954227 ] Hadoop QA commented on YARN-4200: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4227) FairScheduler: RM quits processing expired container from a removed node

2015-10-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954003#comment-14954003 ] Ray Chiang commented on YARN-4227: -- +1 (nonbinding) The only comment I have is whether it's worth having

[jira] [Updated] (YARN-4243) Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit

2015-10-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4243: Attachment: YARN-4243.2.1.patch > Add retry on establishing Zookeeper conenction in >

[jira] [Updated] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-10-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2729: Attachment: YARN-2729.20151310-1.patch Thanks for the review [~rohithsharma], bq. Does

[jira] [Updated] (YARN-4032) Corrupted state from a previous version can still cause RM to fail with NPE due to same reasons as YARN-2834

2015-10-12 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4032: Attachment: YARN-4032.prelim.patch Prelim patch based on the discussion > Corrupted state from a

[jira] [Commented] (YARN-4243) Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954010#comment-14954010 ] Hadoop QA commented on YARN-4243: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4230) Increasing container resource while there is no headroom left will cause ResourceManager to crash

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954011#comment-14954011 ] Hudson commented on YARN-4230: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2423 (See

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954269#comment-14954269 ] Sunil G commented on YARN-3216: --- Hi [~leftnoteasy] Thank you for sharing the comments. bq.why computing max

[jira] [Updated] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4254: --- Attachment: Logs.txt > ApplicationAttempt stuck for ever due to UnknowHostexception >

[jira] [Updated] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4254: --- Attachment: Test.patch > ApplicationAttempt stuck for ever due to UnknowHostexception >

[jira] [Updated] (YARN-4227) FairScheduler: RM quits processing expired container from a removed node

2015-10-12 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-4227: Attachment: YARN-4227.2.patch Updated patch with a test (thanks to [~rchiang] for

[jira] [Commented] (YARN-4254) ApplicationAttempt stuck for ever due to UnknowHostexception

2015-10-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954273#comment-14954273 ] Bibin A Chundatt commented on YARN-4254: Hi [~sunilg] Attached test patch to reproduce the same. AM

[jira] [Commented] (YARN-4170) AM need to be notified with priority in AllocateResponse

2015-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954403#comment-14954403 ] Jian He commented on YARN-4170: --- thanks Sunil. actually, if we require a map, for simplicity, we may just set

[jira] [Commented] (YARN-4243) Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954300#comment-14954300 ] Hadoop QA commented on YARN-4243: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-4170) AM need to be notified with priority in AllocateResponse

2015-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4170: -- Attachment: 0005-YARN-4170-v2.patch Thank you [~jianhe]. yes, I overlooked that. We might need a map to store

[jira] [Commented] (YARN-4243) Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit

2015-10-12 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954396#comment-14954396 ] Rohith Sharma K S commented on YARN-4243: - bq. This will affect the HDFS ZKFS, and they do not want

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-10-12 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v3.patch Merging to trunk > Plumb resource-utilization info in node heartbeat

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-10-12 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: (was: YARN-3980-v3.patch) > Plumb resource-utilization info in node heartbeat through to

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-10-12 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v3.patch Missing key > Plumb resource-utilization info in node heartbeat through

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954365#comment-14954365 ] Hadoop QA commented on YARN-2729: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4170) AM need to be notified with priority in AllocateResponse

2015-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954418#comment-14954418 ] Sunil G commented on YARN-4170: --- Thanks [~jianhe] Yes. For simplicity, its definitely a better option. Also