[jira] [Updated] (YARN-4989) TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently

2016-05-10 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-4989: -- Attachment: YARN-4989.patch Please review > TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails >

[jira] [Commented] (YARN-5049) Extend NMStateStore to save queued container information

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279578#comment-15279578 ] Hadoop QA commented on YARN-5049: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5073) Refactor startContainerInternal() in ContainerManager to remove unused parameter

2016-05-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279571#comment-15279571 ] Arun Suresh commented on YARN-5073: --- Thanks for the patch [~kkaranasos] !! Considering this is a minor

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-10 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279567#comment-15279567 ] Jun Gong commented on YARN-4464: Thanks [~templedf] for the patch. >From [~magnum]'s comment

[jira] [Commented] (YARN-4987) Read cache concurrency issue between read and evict in EntityGroupFS timeline store

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279552#comment-15279552 ] Hadoop QA commented on YARN-4987: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279540#comment-15279540 ] Bibin A Chundatt commented on YARN-5024: Did check

[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279539#comment-15279539 ] Hadoop QA commented on YARN-4866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5073) Refactor startContainerInternal() in ContainerManager to remove unused parameter

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279537#comment-15279537 ] Hadoop QA commented on YARN-5073: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5068) The AM does not know the queue from which it is launched.

2016-05-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279534#comment-15279534 ] Rohith Sharma K S commented on YARN-5068: - Thanks [~hitesh] for providing detailed use-case. +1

[jira] [Commented] (YARN-5049) Extend NMStateStore to save queued container information

2016-05-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279502#comment-15279502 ] Arun Suresh commented on YARN-5049: --- [~kkaranasos], The patch seems pretty straight forward.. But I

[jira] [Commented] (YARN-5068) The AM does not know the queue from which it is launched.

2016-05-10 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279479#comment-15279479 ] Hitesh Shah commented on YARN-5068: --- The main use-case is this: - tez runs multiple dags in a single

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279430#comment-15279430 ] Hadoop QA commented on YARN-4577: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5068) The AM does not know the queue from which it is launched.

2016-05-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279425#comment-15279425 ] Rohith Sharma K S commented on YARN-5068: - Right, ATS client to publish queue name is required

[jira] [Commented] (YARN-4996) Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic, or better yet parameterized

2016-05-10 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279402#comment-15279402 ] Kai Sasaki commented on YARN-4996: -- [~templedf] Thanks for checking. I updated it to use

[jira] [Updated] (YARN-4996) Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic, or better yet parameterized

2016-05-10 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-4996: - Attachment: YARN-4996.03.patch > Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279389#comment-15279389 ] Hadoop QA commented on YARN-5053: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-3678) DelayedProcessKiller may kill other process other than container

2016-05-10 Thread gu-chi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gu-chi resolved YARN-3678. -- Resolution: Duplicate > DelayedProcessKiller may kill other process other than container >

[jira] [Updated] (YARN-5073) Refactor startContainerInternal() in ContainerManager to remove unused parameter

2016-05-10 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5073: - Attachment: YARN-5073.001.patch Attaching patch. > Refactor

[jira] [Assigned] (YARN-5073) Refactor startContainerInternal() in ContainerManager to remove unused parameter

2016-05-10 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos reassigned YARN-5073: Assignee: Konstantinos Karanasos > Refactor startContainerInternal() in

[jira] [Updated] (YARN-5073) Refactor startContainerInternal() in ContainerManager to remove unused parameter

2016-05-10 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5073: - Description: The nmTokenIdentifier is no longer needed as a parameter in the

[jira] [Created] (YARN-5073) Refactor startContainerInternal() in ContainerManager to remove unused parameter

2016-05-10 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5073: Summary: Refactor startContainerInternal() in ContainerManager to remove unused parameter Key: YARN-5073 URL: https://issues.apache.org/jira/browse/YARN-5073

[jira] [Updated] (YARN-4987) Read cache concurrency issue between read and evict in EntityGroupFS timeline store

2016-05-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4987: Attachment: YARN-4987-trunk.001.patch Upload a patch to add reference counting mechanism to fix the concurrency

[jira] [Updated] (YARN-5049) Extend NMStateStore to save queued container information

2016-05-10 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5049: - Attachment: YARN-5049.002.patch New patch version with test cases (and fixed white

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-10 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: whole-scheduler-at-debug.log.gz Okey dokey, here's another log - last 2 or three

[jira] [Updated] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4866: --- Attachment: YARN-4866.002.patch > FairScheduler: AMs can consume all vcores leading to a livelock when using

[jira] [Created] (YARN-5072) Support comma separated list of includes and excludes files

2016-05-10 Thread Ming Ma (JIRA)
Ming Ma created YARN-5072: - Summary: Support comma separated list of includes and excludes files Key: YARN-5072 URL: https://issues.apache.org/jira/browse/YARN-5072 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279237#comment-15279237 ] Hadoop QA commented on YARN-4866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3678) DelayedProcessKiller may kill other process other than container

2016-05-10 Thread Kirk Leon Guerrero (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279214#comment-15279214 ] Kirk Leon Guerrero commented on YARN-3678: -- I added 2.7.2 to the affected versions, my NM receives

[jira] [Commented] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-05-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279212#comment-15279212 ] Junping Du commented on YARN-4325: -- Thanks [~jlowe] for comments. I agree that adding a boolean flag may

[jira] [Updated] (YARN-3678) DelayedProcessKiller may kill other process other than container

2016-05-10 Thread Kirk Leon Guerrero (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk Leon Guerrero updated YARN-3678: - Affects Version/s: 2.7.2 > DelayedProcessKiller may kill other process other than

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279198#comment-15279198 ] Hadoop QA commented on YARN-4464: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279144#comment-15279144 ] Wangda Tan commented on YARN-4844: -- [~ozawa], We have discussed this on this jira. To quick summary,

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279138#comment-15279138 ] Sangjin Lee commented on YARN-4577: --- One minor nit on {{AuxiliaryServiceWithCustomClassLoader.java}}: -

[jira] [Updated] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5053: -- Attachment: YARN-5053.003.patch I forgot that strings in Java are immutable. Updating the patch to fix

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279123#comment-15279123 ] Sangjin Lee commented on YARN-4577: --- It appears the latest patch is missing

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279095#comment-15279095 ] Hadoop QA commented on YARN-5053: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5051) The RM can't update the Decommissioned Nodes Metric

2016-05-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279092#comment-15279092 ] Kuhu Shukla commented on YARN-5051: --- [~tangshangwen], Thank you for reporting this. The fix for this

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279080#comment-15279080 ] Xuan Gong commented on YARN-4577: - Thanks for the review. [~vvasudev] I have uploaded a new patch to

[jira] [Updated] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4577: Attachment: YARN-4577.20160510.patch > Enable aux services to have their own custom classpath/jar file >

[jira] [Updated] (YARN-4972) Cleanup QueuingContainerManager tests to remove long sleep times

2016-05-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4972: -- Parent Issue: YARN-4742 (was: YARN-2877) > Cleanup QueuingContainerManager tests to remove long sleep

[jira] [Updated] (YARN-2889) Limit in the number of queueable container requests per AM

2016-05-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2889: -- Parent Issue: YARN-4742 (was: YARN-2877) > Limit in the number of queueable container requests per AM >

[jira] [Commented] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

2016-05-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279048#comment-15279048 ] Hudson commented on YARN-4768: -- FAILURE: Integrated in Hadoop-trunk-Commit #9741 (See

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-10 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279018#comment-15279018 ] Nathan Roberts commented on YARN-5039: -- Thanks [~milesc]! Still not quite enough. How about

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2016-05-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278993#comment-15278993 ] Karthik Kambatla commented on YARN-4882: Was debugging something else in the RM and saw this. We

[jira] [Updated] (YARN-342) RM doesn't retry token renewals

2016-05-10 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-342: - Assignee: (was: Kuhu Shukla) > RM doesn't retry token renewals > --- > >

[jira] [Updated] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated YARN-4994: - Hadoop Flags: Reviewed > Use MiniYARNCluster with try-with-resources in tests >

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278960#comment-15278960 ] Tsuyoshi Ozawa commented on YARN-4994: -- [~boky01] I'll check the patch. > Use MiniYARNCluster with

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-10 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278951#comment-15278951 ] Andras Bokor commented on YARN-4994: Thanks a lot for the deep review. Could you please commit? > Use

[jira] [Updated] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4866: --- Attachment: YARN-4866.001.patch > FairScheduler: AMs can consume all vcores leading to a livelock when using

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278894#comment-15278894 ] John Zhuge commented on YARN-4994: -- +1 LGTM javac warnings: * YARN-5007 to fix the deprecated warnings

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4464: --- Attachment: YARN-4464.001.patch > default value of

[jira] [Commented] (YARN-342) RM doesn't retry token renewals

2016-05-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278827#comment-15278827 ] Jian He commented on YARN-342: -- [~daryn], is DFS client not handling the transient network failures, doing

[jira] [Commented] (YARN-4832) NM side resource value should get updated if change applied in RM side

2016-05-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278796#comment-15278796 ] Jian He commented on YARN-4832: --- Thanks Junping for working on the patch, some comments: I'm thinking of a

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278793#comment-15278793 ] Daniel Templeton commented on YARN-5053: LGTM > More informative diagnostics when applications

[jira] [Updated] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5053: -- Attachment: YARN-5053.002.patch Attaching patch that builds string based on whether getRemoteAddress()

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278780#comment-15278780 ] Sangjin Lee commented on YARN-5071: --- Filed HBASE-15812. > address HBase compatibility issues with trunk

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278773#comment-15278773 ] Sangjin Lee commented on YARN-5071: --- No. Let me open one. > address HBase compatibility issues with

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278772#comment-15278772 ] Sangjin Lee commented on YARN-5071: --- There may be more incompatible changes coming along in the trunk in

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278770#comment-15278770 ] stack commented on YARN-5071: - Should be an easy fix. Is there an hbase issue to address? > address HBase

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278763#comment-15278763 ] Sangjin Lee commented on YARN-5071: --- The main issue we saw was that in the trunk all metrics v.1 classes

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-10 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: capacity-scheduler-at-debug.log.gz Attached capacity-scheduler-at-debug.log.gz, which

[jira] [Comment Edited] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-05-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278751#comment-15278751 ] Jason Lowe edited comment on YARN-4325 at 5/10/16 7:51 PM: --- I'm just thinking the

[jira] [Commented] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-05-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278751#comment-15278751 ] Jason Lowe commented on YARN-4325: -- I'm just thinking the explicit boolean check and special-case logic is

[jira] [Commented] (YARN-5051) The RM can't update the Decommissioned Nodes Metric

2016-05-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278743#comment-15278743 ] Daniel Templeton commented on YARN-5051: I'm not sure that last suggestion looks right. I don't

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278730#comment-15278730 ] Daniel Templeton commented on YARN-5053: Patch looks reasonable to me. The {{getRemoteAddress()}}

[jira] [Commented] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-05-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278711#comment-15278711 ] Junping Du commented on YARN-4325: -- Thanks [~jlowe] for review and comments! bq. For

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278704#comment-15278704 ] stack commented on YARN-5071: - bq. what do you think for HBase's supporting trunk code? We will have too

[jira] [Commented] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278683#comment-15278683 ] Junping Du commented on YARN-5029: -- 02 patch LGTM. The UT failures are not related to the patch and we

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278664#comment-15278664 ] John Zhuge commented on YARN-4994: -- I will take a quick look. Thanks for the great work! John Zhuge

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278663#comment-15278663 ] Tsuyoshi Ozawa commented on YARN-5071: -- {quote} In principle, I don't think this is really a HBase

[jira] [Commented] (YARN-4913) Yarn logs should take a -out option to write to a directory

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278650#comment-15278650 ] Hadoop QA commented on YARN-4913: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278640#comment-15278640 ] Sangjin Lee commented on YARN-5071: --- Regarding #2, I don't think java 8 would be an issue, but things

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278638#comment-15278638 ] Li Lu commented on YARN-5070: - Let me check with some of the HBase/Phoenix folks for their suggestions. >

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278632#comment-15278632 ] Sangjin Lee commented on YARN-5070: --- HBase 1.2.1 is a potential candidate. > upgrade HBase version for

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278626#comment-15278626 ] Tsuyoshi Ozawa commented on YARN-5071: -- I think we should have a discussion with HBase guys.

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-10 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278627#comment-15278627 ] Andras Bokor commented on YARN-4994: [~jzhuge] Neither the test failures nor the checkstyle warning is

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278596#comment-15278596 ] Sangjin Lee commented on YARN-5070: --- Yes, I thought about phoenix. Do you have some thoughts on the

[jira] [Commented] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278587#comment-15278587 ] Sangjin Lee commented on YARN-5071: --- We have 2 areas of concern: # running our timeline service server

[jira] [Commented] (YARN-4996) Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic, or better yet parameterized

2016-05-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278538#comment-15278538 ] Daniel Templeton commented on YARN-4996: Thanks for the patch, [~lewuathe]! Couple of comments: *

[jira] [Commented] (YARN-5069) TestFifoScheduler.testResourceOverCommit race condition

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278535#comment-15278535 ] Hadoop QA commented on YARN-5069: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278517#comment-15278517 ] Li Lu commented on YARN-5070: - Thanks [~sjlee0]. I'm fine with upgrading our HBase version. Just a reminder

[jira] [Created] (YARN-5071) address HBase compatibility issues with trunk

2016-05-10 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5071: - Summary: address HBase compatibility issues with trunk Key: YARN-5071 URL: https://issues.apache.org/jira/browse/YARN-5071 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278514#comment-15278514 ] Tsuyoshi Ozawa commented on YARN-4844: -- [~wangda], it's reasonable to make these values long. Should

[jira] [Commented] (YARN-4355) NPE while processing localizer heartbeat

2016-05-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278510#comment-15278510 ] Daniel Templeton commented on YARN-4355: Two meta-comments: * Should the log messages really be

[jira] [Created] (YARN-5070) upgrade HBase version for first merge

2016-05-10 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5070: - Summary: upgrade HBase version for first merge Key: YARN-5070 URL: https://issues.apache.org/jira/browse/YARN-5070 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278504#comment-15278504 ] Wangda Tan commented on YARN-4844: -- Test failures in latest Jenkins report are not related to this patch:

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-10 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278488#comment-15278488 ] Miles Crawford commented on YARN-5039: -- Will do, happens pretty regularly, so should be in the next

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278472#comment-15278472 ] Yufei Gu commented on YARN-5024: Not really, if you check

[jira] [Commented] (YARN-1418) Add Tracing to YARN

2016-05-10 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278454#comment-15278454 ] Ray Chiang commented on YARN-1418: -- [~iwasakims], let me know if you could use a collaborator (design

[jira] [Commented] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

2016-05-10 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278369#comment-15278369 ] Nathan Roberts commented on YARN-4963: -- I don't believe test failures are related to this change. If

[jira] [Commented] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

2016-05-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278366#comment-15278366 ] Eric Payne commented on YARN-4768: -- The fix LGTM. +1 > getAvailablePhysicalMemorySize can be inaccurate

[jira] [Updated] (YARN-5069) TestFifoScheduler.testResourceOverCommit race condition

2016-05-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5069: -- Attachment: YARN-5069-b2.7.001.patch Attaching branch 2.7 patch. >

[jira] [Updated] (YARN-5069) TestFifoScheduler.testResourceOverCommit race condition

2016-05-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5069: -- Attachment: YARN-5069.001.patch Attaching trunk patch. > TestFifoScheduler.testResourceOverCommit race

[jira] [Created] (YARN-5069) TestFifoScheduler.testResourceOverCommit race condition

2016-05-10 Thread Eric Badger (JIRA)
Eric Badger created YARN-5069: - Summary: TestFifoScheduler.testResourceOverCommit race condition Key: YARN-5069 URL: https://issues.apache.org/jira/browse/YARN-5069 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-10 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278314#comment-15278314 ] Nathan Roberts commented on YARN-5039: -- [~milesc], if you have it in this state again, would you mind

[jira] [Resolved] (YARN-3048) [Data Serving] Handle how to set up and start/stop ATS reader instances

2016-05-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena resolved YARN-3048. Resolution: Duplicate > [Data Serving] Handle how to set up and start/stop ATS reader instances >

[jira] [Commented] (YARN-5068) The AM does not know the queue from which it is launched.

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278225#comment-15278225 ] Hadoop QA commented on YARN-5068: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4913) Yarn logs should take a -out option to write to a directory

2016-05-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4913: Attachment: YARN-4913.5.1.patch fix the checkstyle issue > Yarn logs should take a -out option to write to

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278194#comment-15278194 ] Hadoop QA commented on YARN-4994: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278138#comment-15278138 ] Varun Vasudev edited comment on YARN-4577 at 5/10/16 2:05 PM: -- [~xgong] -

  1   2   >