[jira] [Assigned] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-4943: --- Assignee: (was: Varun Vasudev) > Add support to collect actual resource usage from

[jira] [Updated] (YARN-7323) Some changes in service REST API

2017-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7323: -- Attachment: YARN-7323.yarn-native-services.01.patch > Some changes in service REST API >

[jira] [Commented] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203066#comment-16203066 ] Varun Vasudev commented on YARN-4943: - [~miklos.szeg...@cloudera.com] - please feel free to take it

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-12 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203070#comment-16203070 ] Manikandan R commented on YARN-7159: Fixed checkstyle and findbugs warnings. Attached patch for the

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-12 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7159: --- Attachment: YARN-7159.002.patch > Normalize unit of resource objects in RM and avoid to do unit

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-12 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201883#comment-16201883 ] Kuhu Shukla commented on YARN-7244: --- Test failures are related. Will update shortly. > ShuffleHandler is

[jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201902#comment-16201902 ] Hadoop QA commented on YARN-7254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201622#comment-16201622 ] Hadoop QA commented on YARN-7254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7319) java.net.UnknownHostException when trying contact node by hostname

2017-10-12 Thread Evgeny Makarov (JIRA)
Evgeny Makarov created YARN-7319: Summary: java.net.UnknownHostException when trying contact node by hostname Key: YARN-7319 URL: https://issues.apache.org/jira/browse/YARN-7319 Project: Hadoop YARN

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201575#comment-16201575 ] Hadoop QA commented on YARN-7275: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-12 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201816#comment-16201816 ] Rohith Sharma K S commented on YARN-7190: - thanks Varun for the patch! I applied patch and built

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.005.patch YARN-5881 branch is rebased. Re attaching the patch run jenkins again

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.004.patch Attaching v4 patch after fixing [~leftnoteasy] comments. Thank you. I

[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201507#comment-16201507 ] Hadoop QA commented on YARN-7170: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-12 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-7275: Attachment: YARN-7275.004.patch Fixing Jenkin issues. The unit tests in

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201554#comment-16201554 ] Hadoop QA commented on YARN-6608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-7319) java.net.UnknownHostException when trying contact node by hostname

2017-10-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-7319. -- Resolution: Invalid JIRA is for tracking features and defects in Apache Hadoop and not for general user

[jira] [Comment Edited] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202047#comment-16202047 ] Arun Suresh edited comment on YARN-7275 at 10/12/17 2:51 PM: - Thanks for the

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202047#comment-16202047 ] Arun Suresh commented on YARN-7275: --- Thanks for the updated patch [~kartheek] Couple of comments: * In

[jira] [Updated] (YARN-7202) Add UT for api-server

2017-10-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7202: Attachment: YARN-7202.yarn-native-services.014.patch - Update setApiServer to setServiceClient for

[jira] [Commented] (YARN-4163) Audit getQueueInfo and getApplications calls

2017-10-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202180#comment-16202180 ] Jason Lowe commented on YARN-4163: -- Thanks for updating the patch! The builder pattern solves the

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6033: - Fix Version/s: 2.9.0 > Add support for sections in container-executor configuration file >

[jira] [Updated] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6608: - Attachment: YARN-6608-branch-2.v7.patch > Backport all SLS improvements from trunk to branch-2 >

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-10-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202192#comment-16202192 ] Miklos Szegedi commented on YARN-6668: -- Indeed this is a duplicate. How should we coordinate? > Use

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Attachment: YARN-7254.YARN-5881.006.patch Updating v6 patch after fixing javadoc and findbugs. Some test case

[jira] [Reopened] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reopened YARN-6852: - [~leftnoteasy] - Any objections to backporting this to branch-2? It has changes to container-executor

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202236#comment-16202236 ] Wangda Tan commented on YARN-6852: -- [~vvasudev], I would prefer to only pull in common changes since rest

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202279#comment-16202279 ] Carlo Curino commented on YARN-6608: [~wangda] # {{TestDebugOverflowUserLimit}} should be removed

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202313#comment-16202313 ] Varun Vasudev commented on YARN-6852: - Sounds good, I'll create a new ticket for that then and close

[jira] [Resolved] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev resolved YARN-6852. - Resolution: Fixed > [YARN-6223] Native code changes to support isolate GPU devices by using >

[jira] [Created] (YARN-7320) Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_

2017-10-12 Thread Misha Dmitriev (JIRA)
Misha Dmitriev created YARN-7320: Summary: Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ Key: YARN-7320 URL: https://issues.apache.org/jira/browse/YARN-7320

[jira] [Commented] (YARN-7202) Add UT for api-server

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202329#comment-16202329 ] Hadoop QA commented on YARN-7202: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-12 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-7321: --- Summary: Backport container-executor changes from YARN-6852 to branch-2 Key: YARN-7321 URL: https://issues.apache.org/jira/browse/YARN-7321 Project: Hadoop YARN

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202335#comment-16202335 ] Haibo Chen commented on YARN-4511: -- Thanks for the background on YARN-5139, [~leftnoteasy]. My

[jira] [Updated] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7317: --- Affects Version/s: 3.0.0 2.9.0 > Fix overallocation resulted from ceiling in

[jira] [Comment Edited] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202335#comment-16202335 ] Haibo Chen edited comment on YARN-4511 at 10/12/17 5:45 PM: Thanks for the

[jira] [Updated] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7317: --- Affects Version/s: (was: 3.0.0) (was: 2.9.0) > Fix overallocation

[jira] [Updated] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7317: --- Fix Version/s: 3.0.0 2.9.0 > Fix overallocation resulted from ceiling in

[jira] [Updated] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-7321: Attachment: YARN-7321-branch-2.001.patch Attached a branch-2 version of the patch. It just drops all

[jira] [Commented] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202339#comment-16202339 ] Varun Vasudev commented on YARN-7321: - [~wangda] - can you please take a look? Thanks! > Backport

[jira] [Assigned] (YARN-7320) Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_

2017-10-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-7320: --- Assignee: Misha Dmitriev > Duplicate LiteralByteStrings in >

[jira] [Updated] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-12 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-7244: -- Attachment: YARN-7244.005.patch Fixing TestShuffleHandler failures. The TestDistributedScheduler failure

[jira] [Commented] (YARN-7317) Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy

2017-10-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202349#comment-16202349 ] Botong Huang commented on YARN-7317: Great, thanks [~curino]! > Fix overallocation resulted from

[jira] [Commented] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5221

2017-10-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202352#comment-16202352 ] Ray Chiang commented on YARN-7138: -- Given that, then does it actually make sense to have such annotations

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-12 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202354#comment-16202354 ] Vrushali C commented on YARN-7190: -- Hi [~jlowe] We were wondering if you have any thoughts/suggestions

[jira] [Commented] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5221

2017-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202358#comment-16202358 ] Wangda Tan commented on YARN-7138: -- [~rchiang], I'm fine with doing that. > Fix incompatible API change

[jira] [Updated] (YARN-6690) Consolidate NM overallocation thresholds with ResourceTypes

2017-10-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6690: - Description: YARN-3926 (ResourceTypes) introduces a new class ResourceInformation to encapsulate all

[jira] [Commented] (YARN-7202) Add UT for api-server

2017-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202372#comment-16202372 ] Jian He commented on YARN-7202: --- Btw, before commit, I reverted the pom.xml changes in hadoop-project module

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-12 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7159: --- Attachment: YARN-7159.001.patch > Normalize unit of resource objects in RM and avoid to do unit

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-12 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202394#comment-16202394 ] Manikandan R commented on YARN-7159: [~wangda] [~sunilg] Thanks for giving me an opportunity to

[jira] [Created] (YARN-7322) Remove annotations from org.apache.hadoop.yarn.server classes

2017-10-12 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-7322: Summary: Remove annotations from org.apache.hadoop.yarn.server classes Key: YARN-7322 URL: https://issues.apache.org/jira/browse/YARN-7322 Project: Hadoop YARN

[jira] [Commented] (YARN-7322) Remove annotations from org.apache.hadoop.yarn.server classes

2017-10-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202406#comment-16202406 ] Ray Chiang commented on YARN-7322: -- Link to YARN-7138. This JIRA came about from a discussion there. >

[jira] [Commented] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202405#comment-16202405 ] Hadoop QA commented on YARN-7321: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5221

2017-10-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202407#comment-16202407 ] Ray Chiang commented on YARN-7138: -- Thanks. Filed YARN-7322. > Fix incompatible API change for

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-10-12 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202415#comment-16202415 ] Manikandan R commented on YARN-6953: Can we move ahead if patch is good? > Clean up

[jira] [Updated] (YARN-7322) Remove annotations from org.apache.hadoop.yarn.server classes

2017-10-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-7322: - Labels: newbie (was: ) > Remove annotations from org.apache.hadoop.yarn.server classes >

[jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202438#comment-16202438 ] Hadoop QA commented on YARN-7254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7310) TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler

2017-10-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202459#comment-16202459 ] Robert Kanter commented on YARN-7310: - This is blocked on YARN-7270. It's causing an overflow, making

[jira] [Comment Edited] (YARN-7310) TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler

2017-10-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202459#comment-16202459 ] Robert Kanter edited comment on YARN-7310 at 10/12/17 6:52 PM: --- This is

[jira] [Updated] (YARN-7224) Support GPU isolation for docker container

2017-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7224: - Attachment: YARN-7224.004.patch Attached ver.4 patch, fixed warnings / test failures and added more

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202465#comment-16202465 ] Hadoop QA commented on YARN-6608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202480#comment-16202480 ] Wangda Tan commented on YARN-6608: -- [~curino], The latest Jenkins result looks good, shell check is

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202485#comment-16202485 ] Allen Wittenauer commented on YARN-6608: Umm, have you folks actually tried using those shell

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202506#comment-16202506 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202588#comment-16202588 ] Hadoop QA commented on YARN-7190: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202591#comment-16202591 ] Carlo Curino commented on YARN-6608: I agree with Allen, the script are unlikely to work, I think we

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202595#comment-16202595 ] Hadoop QA commented on YARN-7244: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6608: - Attachment: YARN-6608-branch-2.v8.patch [~aw] you're right, they're not work. I just reverted this part

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202601#comment-16202601 ] Jason Lowe commented on YARN-7190: -- Patch looks good overall, works as advertised. It would be good to

[jira] [Updated] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7198: -- Attachment: YARN-7198-yarn-native-services.06.patch > Add jsvc support for RegistryDNS >

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202614#comment-16202614 ] Jian He commented on YARN-7198: --- bq. please link "YARN Registry" in the beginning of the document to the

[jira] [Comment Edited] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202614#comment-16202614 ] Jian He edited comment on YARN-7198 at 10/12/17 9:01 PM: - bq. please link "YARN

[jira] [Commented] (YARN-7319) java.net.UnknownHostException when trying contact node by hostname

2017-10-12 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202642#comment-16202642 ] Elek, Marton commented on YARN-7319: I think it's a valid report even if it's not a bug but rather a

[jira] [Commented] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202660#comment-16202660 ] Wangda Tan commented on YARN-7321: -- [~vvasudev], patch looks good to me. Could you verify if this works

[jira] [Updated] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-12 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7169: - Attachment: YARN-7169-YARN-5355_branch2.0003.patch Uploading v003 with maven changes > Backport new

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202670#comment-16202670 ] Hadoop QA commented on YARN-7169: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7170) Investigate bower dependencies for YARN UI v2

2017-10-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202671#comment-16202671 ] Allen Wittenauer commented on YARN-7170: Using HADOOP-14945 (which fixes docker -i mode when GPG

[jira] [Assigned] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-10-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-1014: Assignee: Miklos Szegedi (was: Haibo Chen) > Configure OOM Killer to kill OPPORTUNISTIC containers

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202698#comment-16202698 ] Hadoop QA commented on YARN-7224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7319) java.net.UnknownHostException when trying contact node by hostname

2017-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202708#comment-16202708 ] Daryn Sharp commented on YARN-7319: --- bq. java.lang.IllegalArgumentException:

[jira] [Updated] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-12 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7169: - Attachment: yarn-ui-screenshot.png Attaching one screenshot of the new yarn ui that I took with a

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202732#comment-16202732 ] Allen Wittenauer commented on YARN-7198: I'm still playing with the last patch, but I'm very

[jira] [Updated] (YARN-7320) Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_

2017-10-12 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated YARN-7320: - Attachment: YARN-7320.01.patch > Duplicate LiteralByteStrings in >

[jira] [Updated] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-12 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7169: - Attachment: YARN-7169-YARN-5355_branch2.0004.patch Updating a rebased patch 004. > Backport new yarn-ui

[jira] [Commented] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202742#comment-16202742 ] Hadoop QA commented on YARN-7169: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Created] (YARN-7323) Some changes in service REST API

2017-10-12 Thread Jian He (JIRA)
Jian He created YARN-7323: - Summary: Some changes in service REST API Key: YARN-7323 URL: https://issues.apache.org/jira/browse/YARN-7323 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7320) Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202780#comment-16202780 ] Hadoop QA commented on YARN-7320: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202787#comment-16202787 ] Allen Wittenauer commented on YARN-7198: Anyway, rebuilt and it started up. Also it didn't switch

[jira] [Comment Edited] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202787#comment-16202787 ] Allen Wittenauer edited comment on YARN-7198 at 10/12/17 11:22 PM: ---

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202807#comment-16202807 ] Hadoop QA commented on YARN-6608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7246) Fix the default docker binary path

2017-10-12 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7246: -- Attachment: YARN-7246-branch-2.8.2.007.patch > Fix the default docker binary path >

[jira] [Commented] (YARN-7246) Fix the default docker binary path

2017-10-12 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202815#comment-16202815 ] Shane Kumpf commented on YARN-7246: --- Thanks for the review [~jlowe]. Attaching a patch where the conf

[jira] [Assigned] (YARN-7311) TestRMWebServicesReservation doesn't really test fair scheduler

2017-10-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-7311: -- Assignee: Yufei Gu > TestRMWebServicesReservation doesn't really test fair scheduler >

[jira] [Updated] (YARN-7311) TestRMWebServicesReservation doesn't really test fair scheduler

2017-10-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7311: --- Attachment: YARN-7311.001.patch > TestRMWebServicesReservation doesn't really test fair scheduler >

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202823#comment-16202823 ] Hadoop QA commented on YARN-7198: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7311) TestRMWebServicesReservation doesn't really test fair scheduler

2017-10-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202833#comment-16202833 ] Yufei Gu commented on YARN-7311: Uploaded patch v1. What I did in it: - Make tests really test for fair

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202837#comment-16202837 ] Yufei Gu commented on YARN-4859: [~subru], I found a bug in reservation system for FS and post patch in

[jira] [Comment Edited] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202837#comment-16202837 ] Yufei Gu edited comment on YARN-4859 at 10/13/17 12:03 AM: --- [~subru], I found a

[jira] [Updated] (YARN-7311) TestRMWebServicesReservation doesn't really test fair scheduler

2017-10-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7311: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-2572 > TestRMWebServicesReservation doesn't

[jira] [Comment Edited] (YARN-7169) Backport new yarn-ui to branch2 code (starting with YARN-5355_branch2)

2017-10-12 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202839#comment-16202839 ] Vrushali C edited comment on YARN-7169 at 10/13/17 12:04 AM: - Also verified

  1   2   >