[jira] [Updated] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5433: -- Attachment: YARN-5433.03.patch Posted patch v.3. Included the full MPL v.1.1. I analyzed a few more

[jira] [Commented] (YARN-5772) Replace old Hadoop logo with new one

2016-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607514#comment-15607514 ] Sunil G commented on YARN-5772: --- Thanks [~ajisakaa]. I will commit the same. > Replace old Hadoop logo with

[jira] [Commented] (YARN-5773) RM recovery too slow due to LeafQueue#activateApplication()

2016-10-25 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607493#comment-15607493 ] Bibin A Chundatt commented on YARN-5773: {quote} we could only invoke activateApplications once

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607487#comment-15607487 ] Sangjin Lee commented on YARN-5433: --- Some/most of the ones that I marked as "already analyzed" are the

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607477#comment-15607477 ] Hadoop QA commented on YARN-5433: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5780) [YARN native service] Allowing YARN native services to post data to timeline service V.2

2016-10-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607406#comment-15607406 ] Vrushali C commented on YARN-5780: -- [~gtCarrera9] let me see if I can take a stab at this. I will reach

[jira] [Assigned] (YARN-5780) [YARN native service] Allowing YARN native services to post data to timeline service V.2

2016-10-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-5780: Assignee: Vrushali C > [YARN native service] Allowing YARN native services to post data to timeline

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607384#comment-15607384 ] Xiao Chen commented on YARN-5433: - Thanks [~sjlee0] for the new rev! For MPL, since it's new, we need to

[jira] [Commented] (YARN-5770) Performance improvement of native-services REST API service

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607341#comment-15607341 ] Hadoop QA commented on YARN-5770: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2016-10-25 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607338#comment-15607338 ] stefanlee commented on YARN-4014: - [~rohithsharma] [~jianhe] thanks for sharing this jira ,i have added

[jira] [Updated] (YARN-5770) Performance improvement of native-services REST API service

2016-10-25 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-5770: Attachment: YARN-5770-yarn-native-services.004.patch Oops, had an unnecessary public modifier in the

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607259#comment-15607259 ] Hadoop QA commented on YARN-4757: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5680) Add 2 new fields in Slider status output - image-name and is-privileged-container

2016-10-25 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-5680: Fix Version/s: yarn-native-services > Add 2 new fields in Slider status output - image-name and >

[jira] [Comment Edited] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606182#comment-15606182 ] Sunil G edited comment on YARN-5545 at 10/26/16 2:58 AM: - Extremely for the

[jira] [Commented] (YARN-5680) Add 2 new fields in Slider status output - image-name and is-privileged-container

2016-10-25 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607222#comment-15607222 ] Gour Saha commented on YARN-5680: - Thanks [~billie.rinaldi]. The patch looks good. I ran the tests and the

[jira] [Commented] (YARN-5773) RM recovery too slow due to LeafQueue#activateApplication()

2016-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607225#comment-15607225 ] Sunil G commented on YARN-5773: --- Currently we are trying to invoke activateApplications while recovering

[jira] [Commented] (YARN-5770) Performance improvement of native-services REST API service

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607223#comment-15607223 ] Hadoop QA commented on YARN-5770: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5770) Performance improvement of native-services REST API service

2016-10-25 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607160#comment-15607160 ] Gour Saha commented on YARN-5770: - [~billie.rinaldi] thank you for reviewing the patch. I uploaded a 003

[jira] [Updated] (YARN-5770) Performance improvement of native-services REST API service

2016-10-25 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-5770: Attachment: YARN-5770-yarn-native-services.003.patch > Performance improvement of native-services REST API

[jira] [Commented] (YARN-5752) TestLocalResourcesTrackerImpl#testLocalResourceCache times out

2016-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607028#comment-15607028 ] Miklos Szegedi commented on YARN-5752: -- Thank you, [~ebadger] for the fix! You might want to consider

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607017#comment-15607017 ] Hadoop QA commented on YARN-5433: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-10-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607003#comment-15607003 ] Naganarasimha G R commented on YARN-5765: - bq. I think doing "perm = perm | S_ISGID" will set the

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-25 Thread Venkat Ranganathan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606996#comment-15606996 ] Venkat Ranganathan commented on YARN-4126: -- [~jianhe] IIRC, the issue is that since the delegation

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606964#comment-15606964 ] Jian He commented on YARN-4126: --- bq. what was the motivation for removing the delegation tokens and throwing

[jira] [Updated] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5433: -- Attachment: YARN-5433.02.patch Posted patch v.2. Generated the output using the script provided by

[jira] [Commented] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606943#comment-15606943 ] Miklos Szegedi commented on YARN-5774: -- Hi [~yufeigu]! I am wondering, if the normalize methods for

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606872#comment-15606872 ] Sangjin Lee commented on YARN-5433: --- Thanks for the pointer [~xiaochen]! I played with the python

[jira] [Commented] (YARN-4907) Make all MockRM#waitForState consistent.

2016-10-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606864#comment-15606864 ] Yufei Gu commented on YARN-4907: Thanks [~miklos.szeg...@cloudera.com] for the review. I will upload a new

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-10-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606834#comment-15606834 ] Zhe Zhang commented on YARN-5734: - Since there is some overlap between this JIRA's objectives and those of

[jira] [Commented] (YARN-5587) Add support for resource profiles

2016-10-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606760#comment-15606760 ] Arun Suresh commented on YARN-5587: --- Hmmm... Actually, I think we have to deal with one other issue in

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606758#comment-15606758 ] Andrew Wang commented on YARN-4126: --- One little request, if we do revert this, let's please do so under a

[jira] [Commented] (YARN-4457) Cleanup unchecked types for EventHandler

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606752#comment-15606752 ] Hadoop QA commented on YARN-4457: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4457) Cleanup unchecked types for EventHandler

2016-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606745#comment-15606745 ] Miklos Szegedi commented on YARN-4457: -- +1 (non-binding). I verified and it looks good to me. Thank

[jira] [Commented] (YARN-5587) Add support for resource profiles

2016-10-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606739#comment-15606739 ] Arun Suresh commented on YARN-5587: --- I feel we should try to keep this simple. Given that we have already

[jira] [Commented] (YARN-4907) Make all MockRM#waitForState consistent.

2016-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606716#comment-15606716 ] Miklos Szegedi commented on YARN-4907: -- +1 (non-binding) I verified and it looks good to me. Thank

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606711#comment-15606711 ] Xiao Chen commented on YARN-5433: - Thanks [~sjlee0] for working on this (and the ping). For HADOOP-12893,

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606709#comment-15606709 ] Hadoop QA commented on YARN-4734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5433: -- Attachment: YARN-5433.01.patch Attaching the first version of the patch. - excluded findbugs

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606628#comment-15606628 ] Robert Kanter commented on YARN-4126: - That's a good point [~daryn]. [~jianhe], what was the

[jira] [Commented] (YARN-5767) Fix the order that resources are cleaned up from the local Public/Private caches

2016-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606624#comment-15606624 ] Miklos Szegedi commented on YARN-5767: -- +1 (non-binding) Thank you, [~ctrezzo]! I have a few optional

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-10-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606587#comment-15606587 ] Daryn Sharp commented on YARN-4126: --- The general contract for servers is to return null when tokens are

[jira] [Commented] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606560#comment-15606560 ] Hadoop QA commented on YARN-5716: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5780) [YARN native service] Allowing YARN native services to post data to timeline service V.2

2016-10-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5780: Attachment: YARN-5780.poc.patch POC patch to launch timeline client and post timeline data. This patch applies to

[jira] [Updated] (YARN-5780) [YARN native service] Allowing YARN native services to post data to timeline service V.2

2016-10-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5780: Assignee: (was: Li Lu) > [YARN native service] Allowing YARN native services to post data to timeline > service

[jira] [Updated] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-10-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5765: -- Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.8.0) > LinuxContainerExecutor creates appcache and its

[jira] [Created] (YARN-5780) [YARN native service] Allowing YARN native services to post data to timeline service V.2

2016-10-25 Thread Li Lu (JIRA)
Li Lu created YARN-5780: --- Summary: [YARN native service] Allowing YARN native services to post data to timeline service V.2 Key: YARN-5780 URL: https://issues.apache.org/jira/browse/YARN-5780 Project: Hadoop

[jira] [Commented] (YARN-5680) Add 2 new fields in Slider status output - image-name and is-privileged-container

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606496#comment-15606496 ] Hadoop QA commented on YARN-5680: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5388) Deprecate and remove DockerContainerExecutor

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606468#comment-15606468 ] Hudson commented on YARN-5388: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10677 (See

[jira] [Updated] (YARN-5680) Add 2 new fields in Slider status output - image-name and is-privileged-container

2016-10-25 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-5680: - Attachment: YARN-5680-yarn-native-services.001.patch > Add 2 new fields in Slider status output -

[jira] [Commented] (YARN-4330) MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages.

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606444#comment-15606444 ] Hadoop QA commented on YARN-4330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4330) MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages.

2016-10-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606445#comment-15606445 ] Eric Badger commented on YARN-4330: --- I applied the most recent patch the branch-2.8 and ran

[jira] [Commented] (YARN-4330) MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages.

2016-10-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606417#comment-15606417 ] Eric Badger commented on YARN-4330: --- [~ste...@apache.org], there's talk on the mailing list of releasing

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-10-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606382#comment-15606382 ] Daniel Templeton commented on YARN-5694: The branch-2.7 patch is out of date. I stopped updating

[jira] [Updated] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-10-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5694: --- Attachment: YARN-5694.006.patch Here's a patch to add the null check back. I don't think we

[jira] [Updated] (YARN-5388) Deprecate and remove DockerContainerExecutor

2016-10-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5388: --- Summary: Deprecate and remove DockerContainerExecutor (was: MAPREDUCE-6719 requires changes

[jira] [Commented] (YARN-5388) MAPREDUCE-6719 requires changes to DockerContainerExecutor

2016-10-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606374#comment-15606374 ] Karthik Kambatla commented on YARN-5388: My bad. I missed the fix parts of the code in the rest of

[jira] [Commented] (YARN-5770) Performance improvement of native-services REST API service

2016-10-25 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606354#comment-15606354 ] Gour Saha commented on YARN-5770: - Makes sense. Let me add it to SliderClientAPI so that when we split it,

[jira] [Commented] (YARN-5433) Audit dependencies for Category-X

2016-10-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606346#comment-15606346 ] Sangjin Lee commented on YARN-5433: --- I have done a more comprehensive analysis, and am building a

[jira] [Commented] (YARN-5770) Performance improvement of native-services REST API service

2016-10-25 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606339#comment-15606339 ] Billie Rinaldi commented on YARN-5770: -- [~gsaha], I built with the patch, ran unit tests, and tried

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-10-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606332#comment-15606332 ] Vrushali C commented on YARN-5739: -- So if we need only some entity types, then it's even easier I think.

[jira] [Commented] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-10-25 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606322#comment-15606322 ] Haibo Chen commented on YARN-5765: -- I think doing "perm = perm | S_ISGID" will set the setGID bit

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-10-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606313#comment-15606313 ] Li Lu commented on YARN-5739: - Thanks [~vrushalic]! Yes. One concern we had was the scan may need to go

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606304#comment-15606304 ] Hadoop QA commented on YARN-4734: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Commented] (YARN-5777) TestLogsCLI#testFetchApplictionLogsAsAnotherUser fails

2016-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606302#comment-15606302 ] Hudson commented on YARN-5777: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10676 (See

[jira] [Updated] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4734: - Attachment: YARN-4734.17.patch Oops, just used wrong way to generate the patch, attach the correct one

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606279#comment-15606279 ] Hadoop QA commented on YARN-4734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4734: - Attachment: YARN-4734.16.patch Attached ver.16 included notes of security environment in doc. > Merge

[jira] [Updated] (YARN-5779) [YARN-3368] Document limits/notes of the new YARN UI

2016-10-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5779: - Attachment: YARN-5779-YARN-3368.01.patch Attached ver.1 patch, [~sunilg] plz review. > [YARN-3368]

[jira] [Commented] (YARN-5777) TestLogsCLI#testFetchApplictionLogsAsAnotherUser fails

2016-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606203#comment-15606203 ] Xiao Chen commented on YARN-5777: - Thanks [~ajisakaa] for the catch. The analysis make sense, +1.

[jira] [Updated] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5716: - Attachment: YARN-5716.009.patch Thanks [~sunilg] for comments: For 1), yes it looks like we're doing UL

[jira] [Commented] (YARN-3649) Allow configurable prefix for hbase table names (like prod, exp, test etc)

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606192#comment-15606192 ] Hadoop QA commented on YARN-3649: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606182#comment-15606182 ] Sunil G commented on YARN-5545: --- Currently we are trying to invoke {{activateApplications}} while recovering

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-10-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606155#comment-15606155 ] Karthik Kambatla commented on YARN-5694: I have minor comments (nits) on the trunk patch: #

[jira] [Commented] (YARN-5777) TestLogsCLI#testFetchApplictionLogsAsAnotherUser fails

2016-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606081#comment-15606081 ] John Zhuge commented on YARN-5777: -- +1 (non-binding) The change looks good to me. Thanks [~ajisakaa] for

[jira] [Commented] (YARN-5548) Random test failure TestRMRestart#testFinishedAppRemovalAfterRMRestart

2016-10-25 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606080#comment-15606080 ] Bibin A Chundatt commented on YARN-5548: If there a delay in getting YARN-5375 we can push this

[jira] [Updated] (YARN-3649) Allow configurable prefix for hbase table names (like prod, exp, test etc)

2016-10-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3649: - Attachment: YARN-3649-YARN-5355.005.patch Uploading v5 that addresses Varun's suggestions. Diff between

[jira] [Updated] (YARN-5775) Convert enums in swagger definition to uppercase

2016-10-25 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-5775: - Summary: Convert enums in swagger definition to uppercase (was: Bug fixes in swagger definition)

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-10-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606036#comment-15606036 ] Vrushali C commented on YARN-5739: -- Actually, this is not that hard to do. It requires making two queries:

[jira] [Commented] (YARN-4173) Ensure the final values for metrics/events are emitted/stored at APP completion time

2016-10-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606017#comment-15606017 ] Vrushali C commented on YARN-4173: -- In YARN-5747, the final aggregation is being done explicitly, so need

[jira] [Commented] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2016-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606015#comment-15606015 ] Allen Wittenauer commented on YARN-5366: I think you misunderstood what I was pointing out. If the

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606009#comment-15606009 ] Allen Wittenauer commented on YARN-5428: Nope. Given that probably no one is going to use YARN as

[jira] [Commented] (YARN-3649) Allow configurable prefix for hbase table names (like prod, exp, test etc)

2016-10-25 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606006#comment-15606006 ] Vrushali C commented on YARN-3649: -- Thanks Varun, making the changes, will upload a patch shortly. >

[jira] [Created] (YARN-5779) [YARN-3368] Document limits/notes of the new YARN UI

2016-10-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5779: Summary: [YARN-3368] Document limits/notes of the new YARN UI Key: YARN-5779 URL: https://issues.apache.org/jira/browse/YARN-5779 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605982#comment-15605982 ] Wangda Tan commented on YARN-4734: -- [~aw], thanks. I think we can move the AltKerberos discussions to

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605908#comment-15605908 ] Hadoop QA commented on YARN-4743: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5770) Performance improvement of native-services REST API service

2016-10-25 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605889#comment-15605889 ] Billie Rinaldi commented on YARN-5770: -- This patch looks good to me. I will test it out locally before

[jira] [Commented] (YARN-5778) Add .keep file for yarn native services AM web app

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605887#comment-15605887 ] Hadoop QA commented on YARN-5778: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5775) Bug fixes in swagger definition

2016-10-25 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605886#comment-15605886 ] Billie Rinaldi commented on YARN-5775: -- +1, straightforward patch. > Bug fixes in swagger definition

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605875#comment-15605875 ] Allen Wittenauer commented on YARN-4734: No, I saw it. I just opted to ignore it. We had already

[jira] [Commented] (YARN-5778) Add .keep file for yarn native services AM web app

2016-10-25 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605868#comment-15605868 ] Gour Saha commented on YARN-5778: - Looks good. +1 for the patch. > Add .keep file for yarn native services

[jira] [Updated] (YARN-5778) Add .keep file for yarn native services AM web app

2016-10-25 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-5778: - Attachment: YARN-5778-yarn-native-services.001.patch > Add .keep file for yarn native services AM

[jira] [Created] (YARN-5778) Add .keep file for yarn native services AM web app

2016-10-25 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-5778: Summary: Add .keep file for yarn native services AM web app Key: YARN-5778 URL: https://issues.apache.org/jira/browse/YARN-5778 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5548) Random test failure TestRMRestart#testFinishedAppRemovalAfterRMRestart

2016-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605769#comment-15605769 ] Sunil G commented on YARN-5548: --- YARN-5375 is having a state-store based solution now. Hence we can ensure

[jira] [Updated] (YARN-4743) ResourceManager crash because TimSort

2016-10-25 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zephyr Guo updated YARN-4743: - Attachment: YARN-4743-v4.patch > ResourceManager crash because TimSort >

[jira] [Commented] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-10-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605683#comment-15605683 ] Sunil G commented on YARN-5716: --- Thanks [~leftnoteasy] for the update. Few more general comments: 1.

[jira] [Commented] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-10-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605561#comment-15605561 ] Naganarasimha G R commented on YARN-5765: - Thanks [~haibochen], for giving some insights on the

[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605535#comment-15605535 ] Hadoop QA commented on YARN-5148: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4463) Container launch failure when yarn.nodemanager.log-dirs directory path contains space

2016-10-25 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605532#comment-15605532 ] Bibin A Chundatt commented on YARN-4463: [~sunilg]/[~rohithsharma] Another option can we to skip

[jira] [Updated] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2016-10-25 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-5148: - Attachment: YARN-5148-YARN-3368.05.patch > [YARN-3368] Add page to new YARN UI to view server side >

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605453#comment-15605453 ] Hadoop QA commented on YARN-5375: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >