[jira] [Updated] (YARN-3069) Document missing properties in yarn-default.xml

2015-04-27 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3069: - Attachment: YARN-3069.004.patch Add exceptions for the yarn.nodemanager.resource.* properties. Document

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-27 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513583#comment-14513583 ] Gera Shegalov commented on YARN-2893: - Thanks for the 003 patch, [~zxu]! I agree that

[jira] [Commented] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513599#comment-14513599 ] Hadoop QA commented on YARN-3448: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3547) Apps that have no resource demand should not participate scheduling

2015-04-27 Thread Xianyin Xin (JIRA)
Xianyin Xin created YARN-3547: - Summary: Apps that have no resource demand should not participate scheduling Key: YARN-3547 URL: https://issues.apache.org/jira/browse/YARN-3547 Project: Hadoop YARN

[jira] [Commented] (YARN-3069) Document missing properties in yarn-default.xml

2015-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513627#comment-14513627 ] Hadoop QA commented on YARN-3069: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-04-27 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513797#comment-14513797 ] Rohith commented on YARN-3543: -- It would be nice if it is displayed in RM Web UI

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513930#comment-14513930 ] Junping Du commented on YARN-3431: -- Just thought it again, this should go first given many

[jira] [Commented] (YARN-3549) use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation from RawLocalFileSystem in checkLocalDir.

2015-04-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514878#comment-14514878 ] zhihai xu commented on YARN-3549: - Thanks [~cnauroth], It is very nice of you to help test

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514957#comment-14514957 ] Hudson commented on YARN-3464: -- FAILURE: Integrated in Hadoop-trunk-Commit #7688 (See

[jira] [Commented] (YARN-3465) Use LinkedHashMap to preserve order of resource requests

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514956#comment-14514956 ] Hudson commented on YARN-3465: -- FAILURE: Integrated in Hadoop-trunk-Commit #7688 (See

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514955#comment-14514955 ] Hudson commented on YARN-3516: -- FAILURE: Integrated in Hadoop-trunk-Commit #7688 (See

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515075#comment-14515075 ] Li Lu commented on YARN-3411: - One alternative plan is to try the 4.4.0 snapshot version of

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-04-27 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515016#comment-14515016 ] Hitesh Shah commented on YARN-2859: --- [~zjshen] Are you planning to look at this?

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514872#comment-14514872 ] Sangjin Lee commented on YARN-3411: --- [~vinodkv], that's what I understood as well. The

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514942#comment-14514942 ] Vrushali C commented on YARN-3411: -- Hi Li I see. Hmm. So there are some major changes

[jira] [Updated] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3464: --- Fix Version/s: (was: 2.8.0) 2.7.1 Committed to branch-2.7 as well.

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514794#comment-14514794 ] Hadoop QA commented on YARN-2740: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-04-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514945#comment-14514945 ] Vinod Kumar Vavilapalli commented on YARN-3543: --- This should go into CLI, web

[jira] [Commented] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-04-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514990#comment-14514990 ] Vinod Kumar Vavilapalli commented on YARN-3543: --- Nah, it is small enough to

[jira] [Commented] (YARN-3468) NM should not blindly rename usercache/filecache/nmPrivate on restart

2015-04-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514880#comment-14514880 ] Sangjin Lee commented on YARN-3468: --- It seems the test failures are related to the patch.

[jira] [Commented] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-04-27 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514976#comment-14514976 ] Spandan Dutta commented on YARN-3543: - Do you guys think it would be a good idea to

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515072#comment-14515072 ] Vinod Kumar Vavilapalli commented on YARN-3411: --- I think the bigger question

[jira] [Commented] (YARN-2784) Make POM project names consistent

2015-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514799#comment-14514799 ] Hadoop QA commented on YARN-2784: - (!) The patch artifact directory on has been removed!

[jira] [Commented] (YARN-2784) Make POM project names consistent

2015-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514812#comment-14514812 ] Hadoop QA commented on YARN-2784: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3550) Improve YARN RM REST API error messages

2015-04-27 Thread Rajesh Kartha (JIRA)
Rajesh Kartha created YARN-3550: --- Summary: Improve YARN RM REST API error messages Key: YARN-3550 URL: https://issues.apache.org/jira/browse/YARN-3550 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3549) use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation from RawLocalFileSystem in checkLocalDir.

2015-04-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514842#comment-14514842 ] Chris Nauroth commented on YARN-3549: - Hi [~zxu]. Since this is a proposal to call

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514899#comment-14514899 ] Jason Lowe commented on YARN-3535: -- Yes, the resource request needs to be added back.

[jira] [Commented] (YARN-3468) NM should not blindly rename usercache/filecache/nmPrivate on restart

2015-04-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514929#comment-14514929 ] Vinod Kumar Vavilapalli commented on YARN-3468: --- What do you mean by NM

[jira] [Updated] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-27 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3516: --- Fix Version/s: (was: 2.8.0) 2.7.1 Committed this to branch-2.7 as well

[jira] [Updated] (YARN-3465) Use LinkedHashMap to preserve order of resource requests

2015-04-27 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3465: --- Fix Version/s: (was: 2.8.0) 2.7.1 Committed this to branch-2.7 as well.

[jira] [Created] (YARN-3548) Missing doc for security configuration for timeline service feature

2015-04-27 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3548: -- Summary: Missing doc for security configuration for timeline service feature Key: YARN-3548 URL: https://issues.apache.org/jira/browse/YARN-3548 Project: Hadoop

[jira] [Assigned] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-04-27 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-3543: Assignee: Rohith ApplicationReport should be able to tell whether the Application is AM managed or not.

[jira] [Updated] (YARN-2123) Progress bars in Web UI always at 100% due to non-US locale

2015-04-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-2123: Attachment: yarn-site-ajisaka.xml fair-scheduler-ajisaka.xml Attaching my settings.

[jira] [Commented] (YARN-2123) Progress bars in Web UI always at 100% due to non-US locale

2015-04-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513613#comment-14513613 ] Akira AJISAKA commented on YARN-2123: - bq. Could you check whether this problem happens

[jira] [Commented] (YARN-2123) Progress bars in Web UI always at 100% due to non-US locale

2015-04-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513617#comment-14513617 ] Akira AJISAKA commented on YARN-2123: - bq. How about adding StringUtils.format()? It

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514003#comment-14514003 ] Hudson commented on YARN-3464: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #167 (See

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-04-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514113#comment-14514113 ] Junping Du commented on YARN-3212: -- In addition, per [~jlowe]'s comments in YARN-3535

[jira] [Updated] (YARN-3547) Apps that have no resource demand should not participate scheduling

2015-04-27 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated YARN-3547: -- Attachment: YARN-3547.001.patch A suggested solution provided. Apps that have no resource demand

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513989#comment-14513989 ] Junping Du commented on YARN-3411: -- Just 2 cents on comments above: bq. By

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513984#comment-14513984 ] Hudson commented on YARN-3464: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2108 (See

[jira] [Updated] (YARN-3172) MR-279: Write a simple Java application

2015-04-27 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3172: Labels: (was: newbie) Thanks [~aw] for looking into the patch and trying to commit it. I will rebase and

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514107#comment-14514107 ] Junping Du commented on YARN-3535: -- Sorry for coming late on this. Discussion above sounds

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514012#comment-14514012 ] Hudson commented on YARN-3464: -- FAILURE: Integrated in Hadoop-Yarn-trunk #910 (See

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514018#comment-14514018 ] Hudson commented on YARN-3464: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #176 (See

[jira] [Commented] (YARN-3530) ATS throws exception on trying to filter results without otherinfo.

2015-04-27 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514204#comment-14514204 ] Prakash Ramachandran commented on YARN-3530: LGTM. ATS throws exception on

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514190#comment-14514190 ] Junping Du commented on YARN-3535: -- [~jlowe], [~peng.zhang] and [~rohithsharma], from my

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514137#comment-14514137 ] Jason Lowe commented on YARN-3464: -- Given this is reportedly much more frequent with

[jira] [Commented] (YARN-3547) Apps that have no resource demand should not participate scheduling

2015-04-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514170#comment-14514170 ] Jason Lowe commented on YARN-3547: -- This looks like a duplicate of YARN-2176. There is

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-04-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514182#comment-14514182 ] Junping Du commented on YARN-3212: -- bq. we also need to verify the scheduler hasn't

[jira] [Updated] (YARN-2740) Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2740: - Summary: Fix NodeLabelsManager to properly handle node label modifications when distributed node label

[jira] [Commented] (YARN-3551) Consolidate data model change according to the backend implementation

2015-04-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516073#comment-14516073 ] Li Lu commented on YARN-3551: - Hi [~zjshen], thanks for the patch! Some quick comments and

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516107#comment-14516107 ] Hadoop QA commented on YARN-3134: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3551) Consolidate data model change according to the backend implementation

2015-04-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3551: -- Attachment: YARN-3551.1.patch Upload the patch to fix the issues above. In addition, I added the logic

[jira] [Commented] (YARN-2740) Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515992#comment-14515992 ] Naganarasimha G R commented on YARN-2740: - Thanks [~wangda], for reviewing and

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516013#comment-14516013 ] Arun Suresh commented on YARN-3485: --- +1, LGTM Thanks for working on this [~kasha]

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515134#comment-14515134 ] Wangda Tan commented on YARN-2740: -- Have you checked it in your local environment?

[jira] [Commented] (YARN-2092) Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to 2.5.0-SNAPSHOT

2015-04-27 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515828#comment-14515828 ] Hitesh Shah commented on YARN-2092: --- Closing this out as it is no longer an issue for

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515121#comment-14515121 ] Hadoop QA commented on YARN-2740: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515163#comment-14515163 ] Zhijie Shen commented on YARN-3411: --- bq. Can we make both the implementations use

[jira] [Updated] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3544: -- Priority: Blocker (was: Critical) Seems like a regression. Marking it as a

[jira] [Resolved] (YARN-2092) Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to 2.5.0-SNAPSHOT

2015-04-27 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah resolved YARN-2092. --- Resolution: Not A Problem Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to

[jira] [Commented] (YARN-2740) Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515876#comment-14515876 ] Hudson commented on YARN-2740: -- FAILURE: Integrated in Hadoop-trunk-Commit #7690 (See

[jira] [Updated] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3134: Attachment: YARN-3134-042715.patch In this patch I addressed most of the review comments. Major changes include: #

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-04-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515108#comment-14515108 ] Jason Lowe commented on YARN-3212: -- bq. releasing an unlaunched container is pretty cheap

[jira] [Updated] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-04-27 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-2859: -- Target Version/s: 2.6.1, 2.8.0 (was: 2.8.0) ApplicationHistoryServer binds to default port 8188 in

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515089#comment-14515089 ] Steve Loughran commented on YARN-3539: -- I hadn't seen YARN-1876 ; it's more complete

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515130#comment-14515130 ] Naganarasimha G R commented on YARN-2740: - Hi [~wangda], seems like the test

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515167#comment-14515167 ] Vinod Kumar Vavilapalli commented on YARN-3544: --- Can you add a test-case?

[jira] [Updated] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3544: Attachment: Screen Shot 2015-04-27 at 6.24.05 PM.png AM logs link missing in the RM UI for a completed app

[jira] [Updated] (YARN-2578) NM does not failover timely if RM node network connection fails

2015-04-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2578: -- Target Version/s: 2.8.0 (was: 2.6.0) I now understand the context of HDFS-4858.

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516138#comment-14516138 ] Xuan Gong commented on YARN-3544: - This is the web ui changes. That is why I do not add any

[jira] [Commented] (YARN-3551) Consolidate data model change according to the backend implementation

2015-04-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516359#comment-14516359 ] Zhijie Shen commented on YARN-3551: --- Li, thanks for the comments. See the following

[jira] [Commented] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-27 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516346#comment-14516346 ] Sidharta Seethana commented on YARN-2619: - Thanks for the patch, [~vvasudev].

[jira] [Commented] (YARN-3521) Support return structured NodeLabel objects in REST API when call getClusterNodeLabels

2015-04-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516214#comment-14516214 ] Sunil G commented on YARN-3521: --- Yes. [~leftnoteasy] This change suggestion looks fine for

[jira] [Commented] (YARN-2578) NM does not failover timely if RM node network connection fails

2015-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516201#comment-14516201 ] Hadoop QA commented on YARN-2578: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514291#comment-14514291 ] Hudson commented on YARN-3464: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #177 (See

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner kills localizer before localizing all resources

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514305#comment-14514305 ] Hudson commented on YARN-3464: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2126 (See

[jira] [Commented] (YARN-2784) Make POM project names consistent

2015-04-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514281#comment-14514281 ] Allen Wittenauer commented on YARN-2784: Kicked it off manually, as I want to see

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514388#comment-14514388 ] Junping Du commented on YARN-3134: -- I would like to raise an important issue for reusing

[jira] [Commented] (YARN-2784) Make POM project names consistent

2015-04-27 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514402#comment-14514402 ] Rohith commented on YARN-2784: -- Thanks [~aw] .. I will pull out MR into to separate JIRA and

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514431#comment-14514431 ] Zhijie Shen commented on YARN-3431: --- Junping, thanks! I've rebased the patch. Sub

[jira] [Updated] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3431: -- Attachment: YARN-3431.7.patch Sub resources of timeline entity needs to be passed to a separate

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515135#comment-14515135 ] Vrushali C commented on YARN-3411: -- Hi [~vinodkv] bq. Can we make both the

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515187#comment-14515187 ] Jian He commented on YARN-3517: --- I think below callerUGI can never never null {code}

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14515839#comment-14515839 ] Wangda Tan commented on YARN-2740: -- Just verified in local environment, TestRM can get

[jira] [Created] (YARN-3551) Consolidate data model change according the backend implementation

2015-04-27 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3551: - Summary: Consolidate data model change according the backend implementation Key: YARN-3551 URL: https://issues.apache.org/jira/browse/YARN-3551 Project: Hadoop YARN

[jira] [Updated] (YARN-3551) Consolidate data model change according to the backend implementation

2015-04-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3551: -- Summary: Consolidate data model change according to the backend implementation (was: Consolidate data

[jira] [Updated] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2619: Attachment: YARN-2619.001.patch [YARN-3443] introduces a resource handler chain which cleans up a

[jira] [Commented] (YARN-2176) CapacityScheduler loops over all running applications rather than actively requesting apps

2015-04-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514506#comment-14514506 ] Wangda Tan commented on YARN-2176: -- [~jlowe], this problem should be resolved in CS after

[jira] [Commented] (YARN-3530) ATS throws exception on trying to filter results without otherinfo.

2015-04-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514505#comment-14514505 ] Xuan Gong commented on YARN-3530: - +1 LGTM. Will commit ATS throws exception on trying to

[jira] [Commented] (YARN-3530) ATS throws exception on trying to filter results without otherinfo.

2015-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514518#comment-14514518 ] Hudson commented on YARN-3530: -- FAILURE: Integrated in Hadoop-trunk-Commit #7686 (See

[jira] [Commented] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-27 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514527#comment-14514527 ] Wei Yan commented on YARN-2619: --- Thanks, [~vvasudev]. NodeManager: Add cgroups support for

[jira] [Updated] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2740: - Attachment: YARN-2740.20150423-1-merged.patch Rebased and merge conflicts with latest trunk to kick

[jira] [Commented] (YARN-2784) Make POM project names consistent

2015-04-27 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514537#comment-14514537 ] Rohith commented on YARN-2784: -- Created MAPREDUCE-6342 for tracking at MR changes Make POM

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

2015-04-27 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514536#comment-14514536 ] Gera Shegalov commented on YARN-3491: - Agreed, reducing the number of system calls is a

[jira] [Commented] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-04-27 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514546#comment-14514546 ] Spandan Dutta commented on YARN-3543: - Could you guys assign this to me. I was planning

[jira] [Updated] (YARN-2784) Make POM project names consistent

2015-04-27 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2784: - Attachment: YARN-2784.patch Make POM project names consistent -

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514466#comment-14514466 ] Sangjin Lee commented on YARN-3411: --- bq. In detail thinking, HBase relies on Hadoop/HDFS

[jira] [Updated] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2619: Attachment: (was: YARN-2619.001.patch) NodeManager: Add cgroups support for disk I/O isolation

[jira] [Commented] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514512#comment-14514512 ] Varun Vasudev commented on YARN-2619: - Forgot to mention, # The new patch refactors

  1   2   >