[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.015.patch YARN-3706-YARN-2928.015.patch local runs in pseudo d

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589354#comment-14589354 ] Joep Rottinghuis commented on YARN-3706: Fixed code, now have successful run: {nofo

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-16 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589338#comment-14589338 ] Devaraj K commented on YARN-3809: - bq. The checkstyle error is : YarnConfiguration.java: Fi

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589305#comment-14589305 ] Joep Rottinghuis commented on YARN-3706: Yeah, we can create an entity sub-package

[jira] [Updated] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3804: --- Attachment: YARN-3804.05.patch > Both RM are on standBy state when kerberos user not in yarn.admin.acl

[jira] [Commented] (YARN-2305) When a container is in reserved state then total cluster memory is displayed wrongly.

2015-06-16 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589294#comment-14589294 ] Rohith commented on YARN-2305: -- Updated the duplicated id link. > When a container is in rese

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589287#comment-14589287 ] Zhijie Shen commented on YARN-3706: --- I didn't check the patch details, but according to t

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589258#comment-14589258 ] Varun Saxena commented on YARN-3804: Test failures are related. Will fix them > Both R

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589257#comment-14589257 ] Varun Saxena commented on YARN-3804: Test failures are related. Will fix them > Both R

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

2015-06-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589256#comment-14589256 ] Jian He commented on YARN-3811: --- I'm actually thinking do we still need the NMNotYetReadyExce

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589255#comment-14589255 ] Joep Rottinghuis commented on YARN-3706: Good call on the testing. Interesting res

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589253#comment-14589253 ] Vinod Kumar Vavilapalli commented on YARN-3798: --- Trying to follow the discuss

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

2015-06-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589240#comment-14589240 ] Vinod Kumar Vavilapalli commented on YARN-3811: --- bq. I kind of agree, but thi

[jira] [Commented] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589236#comment-14589236 ] Wei Shao commented on YARN-3806: One more comment :) Regarding YARN-3318. Yes, this propos

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589217#comment-14589217 ] Hadoop QA commented on YARN-3804: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589201#comment-14589201 ] Wei Shao commented on YARN-3806: Hi Wangda Tan, Regarding #4 in your comments. (Decouple a

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

2015-06-16 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589179#comment-14589179 ] Chun Chen commented on YARN-1983: - [~sidharta-s], thanks for letting me know the progress o

[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589174#comment-14589174 ] Robert Kanter commented on YARN-3812: - +1 pending Jenkins > TestRollingLevelDBTimeline

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-16 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589164#comment-14589164 ] Jun Gong commented on YARN-3809: The checkstyle error is : YarnConfiguration.java: File len

[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589154#comment-14589154 ] Bibin A Chundatt commented on YARN-3812: Please review patch uploaded > TestRollin

[jira] [Commented] (YARN-3645) ResourceManager can't start success if attribute value of "aclSubmitApps" is null in fair-scheduler.xml

2015-06-16 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589141#comment-14589141 ] Gabor Liptak commented on YARN-3645: Uploaded same patch to validate if still applies c

[jira] [Updated] (YARN-3645) ResourceManager can't start success if attribute value of "aclSubmitApps" is null in fair-scheduler.xml

2015-06-16 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-3645: --- Attachment: YARN-3645.3.patch > ResourceManager can't start success if attribute value of "aclSubmitAp

[jira] [Updated] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3812: --- Attachment: 0001-YARN-3812.patch > TestRollingLevelDBTimelineStore fails in trunk due to HADOOP

[jira] [Assigned] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned YARN-3812: -- Assignee: Bibin A Chundatt > TestRollingLevelDBTimelineStore fails in trunk due to HADOO

[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589121#comment-14589121 ] Robert Kanter commented on YARN-3812: - [~bibinchundatt], good find! That fixes the tes

[jira] [Commented] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589117#comment-14589117 ] Bibin A Chundatt commented on YARN-3812: {{RawLocalFileSystem#mkOneDirWithMode}} ap

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.1.pdf) > Proposal of Generic Scheduling Fr

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.1.pdf Some minor updates to proposal. > Proposal of

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

2015-06-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589098#comment-14589098 ] Karthik Kambatla commented on YARN-3811: By the way, here is the stack trace: {nof

[jira] [Updated] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-3812: Assignee: (was: Robert Kanter) > TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-113

[jira] [Updated] (YARN-3261) rewrite resourcemanager restart doc to remove roadmap bits

2015-06-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3261: --- Labels: (was: BB2015-05-TBR) > rewrite resourcemanager restart doc to remove roadmap bits >

[jira] [Assigned] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-3812: --- Assignee: Robert Kanter > TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347 >

[jira] [Updated] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-3812: Component/s: (was: timelineserver) test > TestRollingLevelDBTimelineStore fails

[jira] [Created] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

2015-06-16 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-3812: --- Summary: TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347 Key: YARN-3812 URL: https://issues.apache.org/jira/browse/YARN-3812 Project: Hadoop YARN

[jira] [Commented] (YARN-3797) NodeManager not blacklisting the disk (shuffle) with errors

2015-06-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589070#comment-14589070 ] Allen Wittenauer commented on YARN-3797: This is the type of problem where one woul

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

2015-06-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589059#comment-14589059 ] Karthik Kambatla commented on YARN-3811: This wasn't as big an issue without work-p

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589055#comment-14589055 ] Wangda Tan commented on YARN-1197: -- [~mding], The latest proposal (https://issues.apache.

[jira] [Commented] (YARN-3810) Rest API failing when ip configured in RM address in secure https mode

2015-06-16 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589045#comment-14589045 ] Akira AJISAKA commented on YARN-3810: - Yes, you should move this jira to common if the

[jira] [Commented] (YARN-3810) Rest API failing when ip configured in RM address in secure https mode

2015-06-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589034#comment-14589034 ] Bibin A Chundatt commented on YARN-3810: Any comments on the same ? [~ajisakaa] Sho

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589036#comment-14589036 ] Sangjin Lee commented on YARN-3051: --- Sorry it has taken me a while to chime in on this JI

[jira] [Commented] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589022#comment-14589022 ] Wei Shao commented on YARN-3806: Regarding YARN-2986 about unified view of scheduler config

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

2015-06-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589016#comment-14589016 ] Vinod Kumar Vavilapalli commented on YARN-3811: --- This is a long standing issu

[jira] [Commented] (YARN-3069) Document missing properties in yarn-default.xml

2015-06-16 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589005#comment-14589005 ] Akira AJISAKA commented on YARN-3069: - Thanks [~rchiang] for updating the patch. bq. I

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589001#comment-14589001 ] MENG DING commented on YARN-1197: - Sorry got things messed up. Correction: We definitely

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

2015-06-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588995#comment-14588995 ] Karthik Kambatla commented on YARN-3811: The issue is with counting container-launc

[jira] [Commented] (YARN-1948) Expose utility methods in Apps.java publically

2015-06-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588992#comment-14588992 ] Vinod Kumar Vavilapalli commented on YARN-1948: --- Tx for taking this up, [~nij

[jira] [Commented] (YARN-3811) NM restarts could lead to app failures

2015-06-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588984#comment-14588984 ] Karthik Kambatla commented on YARN-3811: We ran into this in our rolling upgrade te

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588965#comment-14588965 ] Vinod Kumar Vavilapalli commented on YARN-1197: --- bq. I don't think it's possi

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588963#comment-14588963 ] MENG DING commented on YARN-1197: - [~leftnoteasy], I am certainly OK doing (a). My original

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

2015-06-16 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588954#comment-14588954 ] Sidharta Seethana commented on YARN-1983: - Hi [~chenchun] [~ashahab] and I have be

[jira] [Commented] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588955#comment-14588955 ] Wei Shao commented on YARN-3806: Hi Wangda Tan, Thanks for reading the proposal! Some quic

[jira] [Created] (YARN-3811) NM restarts could lead to app failures

2015-06-16 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-3811: -- Summary: NM restarts could lead to app failures Key: YARN-3811 URL: https://issues.apache.org/jira/browse/YARN-3811 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3714) AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-id

2015-06-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588944#comment-14588944 ] Hudson commented on YARN-3714: -- FAILURE: Integrated in Hadoop-trunk-Commit #8028 (See [https:

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

2015-06-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588901#comment-14588901 ] Sangjin Lee commented on YARN-3792: --- Yes that might be an idea. > Test case failures in

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1459#comment-1459 ] Wangda Tan commented on YARN-1197: -- Thanks for comment, [~sseth]/[~sandyr]. Now I'm convi

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588847#comment-14588847 ] Siddharth Seth commented on YARN-1197: -- bq. I would argue that waiting for an NM-RM he

[jira] [Updated] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3804: --- Attachment: YARN-3804.04.patch > Both RM are on standBy state when kerberos user not in yarn.admin.acl

[jira] [Commented] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588827#comment-14588827 ] Wangda Tan commented on YARN-3806: -- Hi [~wshao], Thanks for providing thoughts about this,

[jira] [Commented] (YARN-3714) AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-id

2015-06-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588776#comment-14588776 ] Xuan Gong commented on YARN-3714: - Committed into trunk/branch-2. Thanks, [~iwasakims] > A

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588767#comment-14588767 ] Sangjin Lee commented on YARN-3706: --- The latest patch (14) looks good to me. I'll wait on

[jira] [Commented] (YARN-3714) AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-id

2015-06-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588756#comment-14588756 ] Xuan Gong commented on YARN-3714: - +1 LGTM. Will commit > AM proxy filter can not get RM w

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588753#comment-14588753 ] Varun Saxena commented on YARN-3804: ok > Both RM are on standBy state when kerberos u

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588742#comment-14588742 ] Xuan Gong commented on YARN-3804: - [~varun_saxena] The patch Looks good. But Could we add s

[jira] [Commented] (YARN-3810) Rest API failing when ip configured in RM address in secure https mode

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588733#comment-14588733 ] Varun Saxena commented on YARN-3810: If fix is in {{HttpServer2}}, the issue can be mov

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Description: Currently, a typical YARN cluster runs many different kinds of applications: production applicati

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588724#comment-14588724 ] Varun Saxena commented on YARN-3804: Anyhow, even that wouldn't have been proper fix be

[jira] [Updated] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3804: --- Attachment: YARN-3804.03.patch > Both RM are on standBy state when kerberos user not in yarn.admin.acl

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588679#comment-14588679 ] MENG DING commented on YARN-1197: - [~leftnoteasy], if I understand it correctly, in the {{A

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588671#comment-14588671 ] MENG DING commented on YARN-1197: - [~sandyr], by processing both resource decrease and incr

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588660#comment-14588660 ] Varun Saxena commented on YARN-3804: Ok, got it...Because we reload the configuration.

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588648#comment-14588648 ] Varun Saxena commented on YARN-3804: Oops, sorry for the mistake. I had tested this in

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.1.pdf Some minor changes. > Proposal of Generic Sch

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.1.pdf) > Proposal of Generic Scheduling Fr

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.1.pdf) > Proposal of Generic Scheduling Fr

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.1.pdf > Proposal of Generic Scheduling Framework for

[jira] [Commented] (YARN-3810) Rest API failing when ip configured in RM address in secure https mode

2015-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588532#comment-14588532 ] Hadoop QA commented on YARN-3810: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3810) Rest API failing when ip configured in RM address in secure https mode

2015-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588507#comment-14588507 ] Hadoop QA commented on YARN-3810: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588487#comment-14588487 ] Wangda Tan commented on YARN-1197: -- Thanks [~mding], I think (c) sounds like a very good

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588480#comment-14588480 ] Xuan Gong commented on YARN-3804: - [~varun_saxena] Actually, in AdminService#serviceInit, w

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588478#comment-14588478 ] Sandy Ryza commented on YARN-1197: -- bq. I think this assumes cluster is quite idle, I unde

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.1.pdf > Proposal of Generic Scheduling Framework for

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

2015-06-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588465#comment-14588465 ] Naganarasimha G R commented on YARN-3792: - bq. I'm not sure why that is the case. M

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588458#comment-14588458 ] Hadoop QA commented on YARN-3804: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

2015-06-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588441#comment-14588441 ] Sangjin Lee commented on YARN-3792: --- {quote} Other approach i can think of is to make the

[jira] [Commented] (YARN-3119) Memory limit check need not be enforced unless aggregate usage of all containers is near limit

2015-06-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588429#comment-14588429 ] Chris Douglas commented on YARN-3119: - Systems that embrace more forgiving resource enf

[jira] [Updated] (YARN-3810) Rest API failing when ip configured in RM address in secure https mode

2015-06-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3810: --- Attachment: 0002-YARN-3810.patch Uploading patch with formatting. Sorry missed it last time.

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588399#comment-14588399 ] Sangjin Lee commented on YARN-3706: --- The findbugs issue seems to be showing up on all our

[jira] [Updated] (YARN-3810) Rest API failing when ip configured in RM address in secure https mode

2015-06-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3810: --- Attachment: 0001-YARN-3810.patch Hoping that the analysis is correct. Please review the patch u

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588386#comment-14588386 ] Xuan Gong commented on YARN-3804: - [~varun_saxena] ConfiguredYarnAuthorizer#setAdmins has b

[jira] [Updated] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3804: --- Attachment: YARN-3804.02.patch > Both RM are on standBy state when kerberos user not in yarn.admin.acl

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.0.pdf > Proposal of Generic Scheduling Framework for

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.0.pdf) > Proposal of Generic Scheduling Fr

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588334#comment-14588334 ] Hadoop QA commented on YARN-3809: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.0.pdf > Proposal of Generic Scheduling Framework for

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: (was: ProposalOfGenericSchedulingFrameworkForYARN-V1.0.pdf) > Proposal of Generic Scheduling Fr

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588315#comment-14588315 ] Hadoop QA commented on YARN-3706: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.1.pdf > Proposal of Guaranteed Capacity Scheduling

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.1.pdf > Proposal of Time Based Fair Scheduling for

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: (was: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.1.pdf) > Proposal of Time Based Fair Sc

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-16 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Description: This proposal talks about limitations of the YARN scheduling policies for SLA applications, and t

  1   2   >