[jira] [Updated] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

2015-06-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2716: --- Issue Type: Improvement (was: Bug) Refactor ZKRMStateStore retry code with Apache Curator

[jira] [Updated] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

2015-06-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2716: --- Attachment: yarn-2716-1.patch Fixed TestZKRMStateStoreZKClientConnections as well. I believe

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566993#comment-14566993 ] Rohith commented on YARN-3585: -- This is race condition when the NodeManager is shutting down

[jira] [Commented] (YARN-3017) ContainerID in ResourceManager Log Has Slightly Different Format From AppAttemptID

2015-06-01 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566998#comment-14566998 ] zhihai xu commented on YARN-3017: - Hi [~mufeed.usman], thanks for working on this issue.

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-06-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567189#comment-14567189 ] Rohith commented on YARN-3733: -- bq. Verify infinity by calling isInfinite(float v). Quoting

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567196#comment-14567196 ] Rohith commented on YARN-3585: -- Yes, we can raise different Jira. [~bibinchundatt] Can you

[jira] [Updated] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-01 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-3749: Attachment: YARN-3749.2.patch Upload a new patch to fix test cases. Lots of previous tests The HA

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-06-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567186#comment-14567186 ] Rohith commented on YARN-3733: -- bq. 2. The newly added code is duplicated in two places, can

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-06-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567184#comment-14567184 ] Rohith commented on YARN-3733: -- Thanks [~devaraj.k] and [~sunilg] for review bq. Can we check

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567201#comment-14567201 ] Rohith commented on YARN-3585: -- -1 for findbug, does not show any error report, but not sure

[jira] [Commented] (YARN-3069) Document missing properties in yarn-default.xml

2015-06-01 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567038#comment-14567038 ] Akira AJISAKA commented on YARN-3069: - Thanks [~rchiang] for updating the patch. #

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567157#comment-14567157 ] Hudson commented on YARN-3725: -- FAILURE: Integrated in Hadoop-Yarn-trunk #945 (See

[jira] [Commented] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567024#comment-14567024 ] Hadoop QA commented on YARN-2716: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567054#comment-14567054 ] Sunil G commented on YARN-3585: --- Hi [~bibinchundatt] and [~rohithsharma] This recent

[jira] [Updated] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2194: --- Component/s: nodemanager Description: In RHEL7, the CPU controller is named

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567158#comment-14567158 ] Hudson commented on YARN-2900: -- FAILURE: Integrated in Hadoop-Yarn-trunk #945 (See

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567029#comment-14567029 ] Karthik Kambatla commented on YARN-2194: +1 otherwise. [~vinodkv], [~tucu00] - is

[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2015-06-01 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567041#comment-14567041 ] Akira AJISAKA commented on YARN-3432: - Thanks [~brahmareddy] for taking this issue. The

[jira] [Updated] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2194: --- Summary: Cgroups cease to work in RHEL7 (was: Add Cgroup support for RedHat 7) Cgroups

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567025#comment-14567025 ] Karthik Kambatla commented on YARN-2194: Verified the patch works. Can we add more

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

2015-06-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567153#comment-14567153 ] Brahma Reddy Battula commented on YARN-3528: Thanks [~ste...@apache.org] and

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567151#comment-14567151 ] Hudson commented on YARN-2900: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #215 (See

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567150#comment-14567150 ] Hudson commented on YARN-3725: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #215 (See

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567417#comment-14567417 ] Hudson commented on YARN-2900: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #213 (See

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567448#comment-14567448 ] Hudson commented on YARN-2900: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2161 (See

[jira] [Updated] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2194: -- Attachment: YARN-2194-3.patch Thanks, [~kasha]. Updated a patch adding more comments. Cgroups cease to work in

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567416#comment-14567416 ] Hudson commented on YARN-3725: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #213 (See

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567447#comment-14567447 ] Hudson commented on YARN-3725: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2161 (See

[jira] [Updated] (YARN-3748) Cleanup Findbugs volatile warnings

2015-06-01 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-3748: --- Attachment: YARN-3748.4.patch Cleanup Findbugs volatile warnings --

[jira] [Commented] (YARN-3748) Cleanup Findbugs volatile warnings

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567506#comment-14567506 ] Hadoop QA commented on YARN-3748: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3699) Decide if flow version should be part of row key or column

2015-06-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567573#comment-14567573 ] Junping Du commented on YARN-3699: -- Hi [~jrottinghuis] and [~vrushalic], thanks for your

[jira] [Commented] (YARN-3686) CapacityScheduler should trim default_node_label_expression

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567542#comment-14567542 ] Sunil G commented on YARN-3686: --- Thank You [~leftnoteasy] for reviewing and committing the

[jira] [Commented] (YARN-3647) RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567546#comment-14567546 ] Sunil G commented on YARN-3647: --- Thank You [~leftnoteasy] for committing the patch.

[jira] [Assigned] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-06-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-3542: --- Assignee: Varun Vasudev Re-factor support for CPU as a resource using the new

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567341#comment-14567341 ] Hadoop QA commented on YARN-3170: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567366#comment-14567366 ] Hadoop QA commented on YARN-3170: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567380#comment-14567380 ] Hudson commented on YARN-2900: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #204 (See

[jira] [Updated] (YARN-3170) YARN architecture document needs updating

2015-06-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3170: --- Attachment: YARN-3170-009.patch YARN architecture document needs updating

[jira] [Updated] (YARN-3170) YARN architecture document needs updating

2015-06-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3170: --- Attachment: (was: YARN-3170-009.patch) YARN architecture document needs updating

[jira] [Commented] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-06-01 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567327#comment-14567327 ] Anubhav Dhoot commented on YARN-3467: - Did you mean its very verbose? Expose

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-06-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567354#comment-14567354 ] Brahma Reddy Battula commented on YARN-3170: [~aw] thanks a lot for your

[jira] [Commented] (YARN-3747) TestLocalDirsHandlerService.java: test directory logDir2 not deleted

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567355#comment-14567355 ] Hadoop QA commented on YARN-3747: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567358#comment-14567358 ] Hudson commented on YARN-2900: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2143 (See

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2015-06-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567291#comment-14567291 ] Steve Loughran commented on YARN-1042: -- I like this, though I'd also like PREFERRED to

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2015-06-01 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567340#comment-14567340 ] Chang Li commented on YARN-2556: [~jeagles] could you please help review the latest patch?

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567357#comment-14567357 ] Hudson commented on YARN-3725: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2143 (See

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567369#comment-14567369 ] Hadoop QA commented on YARN-3749: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3747) TestLocalDirsHandlerService.java: test directory logDir2 not deleted

2015-06-01 Thread David Moore (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Moore updated YARN-3747: -- Attachment: YARN-3747.patch Please review this patch - Thank you

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

2015-06-01 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567323#comment-14567323 ] Anubhav Dhoot commented on YARN-3751: - There was no failure for this class in the

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567379#comment-14567379 ] Hudson commented on YARN-3725: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #204 (See

[jira] [Commented] (YARN-3748) Cleanup Findbugs volatile warnings

2015-06-01 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567343#comment-14567343 ] Sean Busbey commented on YARN-3748: --- +1 lgtm, presuming that failed test passes locally.

[jira] [Updated] (YARN-3170) YARN architecture document needs updating

2015-06-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3170: --- Attachment: YARN-3170-009.patch YARN architecture document needs updating

[jira] [Commented] (YARN-3699) Decide if flow version should be part of row key or column

2015-06-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567744#comment-14567744 ] Sangjin Lee commented on YARN-3699: --- Thanks [~djp] for your comments! Once everyone's

[jira] [Commented] (YARN-3699) Decide if flow version should be part of row key or column

2015-06-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567756#comment-14567756 ] Li Lu commented on YARN-3699: - I'm +1 on removing the flow version section from the row key. I

[jira] [Resolved] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-06-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-3492. --- Resolution: Cannot Reproduce Closing this based on previous comments. Please

[jira] [Assigned] (YARN-2872) CapacityScheduler: Add disk I/O resource to DRF

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-2872: - Assignee: Sunil G CapacityScheduler: Add disk I/O resource to DRF

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567682#comment-14567682 ] Sunil G commented on YARN-3751: --- Findbugs warning can be skipped as exception handling is

[jira] [Commented] (YARN-2872) CapacityScheduler: Add disk I/O resource to DRF

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567621#comment-14567621 ] Sunil G commented on YARN-2872: --- Hi [~kasha] I would like to take up this for CS. I will work

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567609#comment-14567609 ] Vinod Kumar Vavilapalli commented on YARN-1462: --- bq. Committed to

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567672#comment-14567672 ] Hadoop QA commented on YARN-3751: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3752) TestRMFailover fails due to intermittent UnknownHostException

2015-06-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567762#comment-14567762 ] Masatake Iwasaki commented on YARN-3752: My /etc/hosts works for pseudo distributed

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1462: Fix Version/s: (was: 2.7.1) 2.8.0 AHS API and other AHS changes to handle tags for

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567758#comment-14567758 ] Xuan Gong commented on YARN-1462: - Okay. Reverted it from branch-2.7. And changed the fix

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567851#comment-14567851 ] Jason Lowe commented on YARN-3585: -- Thanks for the patch, Rohith! I think it would be

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567778#comment-14567778 ] Hudson commented on YARN-1462: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7940 (See

[jira] [Commented] (YARN-3752) TestRMFailover fails due to intermittent UnknownHostException

2015-06-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567763#comment-14567763 ] Masatake Iwasaki commented on YARN-3752: While I am doing trial-and-error, using

[jira] [Commented] (YARN-3752) TestRMFailover fails due to intermittent UnknownHostException

2015-06-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567775#comment-14567775 ] Masatake Iwasaki commented on YARN-3752: I don't know the exact reason yet but

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-01 Thread Matthew Jacobs (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568005#comment-14568005 ] Matthew Jacobs commented on YARN-2194: -- While this may work for the default RHEL7

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567969#comment-14567969 ] Vinod Kumar Vavilapalli commented on YARN-2194: --- Thinking out aloud, should

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-01 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568063#comment-14568063 ] Sidharta Seethana commented on YARN-2194: - Isn't it better to use a different

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568128#comment-14568128 ] Li Lu commented on YARN-3051: - Hi [~varun_saxena], thanks for the work! Not sure if you've

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-06-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3542: -- Target Version/s: 2.8.0 Let's do this in the 2.8 timeline before the two

[jira] [Updated] (YARN-3748) Cleanup Findbugs volatile warnings

2015-06-01 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-3748: --- Attachment: (was: YARN-3748.4.patch) Cleanup Findbugs volatile warnings

[jira] [Commented] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-06-01 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568083#comment-14568083 ] Sidharta Seethana commented on YARN-3542: - +1 to this Re-factor support for CPU

[jira] [Commented] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-06-01 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568084#comment-14568084 ] Sidharta Seethana commented on YARN-3542: - +1 to this Re-factor support for CPU

[jira] [Created] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-01 Thread Sumana Sathish (JIRA)
Sumana Sathish created YARN-3753: Summary: RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out Key: YARN-3753 URL: https://issues.apache.org/jira/browse/YARN-3753

[jira] [Assigned] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-3753: - Assignee: Jian He RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568145#comment-14568145 ] Jian He commented on YARN-3753: --- This happens because this exception {{new IOException(Wait

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-01 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568187#comment-14568187 ] zhihai xu commented on YARN-3749: - Hi [~chenchun], thanks for filing and working on this

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-01 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568189#comment-14568189 ] Sergey Shelukhin commented on YARN-1462: This commit changes newInstance API,

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568222#comment-14568222 ] Karthik Kambatla commented on YARN-3753: [~jianhe] - YARN-2716 is ready for review.

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568284#comment-14568284 ] Jian He commented on YARN-3753: --- [~kasha], sure, make sense, this can go into branch-2.7

[jira] [Comment Edited] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568292#comment-14568292 ] Jian He edited comment on YARN-3753 at 6/2/15 12:32 AM: Upload a

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568429#comment-14568429 ] Masatake Iwasaki commented on YARN-3749: Thanks for working on this, [~chenchun]. I

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-06-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568462#comment-14568462 ] Rohith commented on YARN-3733: -- This issue fix need to go in for 2.7.1. Updated the target

[jira] [Created] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

2015-06-01 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3754: -- Summary: Race condition when the NodeManager is shutting down and container is launched Key: YARN-3754 URL: https://issues.apache.org/jira/browse/YARN-3754

[jira] [Assigned] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

2015-06-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned YARN-3754: -- Assignee: Bibin A Chundatt Race condition when the NodeManager is shutting down and

[jira] [Assigned] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-3754: - Assignee: Sunil G (was: Bibin A Chundatt) Race condition when the NodeManager is shutting down and

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568573#comment-14568573 ] Hadoop QA commented on YARN-3170: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-01 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-3749: Attachment: YARN-3749.7.patch We should make a copy of configuration when init MiniYARNCluster with

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568409#comment-14568409 ] Hadoop QA commented on YARN-3753: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-06-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568428#comment-14568428 ] Tsuyoshi Ozawa commented on YARN-3170: -- {quote} The Scheduler has a pluggable policy

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568466#comment-14568466 ] Sunil G commented on YARN-3733: --- I feel clusterResource=0,0 lhs=1,1, and rhs2,2 may happen.

[jira] [Updated] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

2015-06-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3754: --- Description: Container is launched and returned to ContainerImpl NodeManager closed the DB

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568539#comment-14568539 ] Rohith commented on YARN-3585: -- Thanks [~jlowe] for the review .. bq. if we should flip the

[jira] [Updated] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-01 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-3749: Attachment: YARN-3749.4.patch We should make a copy of configuration when init MiniYARNCluster with

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-06-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568467#comment-14568467 ] Sunil G commented on YARN-3733: --- I feel clusterResource=0,0 lhs=1,1, and rhs2,2 may happen.

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568433#comment-14568433 ] Zhijie Shen commented on YARN-1462: --- bq. This commit changes newInstance API, breaking

[jira] [Updated] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-01 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-3749: Attachment: YARN-3749.5.patch We should make a copy of configuration when init MiniYARNCluster with

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568499#comment-14568499 ] Bibin A Chundatt commented on YARN-3585: [~rohithsharma] and [~sunilg] Have added

  1   2   >