[jira] [Commented] (YARN-3336) FileSystem memory leak in DelegationTokenRenewer

2015-03-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358291#comment-14358291 ] zhihai xu commented on YARN-3336: - Hi [~cnauroth], Yes, you are right, I forget the

[jira] [Created] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

2015-03-12 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-3332: - Summary: [Umbrella] Unified Resource Statistics Collection per node Key: YARN-3332 URL: https://issues.apache.org/jira/browse/YARN-3332 Project:

[jira] [Created] (YARN-3335) Job In Error State Will Lost Jobhistory For Second and Later Attempts

2015-03-12 Thread Chang Li (JIRA)
Chang Li created YARN-3335: -- Summary: Job In Error State Will Lost Jobhistory For Second and Later Attempts Key: YARN-3335 URL: https://issues.apache.org/jira/browse/YARN-3335 Project: Hadoop YARN

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

2015-03-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355354#comment-14355354 ] Jian He commented on YARN-3273: --- thanks Rohith ! overall sounds good. bq. All active users

[jira] [Commented] (YARN-2140) Add support for network IO isolation/scheduling for containers

2015-03-12 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355395#comment-14355395 ] Bikas Saha commented on YARN-2140: -- This paper may have useful insights into the network

[jira] [Updated] (YARN-3336) FileSystem memory leak in DelegationTokenRenewer

2015-03-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3336: Attachment: YARN-3336.001.patch FileSystem memory leak in DelegationTokenRenewer

[jira] [Commented] (YARN-3295) Fix documentation nits found in markdown conversion

2015-03-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357015#comment-14357015 ] Hudson commented on YARN-3295: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #129 (See

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357431#comment-14357431 ] Hadoop QA commented on YARN-3243: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357111#comment-14357111 ] Junping Du commented on YARN-3039: -- Thanks [~sjlee0]! Providing an end-to-end flow below

[jira] [Commented] (YARN-3336) FileSystem memory leak in DelegationTokenRenewer

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358390#comment-14358390 ] Hadoop QA commented on YARN-3336: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-12 Thread Naganarasimha G R (JIRA)
: YARN-3034-20150312-1.patch, YARN-3034.20150205-1.patch Per design in YARN-2928, implement resource managers starting their own ATS writers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)

[jira] [Created] (YARN-3339) TestDockerContainerExecutor should pull a single image and not the entire centos repository

2015-03-12 Thread Ravindra Naik (JIRA)
Ravindra Naik created YARN-3339: --- Summary: TestDockerContainerExecutor should pull a single image and not the entire centos repository Key: YARN-3339 URL: https://issues.apache.org/jira/browse/YARN-3339

[jira] [Updated] (YARN-3339) TestDockerContainerExecutor should pull a single image and not the entire centos repository

2015-03-12 Thread Ravindra Naik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Naik updated YARN-3339: Description: TestDockerContainerExecutor test pulls the entire centos repository which is time

[jira] [Commented] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358538#comment-14358538 ] Hudson commented on YARN-1884: -- FAILURE: Integrated in Hadoop-Yarn-trunk #864 (See

[jira] [Commented] (YARN-3302) TestDockerContainerExecutor should run automatically if it can detect docker in the usual place

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358550#comment-14358550 ] Hadoop QA commented on YARN-3302: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3339) TestDockerContainerExecutor should pull a single image and not the entire centos repository

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358588#comment-14358588 ] Hadoop QA commented on YARN-3339: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358755#comment-14358755 ] Hudson commented on YARN-1884: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #121 (See

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358710#comment-14358710 ] Hadoop QA commented on YARN-41: --- {color:red}-1 overall{color}. Here are the results of testing

[jira] [Updated] (YARN-3335) Job In Error State Will Lost Jobhistory Of Second and Later Attempts

2015-03-12 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3335: --- Description: Related to a fixed issue MAPREDUCE-6230 which cause a Job to get into error state. In that

[jira] [Commented] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358737#comment-14358737 ] Hudson commented on YARN-1884: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2062 (See

[jira] [Commented] (YARN-3331) NodeManager should use directory other than tmp for extracting and loading leveldbjni

2015-03-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358768#comment-14358768 ] Allen Wittenauer commented on YARN-3331: We really can't read this in via the

[jira] [Commented] (YARN-3298) User-limit should be enforced in CapacityScheduler

2015-03-12 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358708#comment-14358708 ] Nathan Roberts commented on YARN-3298: -- I agree. Let's not change anything for the

[jira] [Updated] (YARN-3347) Improve YARN log command to get AMContainer logs

2015-03-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3347: Description: Right now, we could specify applicationId, node http address and container ID to get the

[jira] [Created] (YARN-3347) Improve YARN log command to get AMContainer logs

2015-03-12 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-3347: --- Summary: Improve YARN log command to get AMContainer logs Key: YARN-3347 URL: https://issues.apache.org/jira/browse/YARN-3347 Project: Hadoop YARN Issue Type: Test

[jira] [Updated] (YARN-3347) Improve YARN log command to get AMContainer logs

2015-03-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3347: -- Issue Type: Sub-task (was: Test) Parent: YARN-431 Improve YARN log

[jira] [Commented] (YARN-3284) Expose more ApplicationMetrics and ApplicationAttemptMetrics through YARN command

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359969#comment-14359969 ] Hadoop QA commented on YARN-3284: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3305) AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation

2015-03-12 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359893#comment-14359893 ] Rohith commented on YARN-3305: -- Updated patch as per comment.. Kindly review that latest patch

[jira] [Commented] (YARN-3305) AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation

2015-03-12 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359881#comment-14359881 ] Rohith commented on YARN-3305: -- bq. call normalize the am request in RMAppManager after

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359957#comment-14359957 ] Junping Du commented on YARN-3039: -- Also, thanks [~zjshen] for the comments! bq. Sorry for

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-12 Thread Naganarasimha G R (JIRA)
: timelineserver Reporter: Sangjin Lee Assignee: Naganarasimha G R Attachments: YARN-3034-20150312-1.patch, YARN-3034.20150205-1.patch Per design in YARN-2928, implement resource managers starting their own ATS writers. -- This message was sent by Atlassian

[jira] [Updated] (YARN-3305) AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation

2015-03-12 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3305: - Attachment: 0001-YARN-3305.patch AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359936#comment-14359936 ] Junping Du commented on YARN-3039: -- [~sjlee0], Thanks for comments here! In my

[jira] [Commented] (YARN-3305) AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359953#comment-14359953 ] Hadoop QA commented on YARN-3305: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-03-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3294: Attachment: (was: apache-yarn-3294.0.patch) Allow dumping of Capacity Scheduler debug logs via

[jira] [Updated] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-03-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3294: Attachment: apache-yarn-3294.0.patch Allow dumping of Capacity Scheduler debug logs via web UI for

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-12 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3267: --- Attachment: YARN-3267.4.patch Timelineserver applies the ACL rules after applying the limit on the number

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-12 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3267: --- Attachment: (was: YARN-3267.4.patch) Timelineserver applies the ACL rules after applying the limit on the

[jira] [Commented] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358886#comment-14358886 ] Hudson commented on YARN-1884: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2080 (See

[jira] [Commented] (YARN-3330) Implement a protobuf compatibility checker to check if a patch breaks the compatibility with existing client and internal protocols

2015-03-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358792#comment-14358792 ] Allen Wittenauer commented on YARN-3330: This shouldn't be yarn specific. I'd

[jira] [Commented] (YARN-2890) MiniMRYarnCluster should turn on timeline service if configured to do so

2015-03-12 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358798#comment-14358798 ] Mit Desai commented on YARN-2890: - Verified the test failures are not due to my patch. Some

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-12 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3267: --- Attachment: YARN-3267.4.patch Timelineserver applies the ACL rules after applying the limit on the number

[jira] [Updated] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-03-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3294: Attachment: Screen Shot 2015-03-12 at 8.51.25 PM.png Uploaded screenshot with the changes. Allow

[jira] [Updated] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-03-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3294: Attachment: apache-yarn-3294.0.patch Allow dumping of Capacity Scheduler debug logs via web UI for

[jira] [Commented] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-12 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358823#comment-14358823 ] Chang Li commented on YARN-3267: Thanks [~jeagles] for further review, updated patch

[jira] [Commented] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-03-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358821#comment-14358821 ] Varun Vasudev commented on YARN-3294: - The uploaded patch will dump debug logs for the

[jira] [Commented] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358833#comment-14358833 ] Hudson commented on YARN-1884: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #130 (See

[jira] [Commented] (YARN-3291) DockerContainerExecutor should run as a non-root user inside the container

2015-03-12 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358856#comment-14358856 ] Abin Shahab commented on YARN-3291: --- [~sidharta-s] [~raviprak] [~aw] [~vinodkv]

[jira] [Commented] (YARN-3291) DockerContainerExecutor should run as a non-root user inside the container

2015-03-12 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358858#comment-14358858 ] Abin Shahab commented on YARN-3291: --- I'll fix the findbug error.

[jira] [Commented] (YARN-3338) Exclude jline dependency from YARN

2015-03-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358977#comment-14358977 ] Xuan Gong commented on YARN-3338: - +1. lgtm. will commit Exclude jline dependency from

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-12 Thread Sangjin Lee (JIRA)
Reporter: Sangjin Lee Assignee: Naganarasimha G R Attachments: YARN-3034-20150312-1.patch, YARN-3034.20150205-1.patch Per design in YARN-2928, implement resource managers starting their own ATS writers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)

[jira] [Commented] (YARN-3338) Exclude jline dependency from YARN

2015-03-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359020#comment-14359020 ] Xuan Gong commented on YARN-3338: - Committed to trunk/branch-2/branch-2.7. Thanks, zhijie

[jira] [Commented] (YARN-3338) Exclude jline dependency from YARN

2015-03-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359032#comment-14359032 ] Hudson commented on YARN-3338: -- FAILURE: Integrated in Hadoop-trunk-Commit #7309 (See

[jira] [Commented] (YARN-3338) Exclude jline dependency from YARN

2015-03-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358963#comment-14358963 ] Chris Douglas commented on YARN-3338: - +1 lgtm Exclude jline dependency from YARN

[jira] [Commented] (YARN-3326) ReST support for getLabelsToNodes

2015-03-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358986#comment-14358986 ] Varun Vasudev commented on YARN-3326: - [~Naganarasimha] - can we change the endpoint

[jira] [Updated] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3243: - Attachment: YARN-3243.5.patch CapacityScheduler should pass headroom from parent to children to make sure

[jira] [Updated] (YARN-2792) Have a public Test-only API for creating important records that ecosystem projects can depend on

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2792: - Priority: Major (was: Blocker) Have a public Test-only API for creating important records that ecosystem

[jira] [Created] (YARN-3341) Fix findbugs warning:BC_UNCONFIRMED_CAST at FSSchedulerNode.reserveResource

2015-03-12 Thread zhihai xu (JIRA)
zhihai xu created YARN-3341: --- Summary: Fix findbugs warning:BC_UNCONFIRMED_CAST at FSSchedulerNode.reserveResource Key: YARN-3341 URL: https://issues.apache.org/jira/browse/YARN-3341 Project: Hadoop YARN

[jira] [Created] (YARN-3343) TestCapacitySchedulerNodeLabelUpdate.testNodeUpdate sometime fails in trunk

2015-03-12 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-3343: --- Summary: TestCapacitySchedulerNodeLabelUpdate.testNodeUpdate sometime fails in trunk Key: YARN-3343 URL: https://issues.apache.org/jira/browse/YARN-3343 Project: Hadoop YARN

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359460#comment-14359460 ] Hadoop QA commented on YARN-3243: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3343) TestCapacitySchedulerNodeLabelUpdate.testNodeUpdate sometime fails in trunk

2015-03-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3343: Description: Error Message test timed out after 3 milliseconds Stacktrace java.lang.Exception: test

[jira] [Commented] (YARN-3154) Should not upload partial logs for MR jobs or other short-running' applications

2015-03-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359367#comment-14359367 ] Hudson commented on YARN-3154: -- FAILURE: Integrated in Hadoop-trunk-Commit #7312 (See

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-12 Thread Li Lu (JIRA)
: timelineserver Reporter: Sangjin Lee Assignee: Naganarasimha G R Attachments: YARN-3034-20150312-1.patch, YARN-3034.20150205-1.patch Per design in YARN-2928, implement resource managers starting their own ATS writers. -- This message was sent by Atlassian

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-12 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3267: --- Attachment: YARN-3267.5.patch Timelineserver applies the ACL rules after applying the limit on the number

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359438#comment-14359438 ] Hadoop QA commented on YARN-1942: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359441#comment-14359441 ] Zhijie Shen commented on YARN-3039: --- bq. When AM get launched, NM auxiliary service will

[jira] [Reopened] (YARN-2871) TestRMRestart#testRMRestartGetApplicationList sometime fails in trunk

2015-03-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reopened YARN-2871: - I saw the testcase failure with the same issue. rMAppManager.logApplicationSummary(

[jira] [Created] (YARN-3342) TestAllocationFileLoaderService.testGetAllocationFileFromClasspath sometime fails in trunk

2015-03-12 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-3342: --- Summary: TestAllocationFileLoaderService.testGetAllocationFileFromClasspath sometime fails in trunk Key: YARN-3342 URL: https://issues.apache.org/jira/browse/YARN-3342

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359356#comment-14359356 ] Jian He commented on YARN-3136: --- looks good to me. test failures not related?

[jira] [Updated] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1942: - Attachment: YARN-1942.2.patch Attached ver.2. Offline discussed with Vinod, moved most methods of

[jira] [Commented] (YARN-3336) FileSystem memory leak in DelegationTokenRenewer

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359224#comment-14359224 ] Hadoop QA commented on YARN-3336: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3330) Implement a protobuf compatibility checker to check if a patch breaks the compatibility with existing client and internal protocols

2015-03-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359254#comment-14359254 ] Li Lu commented on YARN-3330: - Hi [~aw], thanks for the suggestion! I will definitely bump this

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359230#comment-14359230 ] Hadoop QA commented on YARN-3243: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3337) Provide YARN chaos monkey

2015-03-12 Thread Markus Weimer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359290#comment-14359290 ] Markus Weimer commented on YARN-3337: - Excellent idea! We do this over in REEF within

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-03-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359239#comment-14359239 ] Junping Du commented on YARN-3225: -- Nice discussion, [~devaraj.k]! bq. If there are some

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359275#comment-14359275 ] Wangda Tan commented on YARN-3243: -- Seems like Jenkins issue, rekicked.

[jira] [Commented] (YARN-3154) Should not upload partial logs for MR jobs or other short-running' applications

2015-03-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359332#comment-14359332 ] Vinod Kumar Vavilapalli commented on YARN-3154: --- bq. The testcase failures

[jira] [Assigned] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1942: Assignee: Wangda Tan Many of ConverterUtils methods need to have public interfaces

[jira] [Updated] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1942: - Target Version/s: 2.7.0 (was: 3.0.0, 2.4.1) Many of ConverterUtils methods need to have public

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359091#comment-14359091 ] Wangda Tan commented on YARN-1942: -- Working on this, will post a patch soon. Many of

[jira] [Created] (YARN-3340) Mark setters to be @Public for ApplicationId/ApplicationAttemptId/ContainerId.

2015-03-12 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3340: Summary: Mark setters to be @Public for ApplicationId/ApplicationAttemptId/ContainerId. Key: YARN-3340 URL: https://issues.apache.org/jira/browse/YARN-3340 Project: Hadoop

[jira] [Commented] (YARN-3340) Mark setters to be @Public for ApplicationId/ApplicationAttemptId/ContainerId.

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359188#comment-14359188 ] Hadoop QA commented on YARN-3340: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3154) Should not upload partial logs for MR jobs or other short-running' applications

2015-03-12 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359199#comment-14359199 ] Xuan Gong commented on YARN-3154: - The testcase failures are not related. And They can pass

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359089#comment-14359089 ] Wangda Tan commented on YARN-3243: -- Hi [~jianhe], I've done all updates, thanks for your

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359169#comment-14359169 ] Hadoop QA commented on YARN-1942: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3305) AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation

2015-03-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359186#comment-14359186 ] Jian He commented on YARN-3305: --- [~rohithsharma], thanks for working on this ! I think we

[jira] [Commented] (YARN-3336) FileSystem memory leak in DelegationTokenRenewer

2015-03-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359181#comment-14359181 ] zhihai xu commented on YARN-3336: - The findbugs warning is not related to my change. I just

[jira] [Updated] (YARN-3336) FileSystem memory leak in DelegationTokenRenewer

2015-03-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3336: Attachment: (was: YARN-3336.001.patch) FileSystem memory leak in DelegationTokenRenewer

[jira] [Updated] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1942: - Attachment: YARN-1942.1.patch Attached ver.1 for review, also removed {code} - public static MapString,

[jira] [Commented] (YARN-2792) Have a public Test-only API for creating important records that ecosystem projects can depend on

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359119#comment-14359119 ] Wangda Tan commented on YARN-2792: -- Updated priority from blocker to major, this is no

[jira] [Commented] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359158#comment-14359158 ] Hadoop QA commented on YARN-3267: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-12 Thread Vinod Kumar Vavilapalli (JIRA)
URL: https://issues.apache.org/jira/browse/YARN-3034 Project: Hadoop YARN Issue Type: Sub-task Components: timelineserver Reporter: Sangjin Lee Assignee: Naganarasimha G R Attachments: YARN-3034-20150312-1.patch, YARN-3034.20150205-1

[jira] [Updated] (YARN-3341) Fix findbugs warning:BC_UNCONFIRMED_CAST at FSSchedulerNode.reserveResource

2015-03-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3341: Labels: findbugs (was: ) Fix findbugs warning:BC_UNCONFIRMED_CAST at FSSchedulerNode.reserveResource

[jira] [Updated] (YARN-3336) FileSystem memory leak in DelegationTokenRenewer

2015-03-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3336: Attachment: YARN-3336.001.patch FileSystem memory leak in DelegationTokenRenewer

[jira] [Updated] (YARN-3340) Mark setters to be @Public for ApplicationId/ApplicationAttemptId/ContainerId.

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3340: - Attachment: YARN-3340.1.patch Attached ver.1 patch for review. Mark setters to be @Public for

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359163#comment-14359163 ] Junping Du commented on YARN-3039: -- Thanks [~sjlee0] for review and many good comments! I

[jira] [Updated] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3039: - Attachment: YARN-3039-v5.patch Update v5 patch with incorporating [~sjlee0]'s comments. [Aggregator

[jira] [Commented] (YARN-3336) FileSystem memory leak in DelegationTokenRenewer

2015-03-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359656#comment-14359656 ] zhihai xu commented on YARN-3336: - Hi [~cnauroth], I implemented a unit test in the new

[jira] [Commented] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359662#comment-14359662 ] Jonathan Eagles commented on YARN-3267: --- +1. this patch is a nice addition,

[jira] [Resolved] (YARN-3346) Deadlock in Capacity Scheduler

2015-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-3346. -- Resolution: Implemented Fix Version/s: 2.6.1 2.7.0 This issue is already

[jira] [Commented] (YARN-1453) [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments

2015-03-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359702#comment-14359702 ] Kai Zheng commented on YARN-1453: - Hello [~ajisakaa], We need to look at the JDK8 support.

  1   2   >