[jira] [Commented] (YARN-2140) Add support for network IO isolation/scheduling for containers

2014-06-13 Thread haosdent (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030284#comment-14030284 ] haosdent commented on YARN-2140: Thx [~ywskycn] Looking forward your work. Add support

[jira] [Commented] (YARN-2156) ApplicationMasterService#serviceStart() method has hardcoded AuthMethod.TOKEN as security configuration

2014-06-13 Thread Svetozar Ivanov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030286#comment-14030286 ] Svetozar Ivanov commented on YARN-2156: --- Hm, I would expect a warning message in my

[jira] [Commented] (YARN-2152) Recover missing container information

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030292#comment-14030292 ] Hadoop QA commented on YARN-2152: - {color:green}+1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-2144) Add logs when preemption occurs

2014-06-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2144: Assignee: Wangda Tan Add logs when preemption occurs ---

[jira] [Commented] (YARN-1919) Log yarn.resourcemanager.cluster-id is required for HA instead of throwing NPE

2014-06-13 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030433#comment-14030433 ] Tsuyoshi OZAWA commented on YARN-1919: -- Thanks for the review, Jian. [~kkambatl],

[jira] [Commented] (YARN-2155) FairScheduler: Incorrect threshold check for preemption

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030524#comment-14030524 ] Hudson commented on YARN-2155: -- FAILURE: Integrated in Hadoop-Yarn-trunk #582 (See

[jira] [Commented] (YARN-1702) Expose kill app functionality as part of RM web services

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030528#comment-14030528 ] Hudson commented on YARN-1702: -- FAILURE: Integrated in Hadoop-Yarn-trunk #582 (See

[jira] [Commented] (YARN-2156) ApplicationMasterService#serviceStart() method has hardcoded AuthMethod.TOKEN as security configuration

2014-06-13 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030639#comment-14030639 ] Daryn Sharp commented on YARN-2156: --- A warning doesn't make sense because it implies

[jira] [Commented] (YARN-2140) Add support for network IO isolation/scheduling for containers

2014-06-13 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030643#comment-14030643 ] Robert Joseph Evans commented on YARN-2140: --- We are working on similar things for

[jira] [Commented] (YARN-2155) FairScheduler: Incorrect threshold check for preemption

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030651#comment-14030651 ] Hudson commented on YARN-2155: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1773 (See

[jira] [Commented] (YARN-1702) Expose kill app functionality as part of RM web services

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030655#comment-14030655 ] Hudson commented on YARN-1702: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1773 (See

[jira] [Created] (YARN-2158) TestRMWebServicesAppsModification sometimes fails in trunk

2014-06-13 Thread Ted Yu (JIRA)
Ted Yu created YARN-2158: Summary: TestRMWebServicesAppsModification sometimes fails in trunk Key: YARN-2158 URL: https://issues.apache.org/jira/browse/YARN-2158 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2155) FairScheduler: Incorrect threshold check for preemption

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030721#comment-14030721 ] Hudson commented on YARN-2155: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1800 (See

[jira] [Commented] (YARN-1702) Expose kill app functionality as part of RM web services

2014-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030725#comment-14030725 ] Hudson commented on YARN-1702: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1800 (See

[jira] [Updated] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

2014-06-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2022: -- Attachment: YARN-2022.5.patch Thank you Mayank. I have updated the patch as per the comments. Also I did test

[jira] [Commented] (YARN-2140) Add support for network IO isolation/scheduling for containers

2014-06-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030750#comment-14030750 ] Wei Yan commented on YARN-2140: --- Thanks for the comments, [~revans2]. Add support for

[jira] [Updated] (YARN-1885) RM may not send the app-finished signal after RM restart to some nodes where the application ran before RM restarts

2014-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1885: -- Summary: RM may not send the app-finished signal after RM restart to some nodes

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030800#comment-14030800 ] Hadoop QA commented on YARN-2022: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2146) Yarn logs aggregation error

2014-06-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030812#comment-14030812 ] Xuan Gong commented on YARN-2146: - [~airbots] Hey, Chen. Have you figured out why this

[jira] [Assigned] (YARN-2158) TestRMWebServicesAppsModification sometimes fails in trunk

2014-06-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-2158: --- Assignee: Varun Vasudev TestRMWebServicesAppsModification sometimes fails in trunk

[jira] [Updated] (YARN-1365) ApplicationMasterService to allow Register and Unregister of an app that was running before restart

2014-06-13 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1365: Attachment: YARN-1365.005.patch Addressed Jian's comments. updated finishApplicationMaster to

[jira] [Commented] (YARN-1365) ApplicationMasterService to allow Register and Unregister of an app that was running before restart

2014-06-13 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030874#comment-14030874 ] Anubhav Dhoot commented on YARN-1365: - Hi [~jianhe] I addressed all your comments

[jira] [Updated] (YARN-2157) Document YARN metrics

2014-06-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-2157: Attachment: YARN-2157.patch Attaching a patch. Document YARN metrics -

[jira] [Commented] (YARN-2157) Document YARN metrics

2014-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030943#comment-14030943 ] Jian He commented on YARN-2157: --- [~ajisakaa], Thanks for working on this ! this will be

[jira] [Updated] (YARN-2052) ContainerId creation after work preserving restart is broken

2014-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2052: -- Target Version/s: 2.5.0 ContainerId creation after work preserving restart is

[jira] [Commented] (YARN-1365) ApplicationMasterService to allow Register and Unregister of an app that was running before restart

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030955#comment-14030955 ] Hadoop QA commented on YARN-1365: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2157) Document YARN metrics

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030958#comment-14030958 ] Hadoop QA commented on YARN-2157: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2052) ContainerId creation after work preserving restart is broken

2014-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030966#comment-14030966 ] Vinod Kumar Vavilapalli commented on YARN-2052: --- bq. e.g. container_XXX_1000

[jira] [Commented] (YARN-2052) ContainerId creation after work preserving restart is broken

2014-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030971#comment-14030971 ] Vinod Kumar Vavilapalli commented on YARN-2052: --- I forgot to add one more

[jira] [Commented] (YARN-1365) ApplicationMasterService to allow Register and Unregister of an app that was running before restart

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030979#comment-14030979 ] Hadoop QA commented on YARN-1365: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1885) RM may not send the app-finished signal after RM restart to some nodes where the application ran before RM restarts

2014-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031001#comment-14031001 ] Jian He commented on YARN-1885: --- bq. The application list should only be respected when the

[jira] [Commented] (YARN-2074) Preemption of AM containers shouldn't count towards AM failures

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031007#comment-14031007 ] Hadoop QA commented on YARN-2074: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2074) Preemption of AM containers shouldn't count towards AM failures

2014-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2074: -- Attachment: YARN-2074.5.patch Fixed the find bug warnings Preemption of AM containers shouldn't count towards

[jira] [Updated] (YARN-2158) TestRMWebServicesAppsModification sometimes fails in trunk

2014-06-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2158: Attachment: apache-yarn-2158.0.patch Patch to add debugging information to the test.

[jira] [Commented] (YARN-2000) Fix ordering of starting services inside the RM

2014-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031043#comment-14031043 ] Jian He commented on YARN-2000: --- Probably we can have state-store stop last so that all the

[jira] [Commented] (YARN-2000) Fix ordering of starting services inside the RM

2014-06-13 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031080#comment-14031080 ] Tsuyoshi OZAWA commented on YARN-2000: -- It sounds reasonable to me. Fix ordering of

[jira] [Commented] (YARN-2158) TestRMWebServicesAppsModification sometimes fails in trunk

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031082#comment-14031082 ] Hadoop QA commented on YARN-2158: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2074) Preemption of AM containers shouldn't count towards AM failures

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031083#comment-14031083 ] Hadoop QA commented on YARN-2074: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2159) allocateContainer() in SchedulerNode needs a clearer LOG.info message

2014-06-13 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-2159: Summary: allocateContainer() in SchedulerNode needs a clearer LOG.info message Key: YARN-2159 URL: https://issues.apache.org/jira/browse/YARN-2159 Project: Hadoop YARN

[jira] [Updated] (YARN-2159) allocateContainer() in SchedulerNode needs a clearer LOG.info message

2014-06-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2159: - Description: This bit of code: {quote} LOG.info(Assigned container + container.getId() + of

[jira] [Updated] (YARN-2159) allocateContainer() in SchedulerNode needs a clearer LOG.info message

2014-06-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2159: - Description: This bit of code: {quote} LOG.info(Assigned container + container.getId() + of

[jira] [Commented] (YARN-2146) Yarn logs aggregation error

2014-06-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031120#comment-14031120 ] Chen He commented on YARN-2146: --- I think it is because of mismatching during log parsing. I

[jira] [Commented] (YARN-2146) Yarn logs aggregation error

2014-06-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031162#comment-14031162 ] Xuan Gong commented on YARN-2146: - bq. because of mismatching during log parsing When we

[jira] [Commented] (YARN-2146) Yarn logs aggregation error

2014-06-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031167#comment-14031167 ] Chen He commented on YARN-2146: --- If you take a look of the log aggregation, you may get some

[jira] [Commented] (YARN-2146) Yarn logs aggregation error

2014-06-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031172#comment-14031172 ] Chen He commented on YARN-2146: --- It is the same problem in YARN-1670. Yarn logs aggregation

[jira] [Reopened] (YARN-2146) Yarn logs aggregation error

2014-06-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He reopened YARN-2146: --- Yarn logs aggregation error --- Key: YARN-2146 URL:

[jira] [Resolved] (YARN-2146) Yarn logs aggregation error

2014-06-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He resolved YARN-2146. --- Resolution: Duplicate Yarn logs aggregation error --- Key:

[jira] [Commented] (YARN-1670) aggregated log writer can write more log data then it says is the log length

2014-06-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031175#comment-14031175 ] Chen He commented on YARN-1670: --- It reports similar error in YARN-2146. [~mitdesai] are

[jira] [Commented] (YARN-2052) ContainerId creation after work preserving restart is broken

2014-06-13 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031223#comment-14031223 ] Tsuyoshi OZAWA commented on YARN-2052: -- [~jianhe] and [~vinodkv], thank you for the

[jira] [Commented] (YARN-1365) ApplicationMasterService to allow Register and Unregister of an app that was running before restart

2014-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031248#comment-14031248 ] Jian He commented on YARN-1365: --- Thanks for updating the patch. The debug logging can be

[jira] [Commented] (YARN-2052) ContainerId creation after work preserving restart is broken

2014-06-13 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031258#comment-14031258 ] Tsuyoshi OZAWA commented on YARN-2052: -- {quote} The only problem is users who are

[jira] [Commented] (YARN-1365) ApplicationMasterService to allow Register and Unregister of an app that was running before restart

2014-06-13 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031268#comment-14031268 ] Anubhav Dhoot commented on YARN-1365: - Agreed. I was trying to be consistent with

[jira] [Updated] (YARN-2159) allocateContainer() in SchedulerNode needs a clearer LOG.info message

2014-06-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2159: - Attachment: YARN2159-01.patch Rearrange sentence as per initial suggestion. allocateContainer() in

[jira] [Updated] (YARN-1885) RM may not send the app-finished signal after RM restart to some nodes where the application ran before RM restarts

2014-06-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1885: - Attachment: YARN-1885.patch Thanks [~vinodkv] for your comments. I uploaded a patch addressed all your

[jira] [Commented] (YARN-1885) RM may not send the app-finished signal after RM restart to some nodes where the application ran before RM restarts

2014-06-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031369#comment-14031369 ] Wangda Tan commented on YARN-1885: -- [~jianhe], bq. For nodes that expired but rejoin with

[jira] [Commented] (YARN-2159) allocateContainer() in SchedulerNode needs a clearer LOG.info message

2014-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031368#comment-14031368 ] Hadoop QA commented on YARN-2159: - {color:red}-1 overall{color}. Here are the results of