[jira] [Commented] (YARN-7137) Resource profile: Move new added APIs to unstable

2017-09-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162569#comment-16162569 ] Sunil G commented on YARN-7137: --- +1 on latest patch. I ll commit this later today if no obje

[jira] [Updated] (YARN-7163) RMContext need not to be injected to webapp and other Always Running services.

2017-09-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7163: Attachment: YARN-7163-branch-2.addednum.patch I just observed in branch-2 patch that one more

[jira] [Commented] (YARN-7132) FairScheduler.initScheduler() contains a surprising unary plus

2017-09-11 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162518#comment-16162518 ] Yeliang Cang commented on YARN-7132: Thanks [~haibochen] for the committing! > FairSch

[jira] [Assigned] (YARN-7132) FairScheduler.initScheduler() contains a surprising unary plus

2017-09-11 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang reassigned YARN-7132: -- Assignee: Yeliang Cang > FairScheduler.initScheduler() contains a surprising unary plus > --

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-09-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162494#comment-16162494 ] Naganarasimha G R commented on YARN-3409: - [~sunilg], As per our offline discussion

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-09-11 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162491#comment-16162491 ] Devaraj K commented on YARN-6620: - Thanks [~leftnoteasy] for the patch, Great work! There

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162471#comment-16162471 ] Hadoop QA commented on YARN-7185: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7173) Container update RM-NM communication fix for backward compatibility

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162472#comment-16162472 ] Hudson commented on YARN-7173: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1284

[jira] [Commented] (YARN-7132) FairScheduler.initScheduler() contains a surprising unary plus

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162460#comment-16162460 ] Hudson commented on YARN-7132: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1284

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162456#comment-16162456 ] Arun Suresh commented on YARN-7185: --- Thanks for the patch [~wangda], In general, it LGTM.

[jira] [Commented] (YARN-7132) FairScheduler.initScheduler() contains a surprising unary plus

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162453#comment-16162453 ] Haibo Chen commented on YARN-7132: -- Thanks [~Cyl] for your contribution. I have committed

[jira] [Updated] (YARN-7173) Container update RM-NM communication fix for backward compatibility

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7173: - Summary: Container update RM-NM communication fix for backward compatibility (was: Container Update Backwa

[jira] [Updated] (YARN-7173) Container Update Backward compatibility fix for RM-NM communication

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7173: - Summary: Container Update Backward compatibility fix for RM-NM communication (was: Container Update Backwa

[jira] [Updated] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7185: - Attachment: YARN-7185.003.patch Attached ver.3 patch. Fixed issues reported by unit tests. > ContainerSche

[jira] [Commented] (YARN-7132) FairScheduler.initScheduler() contains a surprising unary plus

2017-09-11 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162410#comment-16162410 ] Yeliang Cang commented on YARN-7132: Thanks [~haibochen] for the review! > FairSchedul

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162356#comment-16162356 ] Hadoop QA commented on YARN-7185: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162338#comment-16162338 ] Hadoop QA commented on YARN-7186: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-09-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162318#comment-16162318 ] Zhankun Tang commented on YARN-6852: [~wangda], agree with you. I'll refactor both nati

[jira] [Updated] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7185: - Attachment: YARN-7185.002.patch Attached ver.2 patch. [~asuresh] please review. > ContainerScheduler shou

[jira] [Commented] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162302#comment-16162302 ] Hadoop QA commented on YARN-6991: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6991: --- Attachment: YARN-6991.002.patch Rebased with trunk > "Kill application" button does not show e

[jira] [Commented] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162280#comment-16162280 ] Hadoop QA commented on YARN-6991: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162274#comment-16162274 ] Jian He commented on YARN-7186: --- A new command "yarn service demo " is added for users to e

[jira] [Comment Edited] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162270#comment-16162270 ] Suma Shivaprasad edited comment on YARN-6991 at 9/12/17 12:17 AM: ---

[jira] [Updated] (YARN-7186) Add examples in yarn-service

2017-09-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7186: -- Attachment: YARN-7186.yarn-native-services.01.patch > Add examples in yarn-service > ---

[jira] [Updated] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6991: --- Attachment: YARN-6991.001.patch Attached patch which validates logged in user vs application us

[jira] [Created] (YARN-7186) Add examples in yarn-service

2017-09-11 Thread Jian He (JIRA)
Jian He created YARN-7186: - Summary: Add examples in yarn-service Key: YARN-7186 URL: https://issues.apache.org/jira/browse/YARN-7186 Project: Hadoop YARN Issue Type: Sub-task Reporter:

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162257#comment-16162257 ] Arun Suresh commented on YARN-7185: --- Had an offline discussion with [~leftnoteasy] The ma

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162242#comment-16162242 ] Hudson commented on YARN-6622: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1284

[jira] [Commented] (YARN-7128) The error message in TimelineSchemaCreator is not enough to find out the error.

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162243#comment-16162243 ] Hudson commented on YARN-7128: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1284

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162241#comment-16162241 ] Hudson commented on YARN-6022: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1284

[jira] [Commented] (YARN-7128) The error message in TimelineSchemaCreator is not enough to find out the error.

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162216#comment-16162216 ] Haibo Chen commented on YARN-7128: -- +1 on the patch. Thanks for the contribution [~lingji

[jira] [Commented] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162210#comment-16162210 ] Haibo Chen commented on YARN-7063: -- bq. Do we have any other option? Agree with you there

[jira] [Comment Edited] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162210#comment-16162210 ] Haibo Chen edited comment on YARN-7063 at 9/11/17 11:17 PM: bq.

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162202#comment-16162202 ] Hudson commented on YARN-6022: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1283

[jira] [Commented] (YARN-7137) Resource profile: Move new added APIs to unstable

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162203#comment-16162203 ] Hadoop QA commented on YARN-7137: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162189#comment-16162189 ] Vinod Kumar Vavilapalli commented on YARN-7185: --- Even if opportunistic schedu

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162173#comment-16162173 ] Chris Douglas commented on YARN-6622: - Sure, it's better than nothing. Thanks, [~temple

[jira] [Updated] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7185: - Attachment: YARN-7185.001.patch [~asuresh], could you check the patch before I add more tests? > Container

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162152#comment-16162152 ] Wangda Tan commented on YARN-7185: -- A simple fix for this issue in my mind is only do avai

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162146#comment-16162146 ] Daniel Templeton commented on YARN-6622: Since the original review comments were as

[jira] [Updated] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7185: - Description: Found an issue: When DefaultContainerCalculator is enabled and opportunistic container allo

[jira] [Commented] (YARN-6977) Node information is not provided for non am containers in RM logs

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162133#comment-16162133 ] Wangda Tan commented on YARN-6977: -- +1, will commit it later, thanks [~suma.shivaprasad]!

[jira] [Updated] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7185: - Summary: ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunis

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162103#comment-16162103 ] Daniel Templeton commented on YARN-6622: Not having docs doesn't close the security

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162099#comment-16162099 ] Junping Du commented on YARN-6622: -- bq. Then let's backport YARN-5258. Enabling docker sup

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162090#comment-16162090 ] Chris Douglas commented on YARN-6622: - Then let's backport YARN-5258. Enabling docker s

[jira] [Commented] (YARN-7057) FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption

2017-09-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162085#comment-16162085 ] Yufei Gu commented on YARN-7057: Thanks [~templedf] for the review. [~kasha], this patch do

[jira] [Updated] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6622: - Target Version/s: 2.9.0, 3.0.0-beta1 (was: 3.0.0-beta1, 2.8.3) > Document Docker work as experimental > --

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162072#comment-16162072 ] Junping Du commented on YARN-6622: -- I just find that YARN-5258 (documentation for docker c

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162070#comment-16162070 ] Robert Kanter commented on YARN-7146: - Test failures unrelated: YARN-7044, YARN6747 >

[jira] [Updated] (YARN-7185) Fix miscellaneous issues in ContainerScheduler

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7185: - Summary: Fix miscellaneous issues in ContainerScheduler (was: Application fails to go to FINISHED state or

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162024#comment-16162024 ] Wangda Tan commented on YARN-7136: -- [~templedf], thanks for committing the patch and thank

[jira] [Updated] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7185: - Target Version/s: 2.9.0, 3.0.0-beta1 (was: 3.0.0-beta1) > Application fails to go to FINISHED state or som

[jira] [Commented] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162012#comment-16162012 ] Junping Du commented on YARN-7185: -- Container Scheduler should get disabled by default. Bu

[jira] [Updated] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7185: - Target Version/s: 3.0.0-beta1 > Application fails to go to FINISHED state or sometimes to RUNNING state > -

[jira] [Updated] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7185: - Fix Version/s: (was: 3.0.0) > Application fails to go to FINISHED state or sometimes to RUNNING state >

[jira] [Updated] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7185: - Priority: Blocker (was: Critical) > Application fails to go to FINISHED state or sometimes to RUNNING stat

[jira] [Updated] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Sumana Sathish (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumana Sathish updated YARN-7185: - Fix Version/s: 3.0.0 > Application fails to go to FINISHED state or sometimes to RUNNING state > --

[jira] [Created] (YARN-7185) Application fails to go to FINISHED state or sometimes to RUNNING state

2017-09-11 Thread Sumana Sathish (JIRA)
Sumana Sathish created YARN-7185: Summary: Application fails to go to FINISHED state or sometimes to RUNNING state Key: YARN-7185 URL: https://issues.apache.org/jira/browse/YARN-7185 Project: Hadoop Y

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161993#comment-16161993 ] Hadoop QA commented on YARN-7136: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161947#comment-16161947 ] Hadoop QA commented on YARN-7146: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161926#comment-16161926 ] Daniel Templeton commented on YARN-7136: LGTM +1 > Additional Performance Improvem

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161913#comment-16161913 ] Hadoop QA commented on YARN-7102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7181) CPUTimeTracker.updateElapsedJiffies can report negative usage

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161889#comment-16161889 ] Hudson commented on YARN-7181: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1283

[jira] [Commented] (YARN-7181) CPUTimeTracker.updateElapsedJiffies can report negative usage

2017-09-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161851#comment-16161851 ] Haibo Chen commented on YARN-7181: -- +1 Will commit it shortly. > CPUTimeTracker.updateEla

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161833#comment-16161833 ] Eric Badger commented on YARN-6622: --- bq. It's generally known to developers, but not to u

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161795#comment-16161795 ] Chris Douglas commented on YARN-6622: - bq. docker container is alpha feature which is g

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161771#comment-16161771 ] Junping Du commented on YARN-6622: -- This is out of my radar too as marked as major instead

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-09-11 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161770#comment-16161770 ] Shane Kumpf commented on YARN-6726: --- Thanks [~wangda] [~sunilg] and [~ebadger]! > Fix is

[jira] [Updated] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7146: Attachment: YARN-7146.003.patch The 003 patch: - Adds a comment about assign multiple - For {{update(

[jira] [Updated] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6726: - Fix Version/s: 2.9.0 > Fix issues with docker commands executed by container-executor > ---

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161747#comment-16161747 ] Wangda Tan commented on YARN-6726: -- [~ebadger] / [~shaneku...@gmail.com], I just committed

[jira] [Updated] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-6622: -- Priority: Blocker (was: Major) I'm going to raise this to a blocker for at least 3.0.0-beta1 based on Da

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-09-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161706#comment-16161706 ] Eric Badger commented on YARN-6726: --- YARN-6804 is in branch-2 now. [~leftnoteasy], can we

[jira] [Commented] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161703#comment-16161703 ] Wangda Tan commented on YARN-7172: -- +1 to latest patch, [~templedf], could you help to com

[jira] [Updated] (YARN-7137) Resource profile: Move new added APIs to unstable

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7137: - Attachment: YARN-7137.YARN-3926.002.patch Attached ver.2 patch based on YARN-7136. > Resource profile: Mov

[jira] [Commented] (YARN-7173) Container Update Backward compatibility fix for upgrades

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161680#comment-16161680 ] Wangda Tan commented on YARN-7173: -- Thanks [~asuresh], +1 to latest patch, will commit t

[jira] [Updated] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7136: - Attachment: YARN-7136.YARN-3926.016.patch Thanks [~templedf]. Done, please review 016. > Additional Perfor

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161629#comment-16161629 ] Daniel Templeton commented on YARN-7136: That takes care of {{LightWeightResource}}

[jira] [Comment Edited] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161623#comment-16161623 ] Botong Huang edited comment on YARN-7102 at 9/11/17 5:23 PM: - V

[jira] [Updated] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7102: --- Attachment: YARN-7102.v3.patch V3 updated, fix more unit test failures around {{MiniYarnCluster}} > NM

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161588#comment-16161588 ] Robert Kanter commented on YARN-7162: - [~djp], can you take a look at the patch? FYI

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161566#comment-16161566 ] Daniel Templeton commented on YARN-6622: [~djp], I don't think it's a good idea to

[jira] [Issue Comment Deleted] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated YARN-7183: - Comment: was deleted (was: State Issue => YARN 2.8.1) > YARN - State vs Final Status - Discrepancy

[jira] [Updated] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated YARN-7183: - Attachment: (was: 281.log.zip) > YARN - State vs Final Status - Discrepancy in 2.8.1 >

[jira] [Updated] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated YARN-7183: - Attachment: (was: state_issue_yarn_281.log.Z) > YARN - State vs Final Status - Discrepancy in 2

[jira] [Reopened] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan reopened YARN-7183: -- > YARN - State vs Final Status - Discrepancy in 2.8.1 > -

[jira] [Comment Edited] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161511#comment-16161511 ] Anbu Cheeralan edited comment on YARN-7183 at 9/11/17 4:53 PM: --

[jira] [Updated] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated YARN-7183: - Attachment: state_issue_yarn_281.log.zip State Issue => YARN 2.8.1 > YARN - State vs Final Status

[jira] [Updated] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated YARN-7183: - Attachment: 281.log.zip > YARN - State vs Final Status - Discrepancy in 2.8.1 > ---

[jira] [Updated] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated YARN-7183: - Attachment: state_issue_yarn_280.log.zip > YARN - State vs Final Status - Discrepancy in 2.8.1 > --

[jira] [Commented] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161546#comment-16161546 ] Eric Payne commented on YARN-7149: -- bq. You could check the unit test code to see if that

[jira] [Commented] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161511#comment-16161511 ] Anbu Cheeralan commented on YARN-7183: -- Here is the relevant log from Yarn 2.8.1 RM [^

[jira] [Updated] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated YARN-7183: - Attachment: state_issue_yarn_281.log.Z > YARN - State vs Final Status - Discrepancy in 2.8.1 >

[jira] [Assigned] (YARN-6059) Update paused container state in the state store

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6059: - Assignee: Hitesh Sharma (was: Arun Suresh) > Update paused container state in the state store > -

[jira] [Commented] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161414#comment-16161414 ] Rohith Sharma K S commented on YARN-7183: - Can you attach RM logs ? And point to ap

[jira] [Commented] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161404#comment-16161404 ] Anbu Cheeralan commented on YARN-7183: -- [~rohit12sh] Thanks for your time to answer t

[jira] [Resolved] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-7183. - Resolution: Invalid Closing as invalid! Please use user mailing lists to ask such doubts!

[jira] [Commented] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161266#comment-16161266 ] Rohith Sharma K S commented on YARN-7183: - There are 2 different meanings for above

  1   2   >