[jira] [Updated] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-23 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8873: - Summary: [YARN-8811] Add CSI java-based client library (was: Add CSI java-based client library)

[jira] [Commented] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660147#comment-16660147 ] Hudson commented on YARN-8873: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15290 (See

[jira] [Commented] (YARN-8811) Support Container Storage Interface (CSI) in YARN

2018-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660148#comment-16660148 ] Hudson commented on YARN-8811: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15290 (See

[jira] [Updated] (YARN-8935) stopped yarn service app does not show when "yarn app -list"

2018-10-23 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-8935: --- Environment: (was: stopped yarn service app can be re-started or destroyed even if it does not

[jira] [Created] (YARN-8935) stopped yarn service app does not show when "yarn app -list"

2018-10-23 Thread kyungwan nam (JIRA)
kyungwan nam created YARN-8935: -- Summary: stopped yarn service app does not show when "yarn app -list" Key: YARN-8935 URL: https://issues.apache.org/jira/browse/YARN-8935 Project: Hadoop YARN

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660160#comment-16660160 ] Hadoop QA commented on YARN-8920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660181#comment-16660181 ] Hadoop QA commented on YARN-8551: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8913) Add helper scripts to launch MaWo App to run Hadoop unit tests on Hadoop Cluster

2018-10-23 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8913: - Attachment: YARN-8913.002.patch > Add helper scripts to launch MaWo App to run Hadoop unit tests on

[jira] [Commented] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-23 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660144#comment-16660144 ] Sunil Govindan commented on YARN-8873: -- Committed to trunk. Thanks [~cheersyang] > [YARN-8811] Add

[jira] [Commented] (YARN-8826) Fix lingering timeline collector after serviceStop in TimelineCollectorManager

2018-10-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660159#comment-16660159 ] Rohith Sharma K S commented on YARN-8826: - committing shortly > Fix lingering timeline collector

[jira] [Updated] (YARN-8854) [Hadoop YARN Common] Update jquery datatable version references

2018-10-23 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8854: --- Attachment: YARN-8854.004.patch > [Hadoop YARN Common] Update jquery datatable version references >

[jira] [Updated] (YARN-7761) [UI2] Clicking 'master container log' or 'Link' next to 'log' under application's appAttempt goes to Old UI's Log link

2018-10-23 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-7761: --- Summary: [UI2] Clicking 'master container log' or 'Link' next to 'log' under application's appAttempt goes to

[jira] [Updated] (YARN-8906) [UI2] NM hostnames not displayed correctly in Node Heatmap Chart

2018-10-23 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8906: --- Summary: [UI2] NM hostnames not displayed correctly in Node Heatmap Chart (was: NM hostnames not displayed

[jira] [Commented] (YARN-8811) Support Container Storage Interface (CSI) in YARN

2018-10-23 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660231#comment-16660231 ] Sunil Govindan commented on YARN-8811: -- I am not very sure why this notification came here. 

[jira] [Commented] (YARN-8811) Support Container Storage Interface (CSI) in YARN

2018-10-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660248#comment-16660248 ] Weiwei Yang commented on YARN-8811: --- Thanks [~sunilg] for the note (y) > Support Container Storage

[jira] [Moved] (YARN-8936) Update ATSv2 hbase.two.version to 2.0.2

2018-10-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S moved HDFS-14019 to YARN-8936: Affects Version/s: (was: 3.3.0)

[jira] [Commented] (YARN-8854) [Hadoop YARN Common] Update jquery datatable version references

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660637#comment-16660637 ] Hadoop QA commented on YARN-8854: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Attachment: YARN-8902.001.patch > Add volume manager that manages CSI volume lifecycle >

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-10-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660577#comment-16660577 ] Bibin A Chundatt edited comment on YARN-8898 at 10/23/18 12:37 PM: ---

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-10-23 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660592#comment-16660592 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for your review and suggestion. Yes, that makes

[jira] [Comment Edited] (YARN-8900) [Router] Federation: routing getContainers REST invocations transparently to multiple RMs

2018-10-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656150#comment-16656150 ] Bibin A Chundatt edited comment on YARN-8900 at 10/23/18 12:42 PM: ---

[jira] [Updated] (YARN-8826) Fix lingering timeline collector after serviceStop in TimelineCollectorManager

2018-10-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8826: Fix Version/s: 3.0.4 > Fix lingering timeline collector after serviceStop in

[jira] [Commented] (YARN-8826) Fix lingering timeline collector after serviceStop in TimelineCollectorManager

2018-10-23 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660298#comment-16660298 ] Rohith Sharma K S commented on YARN-8826: - committed to trunk/branch-3.2/3.1/3.0/2.10 > Fix

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-10-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660577#comment-16660577 ] Bibin A Chundatt edited comment on YARN-8898 at 10/23/18 12:50 PM: ---

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-10-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660577#comment-16660577 ] Bibin A Chundatt commented on YARN-8898: [~botong]/[~BilwaST] Adding few points which we can

[jira] [Updated] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-10-23 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8934: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-7402 > [GPG] Add JvmMetricsInfo

[jira] [Commented] (YARN-8826) Fix lingering timeline collector after serviceStop in TimelineCollectorManager

2018-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660403#comment-16660403 ] Hudson commented on YARN-8826: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15291 (See

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660813#comment-16660813 ] Zhankun Tang commented on YARN-8927: [~eyang], Thanks for mentioning this. Is the value "libraries"

[jira] [Comment Edited] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660813#comment-16660813 ] Zhankun Tang edited comment on YARN-8927 at 10/23/18 3:16 PM: -- [~eyang],

[jira] [Created] (YARN-8937) TestLeaderElectorService hangs

2018-10-23 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-8937: Summary: TestLeaderElectorService hangs Key: YARN-8937 URL: https://issues.apache.org/jira/browse/YARN-8937 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Commented] (YARN-8904) TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey

2018-10-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660919#comment-16660919 ] Jason Lowe commented on YARN-8904: -- Whenever it says there was a timeout or other error in the fork then

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-10-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660677#comment-16660677 ] Weiwei Yang commented on YARN-8925: --- Thanks [~Tao Yang], looking forward to the updates! It seems most

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660904#comment-16660904 ] Wangda Tan commented on YARN-8927: -- [~tangzhankun], thanks for filing the Jira, I encountered the issue

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660881#comment-16660881 ] Eric Yang commented on YARN-8927: - [~tangzhankun] Sorry, my mistake. It is library/centos:latest instead

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP7-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660804#comment-16660804 ] Zhankun Tang edited comment on YARN-8851 at 10/23/18 3:17 PM: --

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660804#comment-16660804 ] Zhankun Tang commented on YARN-8851: [~leftnoteasy], Agree and updated the patch. Please review: 1.

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660906#comment-16660906 ] Weiwei Yang commented on YARN-8851: --- Hi [~tangzhankun] Thanks for the design doc and patch. I have some

[jira] [Commented] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660988#comment-16660988 ] Haibo Chen commented on YARN-8911: -- {quote} Is there any test that would track this from the container to

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661025#comment-16661025 ] Suma Shivaprasad commented on YARN-8920: Merged with trunk > LogAggregation should be

[jira] [Commented] (YARN-8904) TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey

2018-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661056#comment-16661056 ] Hudson commented on YARN-8904: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15295 (See

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661068#comment-16661068 ] Chandni Singh commented on YARN-8672: - [~jlowe] [~eyang] could you please review? >

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661082#comment-16661082 ] Haibo Chen commented on YARN-8059: -- Not a big fan of have a boolean check in all most every unit test to

[jira] [Commented] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661096#comment-16661096 ] Íñigo Goiri commented on YARN-8911: --- Shouldn't the container scheduler test then be affected by this

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2018-10-23 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661124#comment-16661124 ] Yesha Vora commented on YARN-8551: -- Sure, Removed Utils.py and updated Patch #4.  > Build Common module

[jira] [Updated] (YARN-8551) Build Common module for MaWo application

2018-10-23 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8551: - Attachment: YARN-8551.004.patch > Build Common module for MaWo application >

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661146#comment-16661146 ] Hadoop QA commented on YARN-8920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-8938: --- Summary: Add service upgrade cancel and express examples to the service upgrade doc Key: YARN-8938 URL: https://issues.apache.org/jira/browse/YARN-8938 Project: Hadoop

[jira] [Updated] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8938: Priority: Minor (was: Major) > Add service upgrade cancel and express examples to the service

[jira] [Updated] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8938: Attachment: YARN-8938.001.patch > Add service upgrade cancel and express examples to the service

[jira] [Commented] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661163#comment-16661163 ] Chandni Singh commented on YARN-8938: - [~eyang] could you please take a look?   > Add service

[jira] [Updated] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8938: Description: Add cancel upgrade and express upgrade information service upgrade doc. > Add service

[jira] [Assigned] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-8919: --- Assignee: Takanobu Asanuma > Some tests fail due to NoClassDefFoundError for

[jira] [Commented] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661190#comment-16661190 ] Hadoop QA commented on YARN-8911: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661198#comment-16661198 ] Jason Lowe commented on YARN-8672: -- Thanks for the analysis and patch! I believe the patch will fix the

[jira] [Commented] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-23 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661222#comment-16661222 ] Daryn Sharp commented on YARN-8865: --- You shouldn't modify the token identifier, ie. change the max date,

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660945#comment-16660945 ] Robert Kanter commented on YARN-8919: - +1 LGTM [~eyang], does that look good to you? I think this is

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660886#comment-16660886 ] Hadoop QA commented on YARN-8902: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8913) Add helper scripts to launch MaWo App to run Hadoop unit tests on Hadoop Cluster

2018-10-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660947#comment-16660947 ] Eric Yang commented on YARN-8913: - Launch command looks like this in patch 002: {code} cd

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2018-10-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660949#comment-16660949 ] Eric Yang commented on YARN-8551: - [~yeshavora] Utils.java doesn't seem to be used. Can we remove it? >

[jira] [Commented] (YARN-8937) TestLeaderElectorService hangs

2018-10-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661044#comment-16661044 ] Jason Lowe commented on YARN-8937: -- git bisect shows this was caused by HADOOP-15816. Looks like the ZK

[jira] [Updated] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8920: --- Attachment: YARN-8920.6.patch > LogAggregation should be configurable to allow writing to

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661004#comment-16661004 ] Eric Yang commented on YARN-8919: - [~rkanter] I am +0 on this patch because the dependencies are

[jira] [Updated] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8938: Attachment: YARN-8938.002.patch > Add service upgrade cancel and express examples to the service

[jira] [Commented] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661309#comment-16661309 ] Chandni Singh commented on YARN-8938: - Addressed the whitespace warning in patch 2 > Add service

[jira] [Resolved] (YARN-6586) YARN to facilitate HTTPS in AM web server

2018-10-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-6586. - Resolution: Fixed Fix Version/s: 3.3.0 All subtasks are now complete. Thanks for the

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661291#comment-16661291 ] Chandni Singh commented on YARN-8672: - On a second thought, if a container is killed while localizing,

[jira] [Comment Edited] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661291#comment-16661291 ] Chandni Singh edited comment on YARN-8672 at 10/23/18 9:09 PM: --- On a second

[jira] [Commented] (YARN-8814) Yarn Service Upgrade: Update the swagger definition

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661304#comment-16661304 ] Chandni Singh commented on YARN-8814: - this doesn't modify any code, so didn't add any unit tests. >

[jira] [Updated] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8911: - Attachment: YARN-8911.02.patch > ContainerScheduler incorrectly uses percentage number as the cpu

[jira] [Commented] (YARN-8929) DefaultOOMHandler should only pick running containers to kill upon oom events

2018-10-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661388#comment-16661388 ] Robert Kanter commented on YARN-8929: - Thanks for the patch [~haibochen]. Looks good overall; some

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661347#comment-16661347 ] Hadoop QA commented on YARN-8672: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661399#comment-16661399 ] Hadoop QA commented on YARN-8672: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8929) DefaultOOMHandler should only pick running containers to kill upon oom events

2018-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661414#comment-16661414 ] Haibo Chen commented on YARN-8929: -- Thanks [~rkanter] for the review. The unit test failure is unrelated,

[jira] [Updated] (YARN-8929) DefaultOOMHandler should only pick running containers to kill upon oom events

2018-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8929: - Attachment: YARN-8929.01.patch > DefaultOOMHandler should only pick running containers to kill upon oom

[jira] [Updated] (YARN-8936) Update ATSv2 hbase.two.version to 2.0.2

2018-10-23 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-8936: - Attachment: YARN-8936.0001.patch > Update ATSv2 hbase.two.version to 2.0.2 >

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-10-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661440#comment-16661440 ] Eric Payne commented on YARN-7225: -- Thanks a lot for the review, [~jhung]. I have loaded version 005 of

[jira] [Comment Edited] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661291#comment-16661291 ] Chandni Singh edited comment on YARN-8672 at 10/23/18 9:12 PM: --- On a second

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: (was: YARN-8672.003.patch) >

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: YARN-8672.003.patch > TestContainerManager#testLocalingResourceWhileContainerRunning

[jira] [Commented] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661384#comment-16661384 ] Hadoop QA commented on YARN-8938: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8921) SnapshotBasedOverAllocationPolicy always caps the amount of memory availabe to 4 GBs

2018-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661426#comment-16661426 ] Haibo Chen commented on YARN-8921: -- Unit test failure is unrelated. > SnapshotBasedOverAllocationPolicy

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661223#comment-16661223 ] Hadoop QA commented on YARN-8551: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661236#comment-16661236 ] Chandni Singh commented on YARN-8672: - {quote} I believe the patch will fix the issue but cause

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661244#comment-16661244 ] Robert Kanter commented on YARN-8919: - Given how complicated our dependencies are, I'd be concerned

[jira] [Commented] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661276#comment-16661276 ] Hadoop QA commented on YARN-8938: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8919) Some tests fail due to NoClassDefFoundError for OperatorCreationException

2018-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661280#comment-16661280 ] Hudson commented on YARN-8919: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15296 (See

[jira] [Updated] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8672: Attachment: YARN-8672.003.patch > TestContainerManager#testLocalingResourceWhileContainerRunning

[jira] [Commented] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661341#comment-16661341 ] Haibo Chen commented on YARN-8911: -- Good point. I have modified TestContainerSchedulerRecovery to do

[jira] [Assigned] (YARN-8936) Update ATSv2 hbase.two.version to 2.0.2

2018-10-23 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-8936: Assignee: Vrushali C > Update ATSv2 hbase.two.version to 2.0.2 >

[jira] [Updated] (YARN-7225) Add queue and partition info to RM audit log

2018-10-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7225: - Attachment: YARN-7225.005.patch > Add queue and partition info to RM audit log >

[jira] [Updated] (YARN-8865) RMStateStore contains large number of expired RMDelegationToken

2018-10-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8865: Attachment: YARN-8865.006.patch > RMStateStore contains large number of expired

[jira] [Commented] (YARN-8911) ContainerScheduler incorrectly uses percentage number as the cpu resource utlization

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661481#comment-16661481 ] Hadoop QA commented on YARN-8911: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661509#comment-16661509 ] Hadoop QA commented on YARN-8938: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-10-23 Thread Chen Yufei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Yufei resolved YARN-8513. -- Resolution: Fixed Fix Version/s: 3.2.1 3.1.2 > CapacityScheduler infinite

[jira] [Updated] (YARN-8939) Javadoc build fails in hadoop-yarn-csi

2018-10-23 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated YARN-8939: --- Attachment: YARN-8939.1.patch > Javadoc build fails in hadoop-yarn-csi >

[jira] [Commented] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-10-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661460#comment-16661460 ] Eric Yang commented on YARN-8938: - [~csingh] One small nitpick: {code} 3.2.0 onwards canceling upgrade

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661535#comment-16661535 ] Hadoop QA commented on YARN-8672: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661547#comment-16661547 ] Hadoop QA commented on YARN-8933: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

2018-10-23 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661569#comment-16661569 ] Suma Shivaprasad commented on YARN-8920: Validated the patch with both HDFS and S3 with the

  1   2   >