[jira] [Resolved] (YARN-8230) [UI2] Attempt Info page url shows NA for several fields for container info

[ https://issues.apache.org/jira/browse/YARN-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB resolved YARN-8230. Resolution: Not A Bug It is working as expected. UI would display the data if available otherwise N/A. >

[jira] [Commented] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708338#comment-16708338 ] Zhankun Tang commented on YARN-8918: [~sunilg] , it's a minor change. not important. > [Submarine]

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708496#comment-16708496 ] Steve Loughran commented on YARN-9057: -- bq. it it seems to create more problems than the ones it

[jira] [Resolved] (YARN-7897) Invalid NM log link published on Yarn UI when container fails

[ https://issues.apache.org/jira/browse/YARN-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB resolved YARN-7897. Resolution: Not A Bug UI2 has no bug, log link is displayed from ATSv2 response data. If the log link is

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708581#comment-16708581 ] Weiwei Yang commented on YARN-9057: --- Attached patch to remove the shading code, and yarn-csi copies its

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9057: -- Attachment: YARN-9057.001.patch > CSI jar file should not bundle third party dependencies >

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708649#comment-16708649 ] Zac Zhou commented on YARN-9001: Yup, I think it can be applied to 3.2.0. Since this patch uses API from

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708652#comment-16708652 ] Zac Zhou commented on YARN-8960: I think it should be ok, [~leftnoteasy] any comments? > [Submarine]

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708658#comment-16708658 ] Hadoop QA commented on YARN-9057: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708874#comment-16708874 ] Zhankun Tang edited comment on YARN-8714 at 12/4/18 3:29 PM: - [~leftnoteasy],

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709028#comment-16709028 ] Billie Rinaldi commented on YARN-9071: -- I looked at YARN-3619, where the unregistration delay was

[jira] [Commented] (YARN-9041) Performance Optimization of method FSPreemptionThread#identifyContainersToPreempt

[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709077#comment-16709077 ] Hudson commented on YARN-9041: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15558 (See

[jira] [Updated] (YARN-9041) Performance Optimization of method FSPreemptionThread#identifyContainersToPreempt

[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-9041: --- Summary: Performance Optimization of method FSPreemptionThread#identifyContainersToPreempt (was: Performance

[jira] [Updated] (YARN-9041) Performance Optimization of method FSPreemptionThread#identifyContainersToPreempt

[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-9041: --- Fix Version/s: 3.2.1 > Performance Optimization of method > FSPreemptionThread#identifyContainersToPreempt >

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709037#comment-16709037 ] Eric Yang commented on YARN-9071: - [~csingh] Something is strange with this patch. This patch impacts

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709054#comment-16709054 ] Hadoop QA commented on YARN-9071: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9041) Performance Optimization of FSPreemptionThread#identifyContainersToPreempt method

[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-9041: --- Summary: Performance Optimization of FSPreemptionThread#identifyContainersToPreempt method (was: Optimize

[jira] [Updated] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9071: Attachment: q.log > NM and service AM don't have updated status for reinitialized containers >

[jira] [Commented] (YARN-9041) Performance Optimization of method FSPreemptionThread#identifyContainersToPreempt

[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709067#comment-16709067 ] Yufei Gu commented on YARN-9041: Committed to trunk. Thanks [~jiwq] for working on this. Thanks [~Steven

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709089#comment-16709089 ] Eric Yang commented on YARN-9071: - In my local testing, if a container failed to start on node A, and

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708868#comment-16708868 ] Jason Lowe commented on YARN-6523: -- Thanks for updating the patch! If a unit test just added in a patch

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708874#comment-16708874 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy], [~liuxun323] , While refining the patch, I found

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708874#comment-16708874 ] Zhankun Tang edited comment on YARN-8714 at 12/4/18 3:32 PM: - [~leftnoteasy],

[jira] [Created] (YARN-9082) Delay during unregistering metrics is unnecessary

Chandni Singh created YARN-9082: --- Summary: Delay during unregistering metrics is unnecessary Key: YARN-9082 URL: https://issues.apache.org/jira/browse/YARN-9082 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709176#comment-16709176 ] Chandni Singh commented on YARN-9071: - As discussed offline,  [~billie.rinaldi] I created YARN-9082

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709178#comment-16709178 ] Wangda Tan commented on YARN-8714: -- Thanks [~tangzhankun], what I remember is YARN doesn't support

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709246#comment-16709246 ] Eric Yang commented on YARN-5168: - [~liuxun323] The patch looks good. Is it possible to also expose this

[jira] [Commented] (YARN-8937) Upgrade Curator version to 2.13.0 to fix ZK tests

[ https://issues.apache.org/jira/browse/YARN-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709293#comment-16709293 ] Jason Lowe commented on YARN-8937: -- Thanks for the excellent analysis! +1 lgtm. Committing this. >

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709341#comment-16709341 ] Wangda Tan commented on YARN-8870: -- As we discussed offline, reverted the patch from branches. It's

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709465#comment-16709465 ] Weiwei Yang commented on YARN-9057: --- Thanks [~eyang], indeed that is not expected. Not sure why copy

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709475#comment-16709475 ] Chandni Singh commented on YARN-9071: - [~eyang] I have uploaded patch 5 where ip and host is cleared

[jira] [Updated] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9071: Attachment: YARN-9071.005.patch > NM and service AM don't have updated status for reinitialized

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709477#comment-16709477 ] Eric Yang commented on YARN-8914: - [~akhilpb] Patch 008 fixes the issues 1-4 from your last comments.

[jira] [Commented] (YARN-9013) [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner

[ https://issues.apache.org/jira/browse/YARN-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709446#comment-16709446 ] Giovanni Matteo Fumarola commented on YARN-9013: Thanks [~botong] . +1 on 

[jira] [Updated] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8914: Attachment: YARN-8914.008.patch > Add xtermjs to YARN UI2 > --- > >

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709512#comment-16709512 ] Xun Liu commented on YARN-5168: --- [~eyang], Thanks for your tips, I deal with it immediately. :) > Add port

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709320#comment-16709320 ] Eric Yang commented on YARN-9057: - [~cheersyang] Thank you for the patch.

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709356#comment-16709356 ] Hudson commented on YARN-8870: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15561 (See

[jira] [Updated] (YARN-8870) [Submarine] Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8870: - Target Version/s: (was: 3.2.0) > [Submarine] Add submarine installation scripts >

[jira] [Updated] (YARN-8870) [Submarine] Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8870: - Fix Version/s: (was: 3.2.0) > [Submarine] Add submarine installation scripts >

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709605#comment-16709605 ] Wilfred Spiegelenburg commented on YARN-8789: - First: I would expect that the change would be

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709633#comment-16709633 ] Hadoop QA commented on YARN-8914: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709637#comment-16709637 ] Weiwei Yang commented on YARN-9057: --- Hi [~eyang], using provided scope for

[jira] [Updated] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8914: --- Attachment: YARN-8914.008.patch > Add xtermjs to YARN UI2 > --- > > Key:

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9057: -- Attachment: YARN-9057.002.patch > CSI jar file should not bundle third party dependencies >

[jira] [Updated] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8914: --- Attachment: YARN-8914.009.patch > Add xtermjs to YARN UI2 > --- > > Key:

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709640#comment-16709640 ] Akhil PB commented on YARN-8914: [~eyang] Please find the v8 patch [^YARN-8914.008.patch] with latest UI2

[jira] [Comment Edited] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709640#comment-16709640 ] Akhil PB edited comment on YARN-8914 at 12/5/18 6:01 AM: - [~eyang] Please find the

[jira] [Comment Edited] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709640#comment-16709640 ] Akhil PB edited comment on YARN-8914 at 12/5/18 6:02 AM: - [~eyang] Please find the

[jira] [Updated] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8914: --- Attachment: (was: YARN-8914.008.patch) > Add xtermjs to YARN UI2 > --- > >

[jira] [Comment Edited] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709640#comment-16709640 ] Akhil PB edited comment on YARN-8914 at 12/5/18 6:16 AM: - [~eyang] Please find the

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709647#comment-16709647 ] Akhil PB commented on YARN-8914: [~eyang] Please let me know what are the steps to make the terminal work.

[jira] [Comment Edited] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709640#comment-16709640 ] Akhil PB edited comment on YARN-8914 at 12/5/18 6:15 AM: - [~eyang] Please find the

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709547#comment-16709547 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy], [~liuxun323] . Per my testing, the YARN localizer

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709547#comment-16709547 ] Zhankun Tang edited comment on YARN-8714 at 12/5/18 2:33 AM: - [~leftnoteasy],

[jira] [Updated] (YARN-9083) Support remote directory localization in yarn native service

[ https://issues.apache.org/jira/browse/YARN-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9083: --- Description: When refining YARN-8714, found that the YARN localizer seems can handle remote

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709547#comment-16709547 ] Zhankun Tang edited comment on YARN-8714 at 12/5/18 3:04 AM: - [~leftnoteasy],

[jira] [Created] (YARN-9083) Support remote directory localization in yarn native service

Zhankun Tang created YARN-9083: -- Summary: Support remote directory localization in yarn native service Key: YARN-9083 URL: https://issues.apache.org/jira/browse/YARN-9083 Project: Hadoop YARN

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709554#comment-16709554 ] Hadoop QA commented on YARN-9071: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709684#comment-16709684 ] Hadoop QA commented on YARN-9057: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||