[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679707#comment-16679707 ] Hadoop QA commented on YARN-8985: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001-branch-3.1-test.patch > NPE in CapacityScheduler#tryCommit when handling

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.004.patch > Updating distributed node attributes only when necessary >

[jira] [Updated] (YARN-8987) Usability improvements for adding centralised node-attributes from CLI

[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8987: -- Description: I setup a single node cluster, then trying to add node-attributes with CLI, first I

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679280#comment-16679280 ] Hadoop QA commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679512#comment-16679512 ] Weiwei Yang commented on YARN-8988: --- Lets set stretch goal to 3.2.0 if we have a RC1. > Reduce the

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001-test-branch-3.1.patch > NPE in CapacityScheduler#tryCommit when handling

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679315#comment-16679315 ] Daniel Templeton commented on YARN-8985: Doesn't look like Jenkins started yet, so I just kicked

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679352#comment-16679352 ] Daniel Templeton commented on YARN-8985: The findbugs warning is legit. No idea what build error

[jira] [Comment Edited] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679303#comment-16679303 ] Bibin A Chundatt edited comment on YARN-8972 at 11/8/18 8:36 AM: -

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8988: -- Fix Version/s: 3.2.1 > Reduce the verbose log on RM heartbeat path when distributed node-attributes >

[jira] [Commented] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679094#comment-16679094 ] Keqiu Hu commented on YARN-8983: I'm not sure, let me poke around a bit more and report back later. >

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679487#comment-16679487 ] Weiwei Yang commented on YARN-8988: --- Hi [~Tao Yang] Thanks for taking this over. LGTM. > Reduce the

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680181#comment-16680181 ] Konstantinos Karanasos commented on YARN-8984: -- {quote}So please keep the null check here.

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.002.patch > Add basic pluggable device plugin framework >

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679392#comment-16679392 ] Akira Ajisaka commented on YARN-8233: - The failure is not specific to branch-3.1. The unit tests are

[jira] [Created] (YARN-8986) publish all exposed ports to random ports when using bridge network

Charo Zhang created YARN-8986: - Summary: publish all exposed ports to random ports when using bridge network Key: YARN-8986 URL: https://issues.apache.org/jira/browse/YARN-8986 Project: Hadoop YARN

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679278#comment-16679278 ] Akira Ajisaka commented on YARN-8233: - Attached branch-3.1-test patch upgraded Maven surefire plugin

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679208#comment-16679208 ] Yang Wang commented on YARN-8984: - [~cheersyang], I do not think it will throw a NPE when

[jira] [Updated] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8985: Attachment: YARN-8985.002.patch > FSParentQueue: debug log missing when assigning

[jira] [Commented] (YARN-8880) Add configurations for pluggable plugin framework

[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679262#comment-16679262 ] Weiwei Yang commented on YARN-8880: --- LGTM, +1 on v5 patch. > Add configurations for pluggable plugin

[jira] [Created] (YARN-8990) FS" race condition in app submit and queue cleanup

Wilfred Spiegelenburg created YARN-8990: --- Summary: FS" race condition in app submit and queue cleanup Key: YARN-8990 URL: https://issues.apache.org/jira/browse/YARN-8990 Project: Hadoop YARN

[jira] [Created] (YARN-8987) Usability improvements for adding centralised node-attributes from CLI

Weiwei Yang created YARN-8987: - Summary: Usability improvements for adding centralised node-attributes from CLI Key: YARN-8987 URL: https://issues.apache.org/jira/browse/YARN-8987 Project: Hadoop YARN

[jira] [Updated] (YARN-6729) Clarify documentation on how to enable cgroup support

[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6729: --- Fix Version/s: 3.3.0 > Clarify documentation on how to enable cgroup support >

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679535#comment-16679535 ] Wilfred Spiegelenburg commented on YARN-8985: - Patch to fix the findbugs warning

[jira] [Updated] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-8990: --- Priority: Blocker (was: Major) > FS: race condition in app submit and queue cleanup >

[jira] [Created] (YARN-8991) nodemanager not cleaning blockmgr directories inside appcache

Hidayat Teonadi created YARN-8991: - Summary: nodemanager not cleaning blockmgr directories inside appcache Key: YARN-8991 URL: https://issues.apache.org/jira/browse/YARN-8991 Project: Hadoop YARN

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679446#comment-16679446 ] Sunil Govindan commented on YARN-8763: -- Sorry. Apologies. I had some old files in my .m2 repo and

[jira] [Created] (YARN-8989) Move DockerCommandPlugin volume related APIs' invocation from DockerLinuxContainerRuntime#prepareContainer to #launchContainer

Zhankun Tang created YARN-8989: -- Summary: Move DockerCommandPlugin volume related APIs' invocation from DockerLinuxContainerRuntime#prepareContainer to #launchContainer Key: YARN-8989 URL:

[jira] [Commented] (YARN-8880) Add configurations for pluggable plugin framework

[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679376#comment-16679376 ] Zhankun Tang commented on YARN-8880: [~cheersyang] , Thanks for the review! > Add configurations for

[jira] [Commented] (YARN-8881) Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679570#comment-16679570 ] Hadoop QA commented on YARN-8881: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679438#comment-16679438 ] Tao Yang commented on YARN-8988: Attached v1 patch with updating log level to DEBUG. > Reduce the verbose

[jira] [Assigned] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8988: - Assignee: Tao Yang > Reduce the verbose log on RM heartbeat path when distributed

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679103#comment-16679103 ] Hadoop QA commented on YARN-8972: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8989) Move DockerCommandPlugin volume related APIs' invocation from DockerLinuxContainerRuntime#prepareContainer to #launchContainer

[ https://issues.apache.org/jira/browse/YARN-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8989: --- Attachment: YARN-8989-trunk-001.patch > Move DockerCommandPlugin volume related APIs' invocation from

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679196#comment-16679196 ] Hadoop QA commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679514#comment-16679514 ] Weiwei Yang commented on YARN-8988: --- +1, committing now > Reduce the verbose log on RM heartbeat path

[jira] [Commented] (YARN-8880) Add configurations for pluggable plugin framework

[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679288#comment-16679288 ] Weiwei Yang commented on YARN-8880: --- Committed to trunk, thanks [~tangzhankun]. > Add configurations

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679314#comment-16679314 ] Daniel Templeton commented on YARN-8985: LGTM +1 pending Jenkins. > FSParentQueue: debug log

[jira] [Created] (YARN-8985) FSParentQueue: debug log missing when assigning container

Wilfred Spiegelenburg created YARN-8985: --- Summary: FSParentQueue: debug log missing when assigning container Key: YARN-8985 URL: https://issues.apache.org/jira/browse/YARN-8985 Project: Hadoop

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680282#comment-16680282 ] Giovanni Matteo Fumarola commented on YARN-8972: I can add a new property. > [Router] Add

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679313#comment-16679313 ] Wilfred Spiegelenburg commented on YARN-8985: - [~templedf] could you have a look at this one

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.003.patch > Add basic pluggable device plugin framework >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679371#comment-16679371 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review and comments.

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679381#comment-16679381 ] Bibin A Chundatt edited comment on YARN-8933 at 11/8/18 1:31 PM: - Thank

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8988: --- Attachment: YARN-8988.001.patch > Reduce the verbose log on RM heartbeat path when distributed

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679507#comment-16679507 ] Hadoop QA commented on YARN-8988: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679492#comment-16679492 ] Weiwei Yang commented on YARN-8925: --- Thanks [~Tao Yang] for the updates. Overall it looks good, submit

[jira] [Commented] (YARN-8989) Move DockerCommandPlugin volume related APIs' invocation from DockerLinuxContainerRuntime#prepareContainer to #launchContainer

[ https://issues.apache.org/jira/browse/YARN-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679647#comment-16679647 ] Hadoop QA commented on YARN-8989: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8987) Usability improvements node-attributes CLI

[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8987: -- Summary: Usability improvements node-attributes CLI (was: Usability improvements for adding

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679297#comment-16679297 ] Weiwei Yang commented on YARN-8984: --- Hi [~fly_in_gis] {quote}ContainerPBImpl#getAllocationTags() will

[jira] [Updated] (YARN-8987) Usability improvements for adding centralised node-attributes from CLI

[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8987: -- Description: I setup a single node cluster, then trying to add node-attributes with CLI, first I

[jira] [Updated] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8990: Summary: FS: race condition in app submit and queue cleanup (was: FS" race

[jira] [Reopened] (YARN-8978) For fair scheduler, application with higher priority should also get priority resources for running AM

[ https://issues.apache.org/jira/browse/YARN-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiuliang reopened YARN-8978: > For fair scheduler, application with higher priority should also get priority > resources for running AM >

[jira] [Created] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

Weiwei Yang created YARN-8988: - Summary: Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled Key: YARN-8988 URL: https://issues.apache.org/jira/browse/YARN-8988

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8988: -- Target Version/s: 3.3.0, 3.2.1 (was: 3.2.0) > Reduce the verbose log on RM heartbeat path when

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680481#comment-16680481 ] Haibo Chen commented on YARN-8990: -- Thanks [~wilfreds] for the patch!  I have taken the liberty to update

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680570#comment-16680570 ] Wangda Tan commented on YARN-8763: -- [~sunilg] , I highly suggest reverting this from branch-3.2 if

[jira] [Commented] (YARN-8880) Add configurations for pluggable plugin framework

[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679260#comment-16679260 ] Hadoop QA commented on YARN-8880: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8985) FSParentQueue: debug log missing when assigning container

[ https://issues.apache.org/jira/browse/YARN-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679402#comment-16679402 ] Hadoop QA commented on YARN-8985: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679317#comment-16679317 ] Hadoop QA commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679605#comment-16679605 ] Hadoop QA commented on YARN-8925: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679381#comment-16679381 ] Bibin A Chundatt edited comment on YARN-8933 at 11/8/18 1:39 PM: - Thank

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679371#comment-16679371 ] Tao Yang edited comment on YARN-8925 at 11/8/18 7:16 AM: - Thanks [~cheersyang] for

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679546#comment-16679546 ] Hudson commented on YARN-8988: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15386 (See

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8988: -- Labels: log (was: ) > Reduce the verbose log on RM heartbeat path when distributed node-attributes >

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8988: -- Description: When I get distributed node-attributes enabled, RM log is flooded with following logs

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679416#comment-16679416 ] Tao Yang commented on YARN-8925: Attached v4 patch for review. [~cheersyang], pls help to review at your

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680551#comment-16680551 ] Hadoop QA commented on YARN-8990: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001-test-branch-3.1.patch > NPE in CapacityScheduler#tryCommit when handling

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679369#comment-16679369 ] Sunil Govindan commented on YARN-8763: -- Hi [~eyang] I am getting errors of undefined refererence

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: (was: YARN-8233.001-test-branch-3.1.patch) > NPE in CapacityScheduler#tryCommit

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679381#comment-16679381 ] Bibin A Chundatt commented on YARN-8933: Thank you [~botong] for updated patch. Could you

[jira] [Comment Edited] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680525#comment-16680525 ] Keqiu Hu edited comment on YARN-8983 at 11/8/18 10:42 PM: -- [~eyang] I took some

[jira] [Commented] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680525#comment-16680525 ] Keqiu Hu commented on YARN-8983: [~eyang] I took some time to go through the docker overlay network, it

[jira] [Updated] (YARN-8135) Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop

[ https://issues.apache.org/jira/browse/YARN-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8135: - Description: Description: *Goals:* - Allow infra engineer / data scientist to run *unmodified*

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680579#comment-16680579 ] Hadoop QA commented on YARN-8776: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679113#comment-16679113 ] Hadoop QA commented on YARN-8933: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8776) Container Executor change to create stdin/stdout pipeline

[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8776: Attachment: YARN-8776.007.patch > Container Executor change to create stdin/stdout pipeline >

[jira] [Updated] (YARN-8987) Usability improvements node-attributes CLI

[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8987: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-8766 > Usability improvements

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680005#comment-16680005 ] Szilard Nemeth commented on YARN-8990: -- Hi [~wilfreds]! Thanks for posting this patch! Patch LGTM,

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680471#comment-16680471 ] Eric Yang commented on YARN-8776: - [~billie.rinaldi] Thans for the review offline. I clean up the debris

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680622#comment-16680622 ] Botong Huang commented on YARN-8933: Good questions, there are several aspects:  # When we try to

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680630#comment-16680630 ] Haibo Chen commented on YARN-8992: -- See [^YARN-8990.002.patch] for the proposed fix included in the

[jira] [Comment Edited] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680630#comment-16680630 ] Haibo Chen edited comment on YARN-8992 at 11/9/18 12:01 AM: See

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680725#comment-16680725 ] Wilfred Spiegelenburg commented on YARN-8990: - thank you [~haibochen] for the quick review and

[jira] [Created] (YARN-8994) Fix for race condition in move app and queue cleanup in FS

Wilfred Spiegelenburg created YARN-8994: --- Summary: Fix for race condition in move app and queue cleanup in FS Key: YARN-8994 URL: https://issues.apache.org/jira/browse/YARN-8994 Project: Hadoop

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.004.patch > Add basic pluggable device plugin framework >

[jira] [Created] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

Haibo Chen created YARN-8992: Summary: Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue Key: YARN-8992 URL: https://issues.apache.org/jira/browse/YARN-8992

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680656#comment-16680656 ] Hudson commented on YARN-8990: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15393 (See

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001.branch-3.1.patch > NPE in CapacityScheduler#tryCommit when handling

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680848#comment-16680848 ] Sunil Govindan commented on YARN-8902: -- Thanks [~cheersyang]  Few comments. 1. In VolumeImpl, we

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680601#comment-16680601 ] Wangda Tan commented on YARN-8960: -- [~yuan_zac] , as we discussed offline, do we still need the service

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680617#comment-16680617 ] Wangda Tan commented on YARN-8877: -- [~cheersyang], make sense to me. > Extend service spec to allow

[jira] [Commented] (YARN-8990) FS: race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680620#comment-16680620 ] Haibo Chen commented on YARN-8990: -- Another option is to split out the new race condition in a different

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680615#comment-16680615 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , I'm still not quite sure about: {code:java}

[jira] [Updated] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8990: - Summary: Fix fair scheduler race condition in app submit and queue cleanup (was: FS: race condition in

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680632#comment-16680632 ] Tao Yang commented on YARN-8988: Thanks [~cheersyang] for the review and commit. > Reduce the verbose log

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680804#comment-16680804 ] Akira Ajisaka commented on YARN-8233: - The infra issue seems resolved. Attaching the patch for

[jira] [Commented] (YARN-8881) Add basic pluggable device plugin framework

[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680888#comment-16680888 ] Hadoop QA commented on YARN-8881: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >