[jira] [Commented] (YARN-8957) Add Serializable interface to ComponentContainers

2018-11-06 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677218#comment-16677218 ] Chandni Singh commented on YARN-8957: - [~eyang] Could you please review and merge this change?  

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677011#comment-16677011 ] Bibin A Chundatt edited comment on YARN-8898 at 11/6/18 5:27 PM: -

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677039#comment-16677039 ] Wangda Tan commented on YARN-8877: -- [~cheersyang],  If YARN-8940 will satisfy all needs for volume,

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677027#comment-16677027 ] Wangda Tan commented on YARN-8902: -- {quote}I prefer not to do this rename. As the package already has 

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677030#comment-16677030 ] Wangda Tan commented on YARN-8714: -- + [~liuxun323] / [~yuan_zac] to take a look at this as well. >

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677029#comment-16677029 ] Wangda Tan commented on YARN-8714: -- [~tangzhankun] , could u please explain a little bit about what does

[jira] [Created] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-06 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-8980: -- Summary: Mapreduce application container start fail after AM restart. Key: YARN-8980 URL: https://issues.apache.org/jira/browse/YARN-8980 Project: Hadoop YARN

[jira] [Updated] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8973: --- Attachment: YARN-8973.v2.patch > [Router] Add missing methods in

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677011#comment-16677011 ] Bibin A Chundatt commented on YARN-8898: [~botong] {quote} On the other hand, the existing

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677147#comment-16677147 ] Giovanni Matteo Fumarola commented on YARN-8972: Thanks [~bibinchundatt] for the feedback.

[jira] [Created] (YARN-8981) Virtual IP address support

2018-11-06 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created YARN-8981: --- Summary: Virtual IP address support Key: YARN-8981 URL: https://issues.apache.org/jira/browse/YARN-8981 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-06 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677453#comment-16677453 ] Chandni Singh commented on YARN-8672: - [~eyang] Thanks. I see that in the container-executor.c

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677460#comment-16677460 ] Weiwei Yang commented on YARN-8877: --- Hi [~leftnoteasy] I was thinking to put a more neat interface

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677499#comment-16677499 ] Subru Krishnan commented on YARN-8898: -- [~bibinchundatt]/[~botong], thanks for working on this. I am

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677533#comment-16677533 ] Zhankun Tang edited comment on YARN-8714 at 11/7/18 2:06 AM: - [~leftnoteasy]

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677536#comment-16677536 ] Bibin A Chundatt commented on YARN-8972: [~giovanni.fumarola] I advantage i with interceptor at

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677533#comment-16677533 ] Zhankun Tang edited comment on YARN-8714 at 11/7/18 2:05 AM: - [~leftnoteasy] ,

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677533#comment-16677533 ] Zhankun Tang edited comment on YARN-8714 at 11/7/18 2:07 AM: - [~leftnoteasy]

[jira] [Comment Edited] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677536#comment-16677536 ] Bibin A Chundatt edited comment on YARN-8972 at 11/7/18 2:07 AM: -

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677562#comment-16677562 ] Hudson commented on YARN-8233: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15378 (See

[jira] [Commented] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677568#comment-16677568 ] Weiwei Yang commented on YARN-8977: --- Hi [~jiwq] Thanks for the patch, looks good. Two cents: # Could u

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677579#comment-16677579 ] Weiwei Yang commented on YARN-8233: --- Thanks [~ajisakaa] for the review and commit. Since [~surmountian]

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Fix Version/s: 3.2.1 3.3.0 > NPE in CapacityScheduler#tryCommit when handling

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677577#comment-16677577 ] Akira Ajisaka commented on YARN-8233: - Hi [~Tao Yang], would you prepare the patch for branch-2.9, 2,

[jira] [Commented] (YARN-8976) Remove redundant modifiers in interface "ApplicationConstants"

2018-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677590#comment-16677590 ] Hudson commented on YARN-8976: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15379 (See

[jira] [Updated] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-8977: -- Attachment: YARN-8977.002.patch > Remove explicit type when called

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677330#comment-16677330 ] Botong Huang commented on YARN-8898: Technically most of these info are already there for the proxy,

[jira] [Updated] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8973: --- Attachment: YARN-8973.v3.patch > [Router] Add missing methods in

[jira] [Commented] (YARN-8957) Add Serializable interface to ComponentContainers

2018-11-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677239#comment-16677239 ] Eric Yang commented on YARN-8957: - +1 Thank you [~csingh] for the review. Thank you [~tangzhankun] for

[jira] [Commented] (YARN-8957) Add Serializable interface to ComponentContainers

2018-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677250#comment-16677250 ] Hudson commented on YARN-8957: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15376 (See

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-06 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677311#comment-16677311 ] Chandni Singh commented on YARN-8672: - [~eyang] Please see below: In

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7898: --- Attachment: YARN-7898-YARN-7402.v3.patch > [FederationStateStore] Create a

[jira] [Commented] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677360#comment-16677360 ] Giovanni Matteo Fumarola commented on YARN-7898: Rebased an old patch. >

[jira] [Assigned] (YARN-7228) GenericExceptionHandler does not log StackTrace in case of INTERNAL_SERVER_ERROR

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-7228: -- Assignee: (was: Giovanni Matteo Fumarola) >

[jira] [Commented] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677443#comment-16677443 ] Hadoop QA commented on YARN-7898: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8982) [Router] Add locality policy

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-8982: -- Summary: [Router] Add locality policy Key: YARN-8982 URL: https://issues.apache.org/jira/browse/YARN-8982 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8982) [Router] Add locality policy

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8982: --- Parent Issue: YARN-5597 (was: YARN-7402) > [Router] Add locality policy >

[jira] [Updated] (YARN-8982) [Router] Add locality policy

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8982: --- Attachment: YARN-8982.v1.patch > [Router] Add locality policy >

[jira] [Commented] (YARN-8982) [Router] Add locality policy

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677511#comment-16677511 ] Hadoop QA commented on YARN-8982: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

2018-11-06 Thread Keqiu Hu (JIRA)
Keqiu Hu created YARN-8983: -- Summary: YARN container with docker: hostname entry not in /etc/hosts Key: YARN-8983 URL: https://issues.apache.org/jira/browse/YARN-8983 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677538#comment-16677538 ] Akira Ajisaka commented on YARN-8233: - LGTM, +1. The timeout of TestLeaderElectorService is not

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677575#comment-16677575 ] Akira Ajisaka commented on YARN-8233: - Committed this to trunk and branch-3.2. This patch applies

[jira] [Updated] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8984: -- Priority: Critical (was: Major) > OutstandingSchedRequests in AMRMClient could not be removed when >

[jira] [Updated] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8984: Attachment: YARN-8984-001.patch > OutstandingSchedRequests in AMRMClient could not be removed when >

[jira] [Updated] (YARN-8982) [Router] Add locality policy

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8982: --- Description: This jira tracks the effort to add a new policy in the Router.

[jira] [Commented] (YARN-8979) Spark on yarn job failed with yarn federation enabled

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677493#comment-16677493 ] Subru Krishnan commented on YARN-8979: -- [~shenyinjie], thanks for reporting this. This is a known

[jira] [Updated] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

2018-11-06 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keqiu Hu updated YARN-8983: --- Description: I'm experimenting to use Hadoop 2.9.1 to launch applications with docker containers. Inside the

[jira] [Commented] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2018-11-06 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677564#comment-16677564 ] Íñigo Goiri commented on YARN-8973: --- Can we make the test in {{TestRouterWebServices}} a little more

[jira] [Commented] (YARN-8976) Remove redundant modifiers in interface "ApplicationConstants"

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677581#comment-16677581 ] Zhankun Tang commented on YARN-8976: [~cheersyang] Thanks! > Remove redundant modifiers in interface

[jira] [Commented] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677599#comment-16677599 ] Wanqiang Ji commented on YARN-8977: --- Hi [~cheersyang] The patch updated. Pending on Jenkins. I'm so

[jira] [Created] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
Yang Wang created YARN-8984: --- Summary: OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty Key: YARN-8984 URL: https://issues.apache.org/jira/browse/YARN-8984

[jira] [Commented] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677649#comment-16677649 ] Yang Wang commented on YARN-8984: - It could be a critical bug when resync, all the

[jira] [Commented] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677476#comment-16677476 ] Hadoop QA commented on YARN-8973: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677499#comment-16677499 ] Subru Krishnan edited comment on YARN-8898 at 11/7/18 1:31 AM: ---

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677499#comment-16677499 ] Subru Krishnan edited comment on YARN-8898 at 11/7/18 1:30 AM: ---

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677499#comment-16677499 ] Subru Krishnan edited comment on YARN-8898 at 11/7/18 1:30 AM: ---

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677533#comment-16677533 ] Zhankun Tang edited comment on YARN-8714 at 11/7/18 2:04 AM: - [~leftnoteasy] ,

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677535#comment-16677535 ] Bibin A Chundatt commented on YARN-8898: {quote} what are the client APIs that you are referring

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677533#comment-16677533 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy] , The "->" means we want the File in the left to

[jira] [Commented] (YARN-8937) TestLeaderElectorService hangs

2018-11-06 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677542#comment-16677542 ] Akira Ajisaka commented on YARN-8937: - Upgrading Curator to 4.0.0 or upper does not fix this issue

[jira] [Commented] (YARN-8982) [Router] Add locality policy

2018-11-06 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677557#comment-16677557 ] Íñigo Goiri commented on YARN-8982: --- Thanks [~giovanni.fumarola] for the patch. A few comments: * You

[jira] [Commented] (YARN-8976) Remove redundant modifiers in interface "ApplicationConstants"

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677571#comment-16677571 ] Weiwei Yang commented on YARN-8976: --- +1, thanks [~tangzhankun] > Remove redundant modifiers in

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677535#comment-16677535 ] Bibin A Chundatt edited comment on YARN-8898 at 11/7/18 3:11 AM: - {quote}

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677535#comment-16677535 ] Bibin A Chundatt edited comment on YARN-8898 at 11/7/18 3:11 AM: - {quote}

[jira] [Assigned] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned YARN-8984: --- Assignee: Yang Wang > OutstandingSchedRequests in AMRMClient could not be removed when >

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677733#comment-16677733 ] Hadoop QA commented on YARN-8851: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677689#comment-16677689 ] Tao Yang commented on YARN-8233: Thanks [~ajisakaa], [~cheersyang] for the review and commit ! I will

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8233: - Target Version/s: 2.10.0, 2.9.2, 3.0.4, 3.1.2, 3.3.0, 3.2.1 (was: 2.10.0, 3.2.0, 2.9.2, 3.0.4,

[jira] [Resolved] (YARN-8238) [Umbrella] YARN deep learning framework examples to run on native service

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8238. -- Resolution: Fixed Closing as dup of YARN-8135.  > [Umbrella] YARN deep learning framework examples to

[jira] [Commented] (YARN-8953) Add CSI driver adaptor module

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677688#comment-16677688 ] Hadoop QA commented on YARN-8953: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Attachment: YARN-8953.002.patch > Add CSI driver adaptor module > - > >

[jira] [Commented] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677719#comment-16677719 ] Hadoop QA commented on YARN-8977: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-trunk.002.patch > [Umbrella] A new pluggable device plugin framework to ease

[jira] [Updated] (YARN-8220) Running Tensorflow on YARN with GPU and Docker - Examples

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8220: - Description: -Tensorflow could be run on YARN and could leverage YARN's distributed features.- -This

[jira] [Resolved] (YARN-8237) mxnet yarn spec file to add to native service examples

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8237. -- Resolution: Duplicate > mxnet yarn spec file to add to native service examples >

[jira] [Updated] (YARN-8238) [Umbrella] YARN deep learning framework examples to run on native service

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8238: - Description: -Umbrella- jira -to track various deep learning frameworks which can run on yarn native

[jira] [Updated] (YARN-8237) mxnet yarn spec file to add to native service examples

2018-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8237: - Description: Mxnet -could be run on YARN. This- jira -will help to add examples,- yarnfile-, docker

[jira] [Commented] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677660#comment-16677660 ] Weiwei Yang commented on YARN-8984: --- Thanks [~fly_in_gis] for creating this issue, I have increased the

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8984: -- Summary: AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty (was:

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Attachment: csi_adaptor_workflow.png > Add CSI driver adaptor module > - >

[jira] [Updated] (YARN-8811) Support Container Storage Interface (CSI) in YARN

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8811: -- Attachment: Support Container Storage Interface(CSI) in YARN_design_doc_v3.pdf > Support Container

[jira] [Commented] (YARN-8953) Add CSI driver adaptor module

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677728#comment-16677728 ] Hadoop QA commented on YARN-8953: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8529) Add timeout to RouterWebServiceUtil#invokeRMWebService

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677258#comment-16677258 ] Hadoop QA commented on YARN-8529: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7615) [RESERVATION] Federation StateStore: support storage/retrieval of reservations

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-7615: -- Assignee: (was: Giovanni Matteo Fumarola) > [RESERVATION]

[jira] [Assigned] (YARN-7614) [RESERVATION] Support Reservation APIs in Federation Router

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-7614: -- Assignee: (was: Giovanni Matteo Fumarola) > [RESERVATION] Support

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-11-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677329#comment-16677329 ] Eric Yang commented on YARN-8867: - [~csingh] Thank you for the patch. It will help a lot to have YARN

[jira] [Commented] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677338#comment-16677338 ] Hadoop QA commented on YARN-8973: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677365#comment-16677365 ] Eric Yang commented on YARN-8672: - [~csingh] I get this error when localization is happening for a yarn

[jira] [Assigned] (YARN-4473) Add version information for the application and the application attempts

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-4473: -- Assignee: (was: Giovanni Matteo Fumarola) > Add version

[jira] [Assigned] (YARN-5471) Adding null pointer checks in ResourceRequest#newInstance

2018-11-06 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-5471: -- Assignee: (was: Giovanni Matteo Fumarola) > Adding null pointer

[jira] [Comment Edited] (YARN-8867) Retrieve the status of resource localization

2018-11-06 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677263#comment-16677263 ] Chandni Singh edited comment on YARN-8867 at 11/6/18 8:17 PM: --

[jira] [Comment Edited] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-06 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677311#comment-16677311 ] Chandni Singh edited comment on YARN-8672 at 11/6/18 9:49 PM: -- [~eyang]

[jira] [Updated] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-11-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8108: Target Version/s: 3.1.1, 3.2.0 (was: 3.2.0, 3.1.1) Fix Version/s: (was: 3.1.2)

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-11-06 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677227#comment-16677227 ] Eric Yang commented on YARN-8108: - [~sunilg] Thanks for update the fixed version. This fix also exist in

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-11-06 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677263#comment-16677263 ] Chandni Singh commented on YARN-8867: - TestResourceTrackerService failure is unrelated. [~eyang]

[jira] [Commented] (YARN-8975) Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676457#comment-16676457 ] Zhankun Tang commented on YARN-8975: [~leftnoteasy] , please help to review. Thanks. > Use predefined

[jira] [Reopened] (YARN-8700) Application cannot un-registered

2018-11-06 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reopened YARN-8700: -- > Application cannot un-registered > > > Key:

[jira] [Comment Edited] (YARN-8976) Remove redundant modifiers in interface "ApplicationConstants"

2018-11-06 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676348#comment-16676348 ] Zhankun Tang edited comment on YARN-8976 at 11/6/18 9:53 AM: - [~cheersyang] . 

[jira] [Commented] (YARN-8976) Remove redundant modifiers in interface "ApplicationConstants"

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676456#comment-16676456 ] Hadoop QA commented on YARN-8976: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8701) If the single parameter in Resources#createResourceWithSameValue is greater than Integer.MAX_VALUE, then the value of vcores will be -1

2018-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676514#comment-16676514 ] Hadoop QA commented on YARN-8701: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >