[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682262#comment-16682262 ] Hadoop QA commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682255#comment-16682255 ] Bibin A Chundatt edited comment on YARN-8980 at 11/10/18 7:23 AM: -- cc :

[jira] [Commented] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682255#comment-16682255 ] Bibin A Chundatt commented on YARN-8980: cc : [~botong] Mapreduce application for initial

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Attachment: YARN-9005.002.patch > FairScheduler maybe preempt the AM container >

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Attachment: (was: YARN-9005.002.patch) > FairScheduler maybe preempt the AM container >

[jira] [Commented] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682254#comment-16682254 ] Hudson commented on YARN-9002: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15400 (See

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682251#comment-16682251 ] Wanqiang Ji commented on YARN-9005: --- Thanks [~yufeigu] provides the original design and discussion. I

[jira] [Updated] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8987: --- Attachment: YARN-8987.003.patch > Usability improvements node-attributes CLI >

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Attachment: YARN-9005.002.patch > FairScheduler maybe preempt the AM container >

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682248#comment-16682248 ] Bibin A Chundatt commented on YARN-8987: Update patch v3 to remove unused imports > Usability

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682244#comment-16682244 ] Hadoop QA commented on YARN-9001: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8987: --- Attachment: YARN-8987.002.patch > Usability improvements node-attributes CLI >

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682243#comment-16682243 ] Yufei Gu commented on YARN-9005: It is by design that AM containers can be preempted. YARN-5830 did the

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682241#comment-16682241 ] Bibin A Chundatt commented on YARN-8987: Hi [~cheersyang] {quote} I think

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-9005: --- Component/s: scheduler preemption fairscheduler > FairScheduler maybe preempt the AM

[jira] [Commented] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682230#comment-16682230 ] Hadoop QA commented on YARN-9002: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Fix Version/s: 3.1.2 > NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001.branch-3.0.patch > NPE in CapacityScheduler#tryCommit when handling

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682217#comment-16682217 ] Akira Ajisaka commented on YARN-8233: - Resubmitting the branch-3.0 patch to run precommit job for

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682216#comment-16682216 ] Akira Ajisaka commented on YARN-8233: - Committed the branch-3.1 patch to branch-3.1. > NPE in

[jira] [Commented] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682205#comment-16682205 ] Gour Saha commented on YARN-9002: - Thanks [~eyang] for reviewing. I uploaded 002 patch with imports

[jira] [Updated] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-9002: Attachment: YARN-9002.001.patch > YARN Service keytab location is restricted to HDFS and local filesystem

[jira] [Updated] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-9002: Attachment: YARN-9002-branch-3.1.002.patch > YARN Service keytab location is restricted to HDFS and local

[jira] [Issue Comment Deleted] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Comment: was deleted (was: [~wilfreds] Can you help to review this? thx) > FairScheduler maybe preempt

[jira] [Comment Edited] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682199#comment-16682199 ] Wanqiang Ji edited comment on YARN-9005 at 11/10/18 4:30 AM: - Hi 

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682199#comment-16682199 ] Wanqiang Ji commented on YARN-9005: --- Hi [~cheersyang], Happy Weekend! Can you help to review this? This

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682200#comment-16682200 ] Wanqiang Ji commented on YARN-9005: --- [~wilfreds] Can you help to review this? thx > FairScheduler maybe

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682197#comment-16682197 ] Hadoop QA commented on YARN-9005: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682196#comment-16682196 ] Eric Yang commented on YARN-9002: - [~gsaha] Thank you for the patch. The patch looks good to me. The

[jira] [Commented] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682190#comment-16682190 ] Hadoop QA commented on YARN-9002: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682184#comment-16682184 ] Wanqiang Ji commented on YARN-9004: --- Hi [~cheersyang], Happy Weekend! Can you help to review this? This

[jira] [Commented] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682180#comment-16682180 ] Hadoop QA commented on YARN-9004: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682166#comment-16682166 ] Gour Saha commented on YARN-9002: - Tested this patch in tandem with the patch in HIVE-20899 on a cluster

[jira] [Updated] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-9002: Attachment: YARN-9002-branch-3.1.001.patch > YARN Service keytab location is restricted to HDFS and local

[jira] [Created] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9005: - Summary: FairScheduler maybe preempt the AM container Key: YARN-9005 URL: https://issues.apache.org/jira/browse/YARN-9005 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9005: -- Issue Type: Bug (was: Improvement) > FairScheduler maybe preempt the AM container >

[jira] [Updated] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9004: -- Attachment: YARN-9004.001.patch > Remove unnecessary modifier for interface belong to scheduler >

[jira] [Created] (YARN-9004) Remove unnecessary modifier for interface belong to scheduler

2018-11-09 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9004: - Summary: Remove unnecessary modifier for interface belong to scheduler Key: YARN-9004 URL: https://issues.apache.org/jira/browse/YARN-9004 Project: Hadoop YARN

[jira] [Commented] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682104#comment-16682104 ] Hadoop QA commented on YARN-8586: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682101#comment-16682101 ] Hadoop QA commented on YARN-7898: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682080#comment-16682080 ] Eric Yang commented on YARN-5168: - YARN-9003 can improve usability of bridge network and overlay network

[jira] [Created] (YARN-9003) Support multi-homed network for docker container

2018-11-09 Thread Eric Yang (JIRA)
Eric Yang created YARN-9003: --- Summary: Support multi-homed network for docker container Key: YARN-9003 URL: https://issues.apache.org/jira/browse/YARN-9003 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8856) TestTimelineReaderWebServicesHBaseStorage tests failing with NoClassDefFoundError

2018-11-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682060#comment-16682060 ] Vrushali C commented on YARN-8856: -- Patch LGTM. I am downloading it and checking it locally once. >

[jira] [Commented] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682029#comment-16682029 ] Giovanni Matteo Fumarola commented on YARN-7898: [^YARN-7898-YARN-7402.v4.patch] started

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7898: --- Attachment: (was: YARN-7898-YARN-7402.v4.patch) > [FederationStateStore]

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7898: --- Attachment: YARN-7898-YARN-7402.v4.patch > [FederationStateStore] Create a

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7898: --- Attachment: YARN-7898-YARN-7402.v4.patch > [FederationStateStore] Create a

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7898: --- Attachment: (was: YARN-7898-YARN-7402.v4.patch) > [FederationStateStore]

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-7898: --- Attachment: YARN-7898-YARN-7402.v4.patch > [FederationStateStore] Create a

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2018-11-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8586: - Attachment: YARN-8586.001.patch > Extract log aggregation related fields and methods from

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681919#comment-16681919 ] Hadoop QA commented on YARN-8972: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Gour Saha (JIRA)
Gour Saha created YARN-9002: --- Summary: YARN Service keytab location is restricted to HDFS and local filesystem only Key: YARN-9002 URL: https://issues.apache.org/jira/browse/YARN-9002 Project: Hadoop YARN

[jira] [Assigned] (YARN-9002) YARN Service keytab location is restricted to HDFS and local filesystem only

2018-11-09 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-9002: --- Assignee: Gour Saha > YARN Service keytab location is restricted to HDFS and local filesystem only >

[jira] [Commented] (YARN-8997) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681903#comment-16681903 ] Giovanni Matteo Fumarola commented on YARN-8997: Thanks [~tangzhankun] for the patch. Can

[jira] [Resolved] (YARN-8996) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola resolved YARN-8996. Resolution: Duplicate > [Submarine] Simplify the logic in

[jira] [Commented] (YARN-8996) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681901#comment-16681901 ] Giovanni Matteo Fumarola commented on YARN-8996: This is a duplicate of YARN-8997. >

[jira] [Updated] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8972: --- Attachment: YARN-8972.v5.patch > [Router] Add support to prevent DoS attack

[jira] [Commented] (YARN-8856) TestTimelineReaderWebServicesHBaseStorage tests failing with NoClassDefFoundError

2018-11-09 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681770#comment-16681770 ] Íñigo Goiri commented on YARN-8856: --- This keeps failing in the daily jenkins run. According to the

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681753#comment-16681753 ] Hadoop QA commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

2018-11-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681750#comment-16681750 ] Sunil Govindan commented on YARN-8990: -- Back ported to 3.2.0 Re spinning RC with this. Thanks

[jira] [Updated] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

2018-11-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8990: - Fix Version/s: 3.2.0 > Fix fair scheduler race condition in app submit and queue cleanup >

[jira] [Commented] (YARN-8991) nodemanager not cleaning blockmgr directories inside appcache

2018-11-09 Thread Hidayat Teonadi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681745#comment-16681745 ] Hidayat Teonadi commented on YARN-8991: --- Correct, the blockmgr directories are not getting cleaned

[jira] [Commented] (YARN-8990) Fix fair scheduler race condition in app submit and queue cleanup

2018-11-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681743#comment-16681743 ] Daniel Templeton commented on YARN-8990: Thanks for finding and fixing this one, [~wilfreds]! It

[jira] [Updated] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8987: -- Priority: Critical (was: Major) > Usability improvements node-attributes CLI >

[jira] [Commented] (YARN-8983) YARN container with docker: hostname entry not in /etc/hosts

2018-11-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681701#comment-16681701 ] Eric Yang commented on YARN-8983: - [~oliverhuh...@gmail.com] Sorry, there is no plan to document docker

[jira] [Assigned] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8987: - Assignee: (was: Weiwei Yang) > Usability improvements node-attributes CLI >

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681700#comment-16681700 ] Weiwei Yang commented on YARN-8987: --- And another thing, {quote} validateForInvalidNode should have taken

[jira] [Assigned] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8987: - Assignee: Weiwei Yang > Usability improvements node-attributes CLI >

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681692#comment-16681692 ] Weiwei Yang commented on YARN-8987: --- Hi [~bibinchundatt] Thanks for following up on this. A couple of

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681647#comment-16681647 ] Bibin A Chundatt commented on YARN-8948: [~suma.shivaprasad]/[~sunilg]  please review patch

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681643#comment-16681643 ] Bibin A Chundatt commented on YARN-8987: {quote}non-existing attributes, if the validation is

[jira] [Commented] (YARN-8945) Calculation of maximum applications should respect specified and global maximum applications for absolute resource

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681630#comment-16681630 ] Weiwei Yang commented on YARN-8945: --- Ping [~sunilg],  can you help to review this? This is an issue

[jira] [Comment Edited] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681561#comment-16681561 ] Wanqiang Ji edited comment on YARN-8995 at 11/9/18 3:03 PM: +1 I am looking

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681561#comment-16681561 ] Wanqiang Ji commented on YARN-8995: --- +1 I'm looking forward to seeing this patch. > Log the event type

[jira] [Updated] (YARN-8996) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-8996: -- Environment: (was: In YarnServiceJobSubmitter#needHdfs. Below code can be simplified to just one

[jira] [Updated] (YARN-8996) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-09 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-8996: -- Description: In YarnServiceJobSubmitter#needHdfs. Below code can be simplified to just one line.

[jira] [Commented] (YARN-8991) nodemanager not cleaning blockmgr directories inside appcache

2018-11-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681525#comment-16681525 ] Thomas Graves commented on YARN-8991: - [~teonadi] can you clarify here.  Are you saying its not

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681403#comment-16681403 ] Weiwei Yang commented on YARN-8902: --- Hi [~sunilg] #1 I've seen the timeout issue multiple times before,

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681388#comment-16681388 ] Zac Zhou commented on YARN-9001: I'll submit a patch shortly > [Submarine] Use AppAdminClient instead of

[jira] [Created] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-09 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9001: -- Summary: [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs Key: YARN-9001 URL: https://issues.apache.org/jira/browse/YARN-9001 Project: Hadoop YARN

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681352#comment-16681352 ] Hadoop QA commented on YARN-8984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681349#comment-16681349 ] Sunil Govindan commented on YARN-8902: -- Hi [~cheersyang] Thanks for the patch. We are almost there.

[jira] [Commented] (YARN-8881) Add basic pluggable device plugin framework

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681316#comment-16681316 ] Hadoop QA commented on YARN-8881: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681281#comment-16681281 ] Hadoop QA commented on YARN-8902: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2018-11-09 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681229#comment-16681229 ] Zhankun Tang commented on YARN-8995: [~zhuqi]  Good suggestion. +1 for this improvement.  > Log the

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

2018-11-09 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.007.patch > Add basic pluggable device plugin framework >

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-09 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681219#comment-16681219 ] Zhankun Tang commented on YARN-7277: [~cheersyang] , Maybe there's something broken in YARN's

[jira] [Commented] (YARN-8881) Add basic pluggable device plugin framework

2018-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681207#comment-16681207 ] Hadoop QA commented on YARN-8881: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681186#comment-16681186 ] Tao Yang commented on YARN-8233: (y)(y), thanks [~ajisakaa] for your help to solve this problem. > NPE in

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2018-11-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681183#comment-16681183 ] Tao Yang commented on YARN-8995: Hi, [~zhuqi] +1 for this improvement. We have encountered bottleneck of

[jira] [Created] (YARN-9000) Add missing data access methods to webapp entities classes

2018-11-09 Thread Oleksandr Shevchenko (JIRA)
Oleksandr Shevchenko created YARN-9000: -- Summary: Add missing data access methods to webapp entities classes Key: YARN-9000 URL: https://issues.apache.org/jira/browse/YARN-9000 Project: Hadoop

[jira] [Comment Edited] (YARN-8833) compute shares may lock the scheduling process

2018-11-09 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681149#comment-16681149 ] Zhankun Tang edited comment on YARN-8833 at 11/9/18 9:41 AM: - Thanks

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681146#comment-16681146 ] Weiwei Yang commented on YARN-8984: --- Thanks for adding that, appreciate. Patch looks good to me. Pending

[jira] [Commented] (YARN-8833) compute shares may lock the scheduling process

2018-11-09 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681149#comment-16681149 ] Zhankun Tang commented on YARN-8833: Thanks [~cheersyang]. Hi, [~yoelee] , looking forward to your

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-09 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681142#comment-16681142 ] Yang Wang commented on YARN-8984: - [~cheersyang], thanks for your comments. I have added a test to verify

[jira] [Commented] (YARN-8999) [Submarine] Remove redundant local variables

2018-11-09 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681127#comment-16681127 ] Zhankun Tang commented on YARN-8999: This yetus seems broken. VM crash issue is not related to the

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681140#comment-16681140 ] Weiwei Yang commented on YARN-8233: --- Big thumb up [~ajisakaa], (y)(y), thanks a lot. > NPE in

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681138#comment-16681138 ] Akira Ajisaka commented on YARN-8233: - Finally found the root cause and attached a patch in

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-09 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-8984: Attachment: YARN-8984-005.patch > AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or

[jira] [Commented] (YARN-8997) [Submarine] Simplify the logic in YarnServiceJobSubmitter#needHdfs

2018-11-09 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681124#comment-16681124 ] Zhankun Tang commented on YARN-8997: [~sunilg] , [~leftnoteasy] . Please help to review. Thanks. >

  1   2   >