[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682280#comment-16682280 ] Akira Ajisaka commented on YARN-8233: - The test failure in branch-3.0 is not related to the patch.

[jira] [Commented] (YARN-8245) Validate the existence of parent queue for add-queue operation in scheduler-conf REST API

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682281#comment-16682281 ] Tao Yang commented on YARN-8245: Hi, [~jhung], could you help to review this patch? Thanks. > Validate

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-10 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.002.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs >

[jira] [Created] (YARN-9006) TestNodeLabelContainerAllocation fails on branch-3.0

2018-11-10 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-9006: --- Summary: TestNodeLabelContainerAllocation fails on branch-3.0 Key: YARN-9006 URL: https://issues.apache.org/jira/browse/YARN-9006 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-9006) TestNodeLabelContainerAllocation fails in branch-3.0

2018-11-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-9006: Summary: TestNodeLabelContainerAllocation fails in branch-3.0 (was:

[jira] [Updated] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8505: --- Attachment: YARN-8505.003.patch > AMLimit and userAMLimit check should be skipped for unmanaged AM >

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682305#comment-16682305 ] Hadoop QA commented on YARN-9005: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.005.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682332#comment-16682332 ] Hadoop QA commented on YARN-8987: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (YARN-8987) Usability improvements node-attributes CLI

2018-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8987: --- Comment: was deleted (was: [~cheersyang] Seems some issue with jenkinss) > Usability

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682277#comment-16682277 ] Tao Yang commented on YARN-8505: There is no jenkins report for v2 patch. Attached again to trigger it.

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682309#comment-16682309 ] Hadoop QA commented on YARN-9005: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682321#comment-16682321 ] Hadoop QA commented on YARN-8987: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682272#comment-16682272 ] Tao Yang commented on YARN-8925: Attached v5 patch to fix some checkstyle warnings and trigger QA check.

[jira] [Comment Edited] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-10 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682251#comment-16682251 ] Wanqiang Ji edited comment on YARN-9005 at 11/10/18 8:29 AM: - Thanks

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Fix Version/s: 3.0.4 Committed this to branch-3.0. > NPE in CapacityScheduler#tryCommit when

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682283#comment-16682283 ] Akira Ajisaka commented on YARN-8233: - Resubmitting the branch-2 patch to run precommit job for

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8233: Attachment: YARN-8233.001.branch-2.patch > NPE in CapacityScheduler#tryCommit when handling

[jira] [Commented] (YARN-9006) TestNodeLabelContainerAllocation fails in branch-3.0

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682327#comment-16682327 ] Tao Yang commented on YARN-9006: These failures are caused by the inconsistent default value of

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682340#comment-16682340 ] Hadoop QA commented on YARN-7461: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9002) YARN Service keytab does not support s3, wasb, gs and is restricted to HDFS and local filesystem only

2018-11-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682434#comment-16682434 ] Gour Saha commented on YARN-9002: - Thanks a lot [~eyang] > YARN Service keytab does not support s3, wasb,

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Attachment: YARN-9007.001.patch > CS preemption monitor should only select GUARANTEED containers as

[jira] [Commented] (YARN-8987) Usability improvements node-attributes CLI

2018-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682334#comment-16682334 ] Bibin A Chundatt commented on YARN-8987: [~cheersyang] Seems some issue with jenkinss > Usability

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682339#comment-16682339 ] Tao Yang commented on YARN-7461: Hi, [~sunilg], [~leftnoteasy], [~templedf], [~cheersyang]. Can we keep

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-10 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682352#comment-16682352 ] Antal Bálint Steinbach commented on YARN-5106: -- Hi [~snemeth] , Thanks for the patch, it

[jira] [Created] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

2018-11-10 Thread Tao Yang (JIRA)
Tao Yang created YARN-9007: -- Summary: CS preemption monitor should only select GUARANTEED containers as candidates Key: YARN-9007 URL: https://issues.apache.org/jira/browse/YARN-9007 Project: Hadoop YARN

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-10 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682419#comment-16682419 ] Zac Zhou commented on YARN-8960: Maybe, we need both of them, To enable "yarn app -status", submarine

[jira] [Commented] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2018-11-10 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682364#comment-16682364 ] Antal Bálint Steinbach commented on YARN-8586: -- Hi [~snemeth] , Thanks for the patch. The

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682382#comment-16682382 ] Hadoop QA commented on YARN-8925: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682345#comment-16682345 ] Hadoop QA commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

2018-11-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682402#comment-16682402 ] Tao Yang commented on YARN-9007: Attached v1 patch. [~leftnoteasy], [~sunilg], could you help to review

[jira] [Updated] (YARN-9002) YARN Service keytab does not support s3, wasb, gs and is restricted to HDFS and local filesystem only

2018-11-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-9002: Summary: YARN Service keytab does not support s3, wasb, gs and is restricted to HDFS and local filesystem

[jira] [Commented] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-10 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682485#comment-16682485 ] Botong Huang commented on YARN-8980: Thanks [~bibinchundatt] for reporting. This is along the

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682341#comment-16682341 ] Hadoop QA commented on YARN-9001: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682360#comment-16682360 ] Hadoop QA commented on YARN-8505: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682380#comment-16682380 ] Akira Ajisaka commented on YARN-8233: - The javac warning is trivial because it is in test code.

[jira] [Updated] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9008: --- Attachment: YARN-9008-001.patch > Extend YARN distributed shell with file localization feature >

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682579#comment-16682579 ] Hadoop QA commented on YARN-9008: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-10 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9008: -- Summary: Extend YARN distributed shell with file localization feature Key: YARN-9008 URL: https://issues.apache.org/jira/browse/YARN-9008 Project: Hadoop YARN

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682543#comment-16682543 ] Hadoop QA commented on YARN-9008: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9008: --- Description: YARN distributed shell is a very handy tool to test various features of YARN. However,

[jira] [Updated] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9008: --- Attachment: YARN-9008-002.patch > Extend YARN distributed shell with file localization feature >

[jira] [Commented] (YARN-8833) compute shares may lock the scheduling process

2018-11-10 Thread liyakun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682714#comment-16682714 ] liyakun commented on YARN-8833: --- Thanks you both.  This is a single cluster based on hadoop 2.6.0, and lots

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor

2018-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682747#comment-16682747 ] Bibin A Chundatt commented on YARN-8933: Thank you [~botong] for explanation. +1 for the latest

[jira] [Commented] (YARN-8980) Mapreduce application container start fail after AM restart.

2018-11-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682770#comment-16682770 ] Bibin A Chundatt commented on YARN-8980: [~botong]/[~subru] Issue is not completely related to