[jira] [Updated] (YARN-9049) Add application submit data to state store

2018-11-22 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-9049: --- Description: As per the discussion in YARN-8898 we need to persist trimmend

[jira] [Updated] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-22 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated YARN-5168: -- Attachment: YARN-5168.005.patch > Add port mapping handling when docker container use bridge network >

[jira] [Created] (YARN-9048) Add znode hierarchy in Federation ZK State Store

2018-11-22 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-9048: -- Summary: Add znode hierarchy in Federation ZK State Store Key: YARN-9048 URL: https://issues.apache.org/jira/browse/YARN-9048 Project: Hadoop YARN Issue

[jira] [Created] (YARN-9049) Add application submit data to state store

2018-11-22 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-9049: -- Summary: Add application submit data to state store Key: YARN-9049 URL: https://issues.apache.org/jira/browse/YARN-9049 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: YARN-8986.009.patch > publish all exposed ports to random ports when using bridge network >

[jira] [Comment Edited] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696395#comment-16696395 ] Eric Yang edited comment on YARN-8986 at 11/23/18 5:37 AM: --- [~Charo Zhang] The

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696395#comment-16696395 ] Eric Yang commented on YARN-8986: - [~Charo Zhang] The test can be run locally using in

[jira] [Updated] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

2018-11-22 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9043: --- Attachment: YARN-9043.001.patch > Inter-queue preemption sometimes starves an underserved queue when using >

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696380#comment-16696380 ] Hadoop QA commented on YARN-5168: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696371#comment-16696371 ] Hadoop QA commented on YARN-5168: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-22 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated YARN-5168: -- Attachment: YARN-5168.004.patch > Add port mapping handling when docker container use bridge network >

[jira] [Updated] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-22 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated YARN-5168: -- Attachment: YARN-5168.003.patch > Add port mapping handling when docker container use bridge network >

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696318#comment-16696318 ] Charo Zhang commented on YARN-8986: --- [~eyang] The unit test failure of

[jira] [Updated] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9047: - Attachment: YARN-9047.001.patch > FairScheduler: default resource calculator is not resource type

[jira] [Commented] (YARN-9025) Make TestFairScheduler#testChildMaxResources more reliable, as it is flaky now

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696218#comment-16696218 ] Hadoop QA commented on YARN-9025: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-9047: --- Assignee: Szilard Nemeth > FairScheduler: default resource calculator is not

[jira] [Created] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-9047: --- Summary: FairScheduler: default resource calculator is not resource type aware Key: YARN-9047 URL: https://issues.apache.org/jira/browse/YARN-9047

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696144#comment-16696144 ] Hadoop QA commented on YARN-5106: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696123#comment-16696123 ] Eric Yang commented on YARN-8986: - [~liuxun323] Docker container can support one bridge network, and one

[jira] [Updated] (YARN-9025) Make TestFairScheduler#testChildMaxResources more reliable, as it is flaky now

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9025: - Attachment: YARN-9025.002.patch > Make TestFairScheduler#testChildMaxResources more reliable, as

[jira] [Commented] (YARN-9025) Make TestFairScheduler#testChildMaxResources more reliable, as it is flaky now

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696113#comment-16696113 ] Szilard Nemeth commented on YARN-9025: -- Thanks [~haibochen] for doing a review! Added drainEvents()

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696022#comment-16696022 ] Hadoop QA commented on YARN-5106: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2018-11-22 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695976#comment-16695976 ] Antal Bálint Steinbach commented on YARN-8586: -- Thanks, [~snemeth] LGTM +1 (Non-binding) >

[jira] [Commented] (YARN-9042) Javadoc error in deviceplugin package

2018-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695971#comment-16695971 ] Hudson commented on YARN-9042: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15497 (See

[jira] [Commented] (YARN-8994) Fix for race condition in move app and queue cleanup in FS

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695966#comment-16695966 ] Szilard Nemeth commented on YARN-8994: -- Thanks [~wilfreds] for solving this race condition! Patch

[jira] [Commented] (YARN-8994) Fix for race condition in move app and queue cleanup in FS

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695947#comment-16695947 ] Hadoop QA commented on YARN-8994: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-5106: - Attachment: YARN-5106.006.patch > Provide a builder interface for FairScheduler allocations for

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695931#comment-16695931 ] Szilard Nemeth commented on YARN-5106: -- Actually it turned out that the {{"file.encoding"}} system

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695882#comment-16695882 ] Hadoop QA commented on YARN-8986: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9034) ApplicationCLI should have option to take clusterId

2018-11-22 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695864#comment-16695864 ] Suma Shivaprasad commented on YARN-9034: +1 > ApplicationCLI should have option to take clusterId

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695861#comment-16695861 ] Hadoop QA commented on YARN-5168: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-5106: - Attachment: YARN-5106.005.patch > Provide a builder interface for FairScheduler allocations for

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695825#comment-16695825 ] Szilard Nemeth commented on YARN-5106: -- With patch005, nothing is really changed, I just added back

[jira] [Commented] (YARN-9042) Javadoc error in deviceplugin package

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695791#comment-16695791 ] Hadoop QA commented on YARN-9042: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: YARN-8986.008.patch > publish all exposed ports to random ports when using bridge network >

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: (was: YARN-8986.008.patch) > publish all exposed ports to random ports when using

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

2018-11-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695775#comment-16695775 ] Szilard Nemeth commented on YARN-9008: -- Hi [~pbacsko]! Thanks for the updated patch. Latest patch

[jira] [Updated] (YARN-8887) Support isolation in pluggable device framework

2018-11-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8887: --- Description: Devices isolation needs a complete description in API specs(DeviceRuntimeSpec) and a

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695770#comment-16695770 ] Xun Liu commented on YARN-8986: --- hi, [~Charo Zhang], [~eyang] Configure network plugins using calico,

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695755#comment-16695755 ] Charo Zhang commented on YARN-8986: --- [~eyang] i refactored add_ports_mapping_to_command and related test

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-22 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695741#comment-16695741 ] Yang Wang commented on YARN-8984: - [~cheersyang] [~kkaranasos] Thanks for all your reviews and commit. >

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695740#comment-16695740 ] Hadoop QA commented on YARN-8986: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695745#comment-16695745 ] Hudson commented on YARN-8984: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15494 (See

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695737#comment-16695737 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-22 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695727#comment-16695727 ] Wilfred Spiegelenburg commented on YARN-8948: - Thank you [~bibinchundatt] for the updated

[jira] [Commented] (YARN-9042) Javadoc error in deviceplugin package

2018-11-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695693#comment-16695693 ] Zhankun Tang commented on YARN-9042: [~rohithsharma] , the patch is uploaded. Please help to review.

[jira] [Updated] (YARN-9042) Javadoc error in deviceplugin package

2018-11-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9042: --- Attachment: YARN-9042-trunk.001.patch > Javadoc error in deviceplugin package >

[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695690#comment-16695690 ] Weiwei Yang commented on YARN-8984: --- Committed to trunk, cherry picked to branch-3.2. Thanks for the

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8984: -- Fix Version/s: 3.2.1 > AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty >

[jira] [Commented] (YARN-9034) ApplicationCLI should have option to take clusterId

2018-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695678#comment-16695678 ] Hadoop QA commented on YARN-9034: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8714: --- Attachment: YARN-8714-trunk.002.patch > [Submarine] Support files/tarballs to be localized for a