[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481257=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481257 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] JohnZZGithub commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
JohnZZGithub commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-690001235 @umamaheswararao Sure. In fact, I did a major refactor in our internal repo to make it switch case-based.

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481240=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481240 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] umamaheswararao edited a comment on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
umamaheswararao edited a comment on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-689992391 I think the following new lines added into this method. Thats the reason it is reporting longer method warning.. ``` } else if

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481238=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481238 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] umamaheswararao commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
umamaheswararao commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-689992391 I think the following new lines added into this method ``` } else if (src.startsWith(Constants.CONFIG_VIEWFS_LINK_REGEX)) { final String target =

[jira] [Commented] (HADOOP-9331) Hadoop crypto codec framework and crypto codec implementations

2020-09-09 Thread nikhil panchal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193379#comment-17193379 ] nikhil panchal commented on HADOOP-9331: Hello, I have ORC data stored in HDFS. I have one use

[GitHub] [hadoop] JohnZZGithub commented on a change in pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
JohnZZGithub commented on a change in pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#discussion_r486071356 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ConfigUtil.java ## @@ -166,6 +166,42 @@ public static

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481232=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481232 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481231=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481231 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] JohnZZGithub commented on a change in pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
JohnZZGithub commented on a change in pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#discussion_r486070892 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ConfigUtil.java ## @@ -166,6 +166,42 @@ public static

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
umamaheswararao commented on a change in pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#discussion_r486063312 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ConfigUtil.java ## @@ -166,6 +166,42 @@ public static

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481229=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481229 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17255) JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-09-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193369#comment-17193369 ] Akira Ajisaka commented on HADOOP-17255: Thank you [~weichiu] for your comment. The credential

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481226=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481226 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] JohnZZGithub commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
JohnZZGithub commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-689975586 @umamaheswararao Thanks a lot! There's one checkstyle violation. However, I guess it's not introduced by the patch. Yetus recognized a long function name which is

[GitHub] [hadoop] Hexiaoqiao closed pull request #2292: HDFS-15565.Remove the invalid code in the Balancer#doBalance() method.

2020-09-09 Thread GitBox
Hexiaoqiao closed pull request #2292: URL: https://github.com/apache/hadoop/pull/2292 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481216=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481216 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-689963635 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Commented] (HADOOP-17254) Upgrade hbase to 1.2.6.1 on branch-2.10

2020-09-09 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193342#comment-17193342 ] Masatake Iwasaki commented on HADOOP-17254: --- Since only

[jira] [Commented] (HADOOP-17254) Upgrade hbase to 1.2.6.1 on branch-2.10

2020-09-09 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193341#comment-17193341 ] Masatake Iwasaki commented on HADOOP-17254: --- This is minimum dependency bumping to address

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #2225: HDFS-15329. Provide FileContext based ViewFSOverloadScheme implementation

2020-09-09 Thread GitBox
umamaheswararao commented on a change in pull request #2225: URL: https://github.com/apache/hadoop/pull/2225#discussion_r484551422 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/viewfs/TestViewFsOverloadSchemeWithHdfsScheme.java ## @@ -0,0

[jira] [Commented] (HADOOP-17254) Upgrade hbase to 1.2.6.1 on branch-2.10

2020-09-09 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193302#comment-17193302 ] Michael Stack commented on HADOOP-17254: Yeah, upgrade if you can... 1.2.x, 1.3.x are EOL'd. >

[jira] [Commented] (HADOOP-17254) Upgrade hbase to 1.2.6.1 on branch-2.10

2020-09-09 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193275#comment-17193275 ] Mingliang Liu commented on HADOOP-17254: Sorry I do not know what the hbase version is for the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2295: HDFS-15563. Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a snapshottable dir

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2295: URL: https://github.com/apache/hadoop/pull/2295#issuecomment-689903340 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 28m

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481141=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481141 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] umamaheswararao commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
umamaheswararao commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-689877639 Great work @JohnZZGithub. Thanks a lot for your hard work in this. +1 pending jenkins clean report.

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API; S3A to support

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=481138=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481138 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-689874828 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17255) JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-09-09 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193227#comment-17193227 ] Wei-Chiu Chuang commented on HADOOP-17255: -- I was always under the impression that key store

[GitHub] [hadoop] hadoop-yetus commented on pull request #2266: HDFS-15554. RBF: force router check file existence in destinations before adding/updating mount points

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#issuecomment-689860446 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 30m

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
umamaheswararao commented on a change in pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#discussion_r485953722 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md ## @@ -366,6 +366,69 @@ Don't want to change scheme or difficult to copy

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481107=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481107 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-11452) Make FileSystem.rename(path, path, options) public, specified, tested

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11452?focusedWorklogId=481098=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481098 ] ASF GitHub Bot logged work on HADOOP-11452: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #743: HADOOP-11452 make rename/3 public

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #743: URL: https://github.com/apache/hadoop/pull/743#issuecomment-689849388 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 36s

[GitHub] [hadoop] hadoop-yetus commented on pull request #610: [MAPREDUCE-7193] Review of CombineFile Code

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #610: URL: https://github.com/apache/hadoop/pull/610#issuecomment-689838230 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=481066=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481066 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-689831046 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=481060=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481060 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-689822943 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] smengcl opened a new pull request #2295: HDFS-15563. Incorrect getTrashRoot return value when a non-snapshottable dir prefix matches the path of a snapshottable dir

2020-09-09 Thread GitBox
smengcl opened a new pull request #2295: URL: https://github.com/apache/hadoop/pull/2295 https://issues.apache.org/jira/browse/HDFS-15563 This may impact clusters with `dfs.namenode.snapshot.trashroot.enabled` is set to `true`.

[GitHub] [hadoop] hadoop-yetus commented on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-689816045 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=481054=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481054 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri commented on a change in pull request #2266: HDFS-15554. RBF: force router check file existence in destinations before adding/updating mount points

2020-09-09 Thread GitBox
goiri commented on a change in pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#discussion_r485892025 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/router/TestRouterAdmin.java ## @@ -78,6 +83,11 @@

[GitHub] [hadoop] goiri commented on a change in pull request #2266: HDFS-15554. RBF: force router check file existence in destinations before adding/updating mount points

2020-09-09 Thread GitBox
goiri commented on a change in pull request #2266: URL: https://github.com/apache/hadoop/pull/2266#discussion_r485891289 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/router/TestRouterAdmin.java ## @@ -128,7 +175,6 @@

[jira] [Commented] (HADOOP-17181) Handle transient stream read failures in FileSystem contract tests

2020-09-09 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193153#comment-17193153 ] Mingliang Liu commented on HADOOP-17181: Added 3.4.0 as the fix version as well. > Handle

[jira] [Updated] (HADOOP-17181) Handle transient stream read failures in FileSystem contract tests

2020-09-09 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-17181: --- Fix Version/s: 3.4.0 > Handle transient stream read failures in FileSystem contract tests

[jira] [Work logged] (HADOOP-16118) S3Guard to support on-demand DDB tables

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16118?focusedWorklogId=481001=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-481001 ] ASF GitHub Bot logged work on HADOOP-16118: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-16118) S3Guard to support on-demand DDB tables

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-16118: Labels: pull-request-available (was: ) > S3Guard to support on-demand DDB tables >

[GitHub] [hadoop] hadoop-yetus commented on pull request #731: HADOOP-16118. S3Guard to support on-demand DDB tables (branch-3.2).

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #731: URL: https://github.com/apache/hadoop/pull/731#issuecomment-689760736 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 12m 29s

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=480986=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480986 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2294: HADOOP-17195. ABFS Store thread pool for stream IO.

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2294: URL: https://github.com/apache/hadoop/pull/2294#issuecomment-689745307 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=480980=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480980 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=480979=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480979 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
bilaharith commented on a change in pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#discussion_r485828996 ## File path: hadoop-tools/hadoop-azure/.gitignore ## @@ -1,2 +1,4 @@ .checkstyle -bin/ \ No newline at end of file +bin/ +testlogs Review comment:

[GitHub] [hadoop] bilaharith commented on a change in pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
bilaharith commented on a change in pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#discussion_r485828835 ## File path: hadoop-tools/hadoop-azure/testsupport.sh ## @@ -0,0 +1,109 @@ +#!/usr/bin/env bash + +# Licensed to the Apache Software Foundation (ASF)

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=480975=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480975 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
bilaharith commented on a change in pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#discussion_r485827879 ## File path: hadoop-tools/hadoop-azure/testsupport.sh ## @@ -0,0 +1,109 @@ +#!/usr/bin/env bash + +# Licensed to the Apache Software Foundation (ASF)

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=480974=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480974 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
bilaharith commented on a change in pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#discussion_r485827246 ## File path: hadoop-tools/hadoop-azure/testsupport.sh ## @@ -0,0 +1,109 @@ +#!/usr/bin/env bash + +# Licensed to the Apache Software Foundation (ASF)

[jira] [Commented] (HADOOP-17236) Bump up snakeyaml to 1.26 to mitigate CVE-2017-18640

2020-09-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193107#comment-17193107 ] Hadoop QA commented on HADOOP-17236: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] bilaharith commented on a change in pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
bilaharith commented on a change in pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#discussion_r485823482 ## File path: hadoop-tools/hadoop-azure/src/test/resources/abfs-testrun-configs.xml.template ## @@ -0,0 +1,156 @@ + + + + + + + + + + +

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=480973=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480973 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=480966=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480966 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
bilaharith commented on a change in pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#discussion_r485818694 ## File path: hadoop-tools/hadoop-azure/src/test/resources/abfs-testrun-configs.xml.template ## @@ -0,0 +1,156 @@ + + + + + + +

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=480964=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480964 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] bilaharith commented on a change in pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-09 Thread GitBox
bilaharith commented on a change in pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#discussion_r485816830 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemDelegationSAS.java ## @@ -64,7 +64,7 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #582: HDFS-14350:dfs.datanode.ec.reconstruction.threads not take effect

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #582: URL: https://github.com/apache/hadoop/pull/582#issuecomment-689726036 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 0s

[jira] [Work logged] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?focusedWorklogId=480955=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480955 ] ASF GitHub Bot logged work on HADOOP-17165: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2293: YARN-2098. App priority support in Fair Scheduler

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2293: URL: https://github.com/apache/hadoop/pull/2293#issuecomment-689721260 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] tasanuma commented on pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-09-09 Thread GitBox
tasanuma commented on pull request #2240: URL: https://github.com/apache/hadoop/pull/2240#issuecomment-689721030 Thanks for reviewing and merging it, @sunchao and @Hexiaoqiao! This is an automated message from the Apache Git

[GitHub] [hadoop] hadoop-yetus commented on pull request #766: YARN-9509: Added a configuration for admins to be able to capped per-container cpu usage based on a multiplier

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #766: URL: https://github.com/apache/hadoop/pull/766#issuecomment-689716401 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 0s

[jira] [Updated] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-09-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17165: -- Hadoop Flags: Reviewed > Implement service-user feature in DecayRPCScheduler >

[jira] [Updated] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-09-09 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17165: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Work logged] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?focusedWorklogId=480921=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480921 ] ASF GitHub Bot logged work on HADOOP-17165: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?focusedWorklogId=480922=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480922 ] ASF GitHub Bot logged work on HADOOP-17165: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sunchao merged pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-09-09 Thread GitBox
sunchao merged pull request #2240: URL: https://github.com/apache/hadoop/pull/2240 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] sunchao commented on pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-09-09 Thread GitBox
sunchao commented on pull request #2240: URL: https://github.com/apache/hadoop/pull/2240#issuecomment-689690874 Merged. Thanks @tasanuma ! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] sunchao commented on a change in pull request #2292: HDFS-15565.Remove the invalid code in the Balancer#doBalance() method.

2020-09-09 Thread GitBox
sunchao commented on a change in pull request #2292: URL: https://github.com/apache/hadoop/pull/2292#discussion_r485763717 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java ## @@ -705,7 +705,6 @@ static private

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=480916=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480916 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on a change in pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-09 Thread GitBox
viirya commented on a change in pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#discussion_r485760840 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/snappy/SnappyDecompressor.java ## @@ -276,13 +258,27 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #2292: HDFS-15565.Remove the invalid code in the Balancer#doBalance() method.

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2292: URL: https://github.com/apache/hadoop/pull/2292#issuecomment-689671513 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] steveloughran opened a new pull request #2294: HADOOP-17195. ABFS Store thread pool for stream IO.

2020-09-09 Thread GitBox
steveloughran opened a new pull request #2294: URL: https://github.com/apache/hadoop/pull/2294 This is the successor to #2179 1. ABFS Store creates a single threadpool, configurable with fixed size or multiple of cores 1. each output stream is given its own semaphored pool

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=480908=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480908 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17195: Labels: abfsactive pull-request-available (was: abfsactive) > Intermittent OutOfMemory

[GitHub] [hadoop] viirya commented on a change in pull request #2201: HADOOP-17125. Using snappy-java in SnappyCodec

2020-09-09 Thread GitBox
viirya commented on a change in pull request #2201: URL: https://github.com/apache/hadoop/pull/2201#discussion_r485738846 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/snappy/SnappyDecompressor.java ## @@ -276,13 +258,27 @@

[jira] [Work logged] (HADOOP-17125) Using snappy-java in SnappyCodec

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17125?focusedWorklogId=480906=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480906 ] ASF GitHub Bot logged work on HADOOP-17125: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jiwq commented on a change in pull request #2028: MAPREDUCE-7279. Adds RM host name to history server web page

2020-09-09 Thread GitBox
jiwq commented on a change in pull request #2028: URL: https://github.com/apache/hadoop/pull/2028#discussion_r485720653 ## File path:

[GitHub] [hadoop] jiwq commented on a change in pull request #2028: MAPREDUCE-7279. Adds RM host name to history server web page

2020-09-09 Thread GitBox
jiwq commented on a change in pull request #2028: URL: https://github.com/apache/hadoop/pull/2028#discussion_r485720653 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2291: HADOOP-17255. JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-09-09 Thread GitBox
hadoop-yetus commented on pull request #2291: URL: https://github.com/apache/hadoop/pull/2291#issuecomment-689650431 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 32m

[jira] [Work logged] (HADOOP-17255) JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17255?focusedWorklogId=480892=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480892 ] ASF GitHub Bot logged work on HADOOP-17255: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17166) ABFS: configure output stream thread pool

2020-09-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192963#comment-17192963 ] Steve Loughran commented on HADOOP-17166: - merged to trunk. If you want it in 3.3.1 (and IMO,

[jira] [Work logged] (HADOOP-17166) ABFS: Add configs for maxConcurrentRequestCount and threadpool queue size

2020-09-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?focusedWorklogId=480884=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480884 ] ASF GitHub Bot logged work on HADOOP-17166: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-09-09 Thread GitBox
steveloughran merged pull request #2179: URL: https://github.com/apache/hadoop/pull/2179 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (HADOOP-17166) ABFS: configure output stream thread pool

2020-09-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17166: Summary: ABFS: configure output stream thread pool (was: ABFS: Add configs for

[GitHub] [hadoop] jiwq commented on pull request #2270: MAPREDUCE-7295 Add support for a read-only history server

2020-09-09 Thread GitBox
jiwq commented on pull request #2270: URL: https://github.com/apache/hadoop/pull/2270#issuecomment-689640419 > > @Gaurangi94 Thanks for your contribution. I think we should move this JIRA to MapReduce project first. Do you have the detail design docs? > > Hello, I have moved the

[jira] [Commented] (HADOOP-17246) Fix build the hadoop-build Docker image failed

2020-09-09 Thread Wanqiang Ji (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192937#comment-17192937 ] Wanqiang Ji commented on HADOOP-17246: -- Hi [~aajisaka], could you help to review? > Fix build the

[GitHub] [hadoop] jiwq opened a new pull request #2293: YARN-2098. App priority support in Fair Scheduler

2020-09-09 Thread GitBox
jiwq opened a new pull request #2293: URL: https://github.com/apache/hadoop/pull/2293 https://issues.apache.org/jira/browse/YARN-2098 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] jianghuazhu opened a new pull request #2292: HDFS-15565.Remove the invalid code in the Balancer#doBalance() method.

2020-09-09 Thread GitBox
jianghuazhu opened a new pull request #2292: URL: https://github.com/apache/hadoop/pull/2292 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number.

[jira] [Updated] (HADOOP-17255) JavaKeyStoreProvider fails to create a new key if the keystore is HDFS

2020-09-09 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17255: --- Target Version/s: 3.2.2, 3.3.1, 3.4.0, 3.1.5, 2.10.2 (was: 3.3.1, 3.4.0) >

  1   2   >