[GitHub] [hadoop] hadoop-yetus commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-616683729 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 34s |

[jira] [Work started] (HADOOP-17004) ABFS: Improve the ABFS driver documentation

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17004 started by Bilahari T H. - > ABFS: Improve the ABFS driver documentation >

[jira] [Updated] (HADOOP-17004) ABFS: Improve the ABFS driver documentation

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H updated HADOOP-17004: -- Status: Patch Available (was: In Progress) > ABFS: Improve the ABFS driver documentation >

[jira] [Created] (HADOOP-17004) ABFS: Improve the ABFS driver documentation

2020-04-20 Thread Bilahari T H (Jira)
Bilahari T H created HADOOP-17004: - Summary: ABFS: Improve the ABFS driver documentation Key: HADOOP-17004 URL: https://issues.apache.org/jira/browse/HADOOP-17004 Project: Hadoop Common

[jira] [Updated] (HADOOP-16922) ABFS: Change in User-Agent header

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H updated HADOOP-16922: -- Target Version/s: 3.4.0 (was: 3.3.1) > ABFS: Change in User-Agent header >

[jira] [Updated] (HADOOP-16922) ABFS: Change in User-Agent header

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H updated HADOOP-16922: -- Affects Version/s: (was: 3.3.1) 3.4.0 > ABFS: Change in

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088030#comment-17088030 ] Mingliang Liu commented on HADOOP-17001: A final class with private constructor may be better

[GitHub] [hadoop] steveloughran commented on issue #1963: HADOOP-16798. S3A Committer thread pool shutdown problems.

2020-04-20 Thread GitBox
steveloughran commented on issue #1963: URL: https://github.com/apache/hadoop/pull/1963#issuecomment-616771790 run full suite 2x more; no recreation of the failure This is an automated message from the Apache Git Service. To

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087892#comment-17087892 ] bianqi commented on HADOOP-17001: - [~liuml07] update patch , please review thank you very much~~ > The

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17001: - Target Version/s: 3.2.2 (was: 3.2) > The suffix name of the unified compression class

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17001: - Fix Version/s: (was: 3.2.2) > The suffix name of the unified compression class >

[jira] [Assigned] (HADOOP-17004) ABFS: Improve the ABFS driver documentation

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H reassigned HADOOP-17004: - Assignee: Bilahari T H > ABFS: Improve the ABFS driver documentation >

[GitHub] [hadoop] bilaharith opened a new pull request #1970: HADOOP-17004. ABFS: Improve the ABFS driver documentation

2020-04-20 Thread GitBox
bilaharith opened a new pull request #1970: URL: https://github.com/apache/hadoop/pull/1970 ABFS: Improve the ABFS driver documentation. There is no code change. So the tests has not been ran for this. This is an

[jira] [Commented] (HADOOP-17004) ABFS: Improve the ABFS driver documentation

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088026#comment-17088026 ] Bilahari T H commented on HADOOP-17004: --- There is no code change. So the tests has not been ran

[GitHub] [hadoop] hadoop-yetus commented on issue #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1952: URL: https://github.com/apache/hadoop/pull/1952#issuecomment-616654493 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 41s |

[jira] [Assigned] (HADOOP-16933) Backport HADOOP-16890- "ABFS: Change in expiry calculation for MSI token provider" & HADOOP-16825 "ITestAzureBlobFileSystemCheckAccess failing" to branch-2

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H reassigned HADOOP-16933: - Assignee: Bilahari T H > Backport HADOOP-16890- "ABFS: Change in expiry calculation

[GitHub] [hadoop] bilaharith commented on a change in pull request #1898: HADOOP-16852: Report read-ahead error back

2020-04-20 Thread GitBox
bilaharith commented on a change in pull request #1898: URL: https://github.com/apache/hadoop/pull/1898#discussion_r411515373 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestAbfsInputStream.java ## @@ -0,0 +1,433 @@ +/** + *

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001-002.patch > The suffix name of the unified compression class >

[GitHub] [hadoop] ThomasMarquardt commented on issue #1965: HADOOP-16916: ABFS: Delegation SAS generator for integration with Ranger

2020-04-20 Thread GitBox
ThomasMarquardt commented on issue #1965: URL: https://github.com/apache/hadoop/pull/1965#issuecomment-616670838 Thanks for the heads-up, and I'll update this after PR 1956 is merged. Yes, this is a big patch and all of it is related to enabling Delegation SAS support for Apache Ranger.

[jira] [Comment Edited] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

2020-04-20 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087871#comment-17087871 ] Anoop Sam John edited comment on HADOOP-16998 at 4/20/20, 5:30 PM: ---

[GitHub] [hadoop] jojochuang commented on a change in pull request #1967: YARN-9898. Workaround of Netty-all dependency aarch64 support

2020-04-20 Thread GitBox
jojochuang commented on a change in pull request #1967: URL: https://github.com/apache/hadoop/pull/1967#discussion_r411560697 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/pom.xml ## @@ -32,6 +32,25 @@ 1.5.0.Final + Review comment:

[jira] [Updated] (HADOOP-16922) ABFS: Change in User-Agent header

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H updated HADOOP-16922: -- Fix Version/s: (was: 3.3.1) 3.4.0 > ABFS: Change in User-Agent header

[jira] [Created] (HADOOP-17003) No Log compression and retention at KMS

2020-04-20 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17003: -- Summary: No Log compression and retention at KMS Key: HADOOP-17003 URL: https://issues.apache.org/jira/browse/HADOOP-17003 Project: Hadoop Common Issue

[GitHub] [hadoop] hadoop-yetus commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-616681135 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s |

[GitHub] [hadoop] hadoop-yetus commented on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1937: URL: https://github.com/apache/hadoop/pull/1937#issuecomment-616697666 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 23m 22s |

[GitHub] [hadoop] hadoop-yetus commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-616706151 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 16s |

[GitHub] [hadoop] steveloughran commented on issue #1938: HADOOP-16922. ABFS: Changing User-Agent header

2020-04-20 Thread GitBox
steveloughran commented on issue #1938: URL: https://github.com/apache/hadoop/pull/1938#issuecomment-616757178 @DadanielZ I'm happy if you are. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] mpryahin edited a comment on issue #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
mpryahin edited a comment on issue #1952: URL: https://github.com/apache/hadoop/pull/1952#issuecomment-616799192 I've looked through the console output which reports both trunk and patch builds failure due to the following module compilation failure: `[INFO] Apache Hadoop Tencent

[GitHub] [hadoop] mpryahin edited a comment on issue #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
mpryahin edited a comment on issue #1952: URL: https://github.com/apache/hadoop/pull/1952#issuecomment-616799192 I've looked through the console output which reports both trunk and patch builds failure due to the following module compilation failure: `[INFO] Apache Hadoop Tencent

[GitHub] [hadoop] mpryahin commented on issue #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
mpryahin commented on issue #1952: URL: https://github.com/apache/hadoop/pull/1952#issuecomment-616799192 I've looked through the console output which reports both trunk and patch builds failure due to the following module compilation failure: `[INFO] Apache Hadoop Tencent COS

[GitHub] [hadoop] hadoop-yetus commented on issue #1970: HADOOP-17004. ABFS: Improve the ABFS driver documentation

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1970: URL: https://github.com/apache/hadoop/pull/1970#issuecomment-616788015 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 35s |

[GitHub] [hadoop] liusheng commented on a change in pull request #1967: YARN-9898. Workaround of Netty-all dependency aarch64 support

2020-04-20 Thread GitBox
liusheng commented on a change in pull request #1967: URL: https://github.com/apache/hadoop/pull/1967#discussion_r411838315 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/pom.xml ## @@ -32,6 +32,25 @@ 1.5.0.Final + Review comment:

[GitHub] [hadoop] liusheng commented on a change in pull request #1967: YARN-9898. Workaround of Netty-all dependency aarch64 support

2020-04-20 Thread GitBox
liusheng commented on a change in pull request #1967: URL: https://github.com/apache/hadoop/pull/1967#discussion_r411838315 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/pom.xml ## @@ -32,6 +32,25 @@ 1.5.0.Final + Review comment:

[GitHub] [hadoop] hadoop-yetus commented on issue #1967: YARN-9898. Workaround of Netty-all dependency aarch64 support

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1967: URL: https://github.com/apache/hadoop/pull/1967#issuecomment-616945945 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 9s |

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

2020-04-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087834#comment-17087834 ] Steve Loughran commented on HADOOP-16998: - you got a full stack? > WASB :

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

2020-04-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087838#comment-17087838 ] Steve Loughran commented on HADOOP-16998: - can tag this with the specific version of hadoop you

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: (was: HADOOP-17001-002.patch) > The suffix name of the unified compression class >

[jira] [Issue Comment Deleted] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Comment: was deleted (was: [~liuml07] update patch, please review, thank you very much ~) > The suffix

[jira] [Commented] (HADOOP-16977) in javaApi, UGI params should be overidden through FileSystem conf

2020-04-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087842#comment-17087842 ] Steve Loughran commented on HADOOP-16977: - If you have kerberos disabled then the username of

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-20 Thread GitBox
hadoop-yetus removed a comment on issue #1899: URL: https://github.com/apache/hadoop/pull/1899#issuecomment-609805651 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 24m

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-20 Thread GitBox
hadoop-yetus removed a comment on issue #1899: URL: https://github.com/apache/hadoop/pull/1899#issuecomment-600547500 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-20 Thread GitBox
hadoop-yetus removed a comment on issue #1899: URL: https://github.com/apache/hadoop/pull/1899#issuecomment-600068083 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 21m

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-20 Thread GitBox
hadoop-yetus removed a comment on issue #1899: URL: https://github.com/apache/hadoop/pull/1899#issuecomment-610641314 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-20 Thread GitBox
hadoop-yetus removed a comment on issue #1899: URL: https://github.com/apache/hadoop/pull/1899#issuecomment-614531091 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] steveloughran commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-20 Thread GitBox
steveloughran commented on a change in pull request #1899: URL: https://github.com/apache/hadoop/pull/1899#discussion_r411472091 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAbfsOutputStreamStatistics.java ## @@ -0,0 +1,233 @@ +/**

[GitHub] [hadoop] steveloughran commented on a change in pull request #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-20 Thread GitBox
steveloughran commented on a change in pull request #1899: URL: https://github.com/apache/hadoop/pull/1899#discussion_r411474545 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStream.java ## @@ -436,4 +453,28 @@ private

[jira] [Created] (HADOOP-17002) ABFS: Avoid storage calls to check if the account is HNS enabled or not

2020-04-20 Thread Bilahari T H (Jira)
Bilahari T H created HADOOP-17002: - Summary: ABFS: Avoid storage calls to check if the account is HNS enabled or not Key: HADOOP-17002 URL: https://issues.apache.org/jira/browse/HADOOP-17002 Project:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1956: HADOOP-16965 Refactor abfs stream configuration.

2020-04-20 Thread GitBox
steveloughran commented on a change in pull request #1956: URL: https://github.com/apache/hadoop/pull/1956#discussion_r411477050 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -61,21 +61,19 @@ private

[GitHub] [hadoop] steveloughran commented on issue #1946: HADOOP-16961. ABFS: Adding metrics to AbfsInputStream

2020-04-20 Thread GitBox
steveloughran commented on issue #1946: URL: https://github.com/apache/hadoop/pull/1946#issuecomment-616634674 @bgaborg, Can you wait for #1956 to go in? It's trying to get the args to the input stream under control. I hope to merge it on Tuesday Apr 20.

[GitHub] [hadoop] ishaniahuja commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-20 Thread GitBox
ishaniahuja commented on a change in pull request #1937: URL: https://github.com/apache/hadoop/pull/1937#discussion_r411481780 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -119,7 +119,6 @@ public

[GitHub] [hadoop] steveloughran commented on issue #1965: HADOOP-16916: ABFS: Delegation SAS generator for integration with Ranger

2020-04-20 Thread GitBox
steveloughran commented on issue #1965: URL: https://github.com/apache/hadoop/pull/1965#issuecomment-616635540 Well, this is a big patch :) I hope to merge #1956 in on Tuesday Apr 20; it'll break your arg passing to the streams, but its designed to reduce future merge conflict

[GitHub] [hadoop] ishaniahuja commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-20 Thread GitBox
ishaniahuja commented on a change in pull request #1937: URL: https://github.com/apache/hadoop/pull/1937#discussion_r411482133 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/ConfigurationKeys.java ## @@ -51,6 +51,7 @@ public

[GitHub] [hadoop] ishaniahuja commented on a change in pull request #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-20 Thread GitBox
ishaniahuja commented on a change in pull request #1937: URL: https://github.com/apache/hadoop/pull/1937#discussion_r411482408 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java ## @@ -405,10 +426,15 @@ public

[GitHub] [hadoop] ishaniahuja commented on issue #1937: HADOOP-16937. ABFS: revert combined append+flush calls., with default config to disable append+flush calls.

2020-04-20 Thread GitBox
ishaniahuja commented on issue #1937: URL: https://github.com/apache/hadoop/pull/1937#issuecomment-616636078 Result Summary PUBLIC ENDPOINT, SOUTH CENTRAL US Namespace Account Default(fs.azure.enable.appendwithflush=false) Tests run: 59, Failures: 0, Errors: 0,

[jira] [Updated] (HADOOP-17002) ABFS: Avoid storage calls to check if the account is HNS enabled or not

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilahari T H updated HADOOP-17002: -- Status: Patch Available (was: In Progress) > ABFS: Avoid storage calls to check if the

[GitHub] [hadoop] bilaharith opened a new pull request #1969: ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-20 Thread GitBox
bilaharith opened a new pull request #1969: URL: https://github.com/apache/hadoop/pull/1969 Each time an FS instance is created a Getacl call is made. If the call fails with 400 Bad request, the account is determined to be a non-HNS account. Recommendation is to create a config and

[jira] [Commented] (HADOOP-17002) ABFS: Avoid storage calls to check if the account is HNS enabled or not

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087863#comment-17087863 ] Bilahari T H commented on HADOOP-17002: --- *Driver test results using accounts in Central India*

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

2020-04-20 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087871#comment-17087871 ] Anoop Sam John commented on HADOOP-16998: - Thanks Steve. The version on which this was observed

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

2020-04-20 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087873#comment-17087873 ] Anoop Sam John commented on HADOOP-16998: - bq.Patches up on github as PRs for review Bit busy

[jira] [Work started] (HADOOP-17002) ABFS: Avoid storage calls to check if the account is HNS enabled or not

2020-04-20 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17002 started by Bilahari T H. - > ABFS: Avoid storage calls to check if the account is HNS enabled or not >

[jira] [Commented] (HADOOP-14597) Native compilation broken with OpenSSL-1.1.0 because EVP_CIPHER_CTX has been made opaque

2020-04-20 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087403#comment-17087403 ] Masatake Iwasaki commented on HADOOP-14597: --- cherry-picked this to branch-2.10. > Native

[jira] [Updated] (HADOOP-14597) Native compilation broken with OpenSSL-1.1.0 because EVP_CIPHER_CTX has been made opaque

2020-04-20 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-14597: -- Fix Version/s: 2.10.1 > Native compilation broken with OpenSSL-1.1.0 because

[jira] [Updated] (HADOOP-16739) Fix native build failure of hadoop-pipes on CentOS 8

2020-04-20 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16739: -- Fix Version/s: 2.10.1 > Fix native build failure of hadoop-pipes on CentOS 8 >

[jira] [Updated] (HADOOP-16647) Support OpenSSL 1.1.1 LTS

2020-04-20 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16647: -- Fix Version/s: 2.10.1 > Support OpenSSL 1.1.1 LTS > - > >

[jira] [Commented] (HADOOP-16647) Support OpenSSL 1.1.1 LTS

2020-04-20 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087405#comment-17087405 ] Masatake Iwasaki commented on HADOOP-16647: --- cherry-picked this following HADOOP-14597,

[jira] [Commented] (HADOOP-15062) TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9

2020-04-20 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087404#comment-17087404 ] Masatake Iwasaki commented on HADOOP-15062: --- cherry-picked this to branch-2.10. >

[jira] [Updated] (HADOOP-15062) TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9

2020-04-20 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-15062: -- Fix Version/s: 2.10.1 > TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on

[GitHub] [hadoop] liuml07 commented on a change in pull request #1964: HDFS-15281: Make sure ZKFC uses dfs.namenode.rpc-address to bind to host address

2020-04-20 Thread GitBox
liuml07 commented on a change in pull request #1964: URL: https://github.com/apache/hadoop/pull/1964#discussion_r411109845 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/tools/TestDFSZKFCRespectsBindHostKeys.java ## @@ -0,0 +1,98 @@ +/** +

[GitHub] [hadoop] aajisaka opened a new pull request #1968: HDFS-14742. RBF: RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread GitBox
aajisaka opened a new pull request #1968: URL: https://github.com/apache/hadoop/pull/1968 JIRA: https://issues.apache.org/jira/browse/HDFS-14742 This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-20 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HADOOP-16959: Fix Version/s: 3.4.0 > Resolve hadoop-cos dependency conflict >

[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-20 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HADOOP-16959: Fix Version/s: 3.3.1 > Resolve hadoop-cos dependency conflict >

[jira] [Updated] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-20 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HADOOP-16959: Resolution: Fixed Status: Resolved (was: Patch Available) > Resolve hadoop-cos

[GitHub] [hadoop] mpryahin commented on a change in pull request #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
mpryahin commented on a change in pull request #1952: URL: https://github.com/apache/hadoop/pull/1952#discussion_r411300453 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ftp/FTPFileSystem.java ## @@ -340,8 +343,19 @@ public

[GitHub] [hadoop] mpryahin commented on a change in pull request #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
mpryahin commented on a change in pull request #1952: URL: https://github.com/apache/hadoop/pull/1952#discussion_r411300562 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/ftp/TestFTPFileSystem.java ## @@ -37,9 +54,70 @@ */ public class

[GitHub] [hadoop] hadoop-yetus commented on issue #1968: HDFS-14742. RBF: TestRouterFaultTolerant tests are flaky

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1968: URL: https://github.com/apache/hadoop/pull/1968#issuecomment-616469659 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 34s |

[GitHub] [hadoop] mpryahin commented on a change in pull request #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
mpryahin commented on a change in pull request #1952: URL: https://github.com/apache/hadoop/pull/1952#discussion_r411299384 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ftp/FTPFileSystem.java ## @@ -110,7 +111,9 @@ public void

[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-20 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087571#comment-17087571 ] Sammi Chen commented on HADOOP-16959: - Thanks [~yuyang733] for continuously improving the patch

[jira] [Commented] (HADOOP-16959) Resolve hadoop-cos dependency conflict

2020-04-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087588#comment-17087588 ] Hudson commented on HADOOP-16959: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18165 (See

[GitHub] [hadoop] steveloughran commented on a change in pull request #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
steveloughran commented on a change in pull request #1952: URL: https://github.com/apache/hadoop/pull/1952#discussion_r411272114 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ftp/FTPFileSystem.java ## @@ -340,8 +343,19 @@ public

[GitHub] [hadoop] steveloughran commented on a change in pull request #1950: HADOOP-16586. ITestS3GuardFsck, others fails when run using a local m…

2020-04-20 Thread GitBox
steveloughran commented on a change in pull request #1950: URL: https://github.com/apache/hadoop/pull/1950#discussion_r411349770 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/impl/ITestPartialRenamesDeletes.java ## @@ -54,7 +54,12 @@ import

[GitHub] [hadoop] steveloughran commented on issue #1948: HADOOP-16986. s3a to not need wildfly on the classpath

2020-04-20 Thread GitBox
steveloughran commented on issue #1948: URL: https://github.com/apache/hadoop/pull/1948#issuecomment-616535042 Thanks! This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] hadoop-yetus commented on issue #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-20 Thread GitBox
hadoop-yetus commented on issue #1952: URL: https://github.com/apache/hadoop/pull/1952#issuecomment-616555963 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 34s |

[GitHub] [hadoop] aajisaka commented on issue #1939: YARN-10223. Duplicate jersey-test-framework-core dependency in yarn-server-common

2020-04-20 Thread GitBox
aajisaka commented on issue #1939: URL: https://github.com/apache/hadoop/pull/1939#issuecomment-616563294 It's intentional. I think these imports are not required. This is an automated message from the Apache Git Service. To

[jira] [Commented] (HADOOP-16986) s3a to not need wildfly on the classpath

2020-04-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087749#comment-17087749 ] Hudson commented on HADOOP-16986: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18166 (See

[GitHub] [hadoop] bgaborg commented on issue #1962: HADOOP-16953. tuning s3guard disabled warnings

2020-04-20 Thread GitBox
bgaborg commented on issue #1962: URL: https://github.com/apache/hadoop/pull/1962#issuecomment-616570277 LGTM. It's better to have this turned off by default than shout whenever it's disabled. Thanks for fixing this @steveloughran +1

[GitHub] [hadoop] steveloughran commented on issue #1962: HADOOP-16953. tuning s3guard disabled warnings

2020-04-20 Thread GitBox
steveloughran commented on issue #1962: URL: https://github.com/apache/hadoop/pull/1962#issuecomment-616572882 thanks! This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087775#comment-17087775 ] bianqi commented on HADOOP-17001: - [~liuml07] update patch, please review, thank you very much ~ > The

[jira] [Commented] (HADOOP-16953) HADOOP-16953. tune s3guard disabled warnings

2020-04-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087781#comment-17087781 ] Hudson commented on HADOOP-16953: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18167 (See

[GitHub] [hadoop] steveloughran commented on issue #1939: YARN-10223. Duplicate jersey-test-framework-core dependency in yarn-server-common

2020-04-20 Thread GitBox
steveloughran commented on issue #1939: URL: https://github.com/apache/hadoop/pull/1939#issuecomment-616557738 this cuts out both imports. intentional? This is an automated message from the Apache Git Service. To respond to

[jira] [Resolved] (HADOOP-16986) s3a to not need wildfly on the classpath

2020-04-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16986. - Fix Version/s: 3.3.0 Release Note: hadoop-aws can use native openssl libraries

[jira] [Updated] (HADOOP-16953) HADOOP-16953. tune s3guard disabled warnings

2020-04-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16953: Summary: HADOOP-16953. tune s3guard disabled warnings (was: remove org.apache.hadoop

[jira] [Updated] (HADOOP-16953) HADOOP-16953. tune s3guard disabled warnings

2020-04-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16953: Fix Version/s: 3.3.1 > HADOOP-16953. tune s3guard disabled warnings >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-20 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001-002.patch > The suffix name of the unified compression class >