[GitHub] [hadoop] DadanielZ commented on issue #1923: Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-21 Thread GitBox
DadanielZ commented on issue #1923: URL: https://github.com/apache/hadoop/pull/1923#issuecomment-617545247 Looks good to me, +1. Merged into trunk This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1923: Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-21 Thread GitBox
DadanielZ commented on a change in pull request #1923: URL: https://github.com/apache/hadoop/pull/1923#discussion_r412662675 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/oauth2/CustomTokenProviderAdapter.java ## @@ -46,16 +48,53 @@ *

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1923: Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-21 Thread GitBox
DadanielZ commented on a change in pull request #1923: URL: https://github.com/apache/hadoop/pull/1923#discussion_r412662007 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/oauth2/CustomTokenProviderAdapter.java ## @@ -46,16 +48,53 @@ *

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
DadanielZ commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412655425 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java ## @@ -732,6 +740,11 @@ void

[GitHub] [hadoop] DadanielZ commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
DadanielZ commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412652364 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java ## @@ -234,6 +236,9 @@ String

[jira] [Updated] (HADOOP-16671) Optimize InnerNodeImpl#getLeaf

2020-04-21 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HADOOP-16671: - Status: Patch Available (was: Reopened) > Optimize InnerNodeImpl#getLeaf >

[jira] [Created] (HADOOP-17005) Add capability in hadoop-client to automatically login from a client/service keytab

2020-04-21 Thread Maziar Mirzazad (Jira)
Maziar Mirzazad created HADOOP-17005: Summary: Add capability in hadoop-client to automatically login from a client/service keytab Key: HADOOP-17005 URL: https://issues.apache.org/jira/browse/HADOOP-17005

[GitHub] [hadoop] hadoop-yetus commented on issue #1923: Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1923: URL: https://github.com/apache/hadoop/pull/1923#issuecomment-617459239 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 31s |

[GitHub] [hadoop] snvijaya commented on a change in pull request #1923: Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-21 Thread GitBox
snvijaya commented on a change in pull request #1923: URL: https://github.com/apache/hadoop/pull/1923#discussion_r412520627 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/oauth2/CustomTokenProviderAdapter.java ## @@ -46,16 +48,53 @@ *

[GitHub] [hadoop] snvijaya commented on a change in pull request #1923: Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-21 Thread GitBox
snvijaya commented on a change in pull request #1923: URL: https://github.com/apache/hadoop/pull/1923#discussion_r412518187 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/oauth2/CustomTokenProviderAdapter.java ## @@ -46,16 +48,53 @@ *

[GitHub] [hadoop] snvijaya commented on issue #1923: Hadoop 16857. ABFS: Stop CustomTokenProvider retry logic to depend on AbfsRestOp retry policy

2020-04-21 Thread GitBox
snvijaya commented on issue #1923: URL: https://github.com/apache/hadoop/pull/1923#issuecomment-617432357 Latest test results: Test results: East US 2 Account - With HNS [INFO] Tests run: 54, Failures: 0, Errors: 0, Skipped: 0 [WARNING] Tests run: 416, Failures: 0,

[GitHub] [hadoop] hadoop-yetus commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-617421026 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 17s |

[jira] [Commented] (HADOOP-16922) ABFS: Change in User-Agent header

2020-04-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089015#comment-17089015 ] Hudson commented on HADOOP-16922: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18171 (See

[jira] [Commented] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2020-04-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089014#comment-17089014 ] Hudson commented on HADOOP-16965: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18171 (See

[jira] [Updated] (HADOOP-16989) Update JaegerTracing

2020-04-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16989: - Target Version/s: thirdparty-1.1.0 > Update JaegerTracing > > >

[jira] [Commented] (HADOOP-16916) ABFS: Delegation SAS generator for integration with Ranger

2020-04-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088986#comment-17088986 ] Hadoop QA commented on HADOOP-16916: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on issue #1965: HADOOP-16916: ABFS: Delegation SAS generator for integration with Ranger

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1965: URL: https://github.com/apache/hadoop/pull/1965#issuecomment-617357370 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 34s |

[GitHub] [hadoop] hadoop-yetus commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-617344317 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 32s |

[GitHub] [hadoop] ThomasMarquardt commented on issue #1965: HADOOP-16916: ABFS: Delegation SAS generator for integration with Ranger

2020-04-21 Thread GitBox
ThomasMarquardt commented on issue #1965: URL: https://github.com/apache/hadoop/pull/1965#issuecomment-617331272 Thanks for the update, I merged and pushed the update. All tests passing against my eastus2euap account: $ mvn -T 1C -Dparallel-tests=abfs -Dscale

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088899#comment-17088899 ] Hadoop QA commented on HADOOP-17001: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] bilaharith commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
bilaharith commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412349747 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/ConfigurationKeys.java ## @@ -27,6 +27,14 @@

[GitHub] [hadoop] bilaharith removed a comment on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
bilaharith removed a comment on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-617260280 **Driver test results using accounts in Central India** mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify **Account with HNS Support**

[GitHub] [hadoop] snvijaya commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
snvijaya commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412343848 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java ## @@ -110,6 +110,7 @@ import static

[jira] [Commented] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1705#comment-1705 ] Steve Loughran commented on HADOOP-16965: - (got some git repo sync issues between amazon and

[jira] [Commented] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1704#comment-1704 ] Steve Loughran commented on HADOOP-16965: - merged in to trunk; about to merge into branch-3.3

[GitHub] [hadoop] steveloughran commented on a change in pull request #1916: MAPREDUCE-7267 Merge paths with multi threads during commit job in FileOutputCommitter

2020-04-21 Thread GitBox
steveloughran commented on a change in pull request #1916: URL: https://github.com/apache/hadoop/pull/1916#discussion_r412321478 ## File path:

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-21 Thread GitBox
hadoop-yetus removed a comment on issue #1952: URL: https://github.com/apache/hadoop/pull/1952#issuecomment-612602618 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] steveloughran commented on a change in pull request #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-21 Thread GitBox
steveloughran commented on a change in pull request #1952: URL: https://github.com/apache/hadoop/pull/1952#discussion_r412336936 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/ftp/FTPFileSystem.java ## @@ -110,7 +111,9 @@ public void

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-21 Thread GitBox
hadoop-yetus removed a comment on issue #1952: URL: https://github.com/apache/hadoop/pull/1952#issuecomment-612242452 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088867#comment-17088867 ] Hadoop QA commented on HADOOP-17001: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] steveloughran commented on issue #1965: HADOOP-16916: ABFS: Delegation SAS generator for integration with Ranger

2020-04-21 Thread GitBox
steveloughran commented on issue #1965: URL: https://github.com/apache/hadoop/pull/1965#issuecomment-617275425 ok, conflicting patch is in This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] steveloughran commented on issue #1946: HADOOP-16961. ABFS: Adding metrics to AbfsInputStream

2020-04-21 Thread GitBox
steveloughran commented on issue #1946: URL: https://github.com/apache/hadoop/pull/1946#issuecomment-617275059 gabor, see if I've broken this building; if so rebase and resubmit. thanks This is an automated message from the

[GitHub] [hadoop] bilaharith commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
bilaharith commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-617260280 **Driver test results using accounts in Central India** mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify **Account with HNS Support** [INFO]

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088828#comment-17088828 ] Wei-Chiu Chuang commented on HADOOP-17001: -- LGTM Github PR is now preferred but attaching

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088827#comment-17088827 ] bianqi commented on HADOOP-17001: - update patch, fix whitespace checkstyle > The suffix name of the

[GitHub] [hadoop] bilaharith commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
bilaharith commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-617258947 Review comments addressed. **Driver test results using accounts in Central India** mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify **Account

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001.005.patch Status: Patch Available (was: Open) > The suffix name of the

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: (was: HADOOP-17001-001.patch) > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Status: Open (was: Patch Available) > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: (was: HADOOP-17001-002.patch) > The suffix name of the unified compression class >

[GitHub] [hadoop] bilaharith commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
bilaharith commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412263543 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java ## @@ -253,6 +259,20 @@ public

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088761#comment-17088761 ] Hadoop QA commented on HADOOP-17001: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: (was: HADOOP-17001.004.patch) > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Status: Open (was: Patch Available) > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001.004.patch Status: Patch Available (was: Open) > The suffix name of the

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001.004.patch > The suffix name of the unified compression class >

[GitHub] [hadoop] hadoop-yetus commented on issue #1956: HADOOP-16965 Refactor abfs stream configuration.

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1956: URL: https://github.com/apache/hadoop/pull/1956#issuecomment-617227728 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 32s |

[jira] [Commented] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088740#comment-17088740 ] Hadoop QA commented on HADOOP-17001: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16977) in javaApi, UGI params should be overidden through FileSystem conf

2020-04-21 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088738#comment-17088738 ] Hongbing Wang commented on HADOOP-16977: We have disabled kerberos. The username can be passed

[GitHub] [hadoop] hadoop-yetus commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-617208584 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 1s |

[GitHub] [hadoop] steveloughran commented on a change in pull request #1892: HADOOP-16769 LocalDirAllocator to provide diagnostics when file creat…

2020-04-21 Thread GitBox
steveloughran commented on a change in pull request #1892: URL: https://github.com/apache/hadoop/pull/1892#discussion_r412220807 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/LocalDirAllocator.java ## @@ -441,9 +443,16 @@ public Path

[jira] [Issue Comment Deleted] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16769: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Issue Comment Deleted] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16769: Comment: was deleted (was: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Issue Comment Deleted] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16769: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Issue Comment Deleted] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16769: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Issue Comment Deleted] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16769: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Issue Comment Deleted] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16769: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Issue Comment Deleted] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16769: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on issue #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1969: URL: https://github.com/apache/hadoop/pull/1969#issuecomment-617190479 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 14s |

[jira] [Updated] (HADOOP-17003) No Log compression and retention in Hadoop

2020-04-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17003: --- Description: Hadoop logging lacks several important features. Logs generated end up eating

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #1956: HADOOP-16965 Refactor abfs stream configuration.

2020-04-21 Thread GitBox
mukund-thakur commented on a change in pull request #1956: URL: https://github.com/apache/hadoop/pull/1956#discussion_r412185071 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsOutputStreamContext.java ## @@ -0,0 +1,68 @@ +/**

[jira] [Updated] (HADOOP-17003) No Log compression and retention in Hadoop

2020-04-21 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17003: --- Summary: No Log compression and retention in Hadoop (was: No Log compression and

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

2020-04-21 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088658#comment-17088658 ] ramkrishna.s.vasudevan commented on HADOOP-16998: - +1 on patch's approach. (non

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001.003.patch Status: Patch Available (was: Open) > The suffix name of the

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001.003.patch > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: (was: HADOOP-17001.003.patch) > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Status: Open (was: Patch Available) > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: (was: HADOOP-17001-003.patch) > The suffix name of the unified compression class >

[GitHub] [hadoop] bilaharith commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
bilaharith commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412131351 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java ## @@ -253,6 +259,20 @@ public

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001-003.patch Status: Patch Available (was: In Progress) > The suffix name

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: (was: HADOOP-17001-003.patch) > The suffix name of the unified compression class >

[jira] [Work started] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17001 started by bianqi. --- > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-17001) The suffix name of the unified compression class

2020-04-21 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HADOOP-17001: Attachment: HADOOP-17001-003.patch > The suffix name of the unified compression class >

[jira] [Updated] (HADOOP-16944) Use Yetus 0.12.0 in GitHub PR

2020-04-21 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16944: --- Fix Version/s: 2.10.1 3.2.2 3.1.4

[jira] [Updated] (HADOOP-16944) Use Yetus 0.12.0 in GitHub PR

2020-04-21 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16944: --- Fix Version/s: (was: 3.4.0) > Use Yetus 0.12.0 in GitHub PR >

[GitHub] [hadoop] bilaharith commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
bilaharith commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412131351 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java ## @@ -253,6 +259,20 @@ public

[GitHub] [hadoop] bilaharith commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
bilaharith commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412127358 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/ConfigurationKeys.java ## @@ -27,6 +27,15 @@

[GitHub] [hadoop] snvijaya commented on a change in pull request #1969: HADOOP-17002. ABFS: Adding config to determine if the account is HNS enabled or not

2020-04-21 Thread GitBox
snvijaya commented on a change in pull request #1969: URL: https://github.com/apache/hadoop/pull/1969#discussion_r412108329 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/ConfigurationKeys.java ## @@ -27,6 +27,15 @@

[GitHub] [hadoop] hadoop-yetus commented on issue #1970: HADOOP-17004. ABFS: Improve the ABFS driver documentation

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1970: URL: https://github.com/apache/hadoop/pull/1970#issuecomment-617126273 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 14s |

[GitHub] [hadoop] snvijaya commented on a change in pull request #1970: HADOOP-17004. ABFS: Improve the ABFS driver documentation

2020-04-21 Thread GitBox
snvijaya commented on a change in pull request #1970: URL: https://github.com/apache/hadoop/pull/1970#discussion_r412092762 ## File path: hadoop-tools/hadoop-azure/src/site/markdown/abfs.md ## @@ -665,6 +665,79 @@ performance issues. Config `fs.azure.enable.check.access`

[GitHub] [hadoop] mpryahin edited a comment on issue #1952: HDFS-1820. FTPFileSystem attempts to close the outputstream even when it is not initialised.

2020-04-21 Thread GitBox
mpryahin edited a comment on issue #1952: URL: https://github.com/apache/hadoop/pull/1952#issuecomment-616799192 I've looked through the console output which reports both trunk and patch builds failure due to the following module compilation failure: `[INFO] Apache Hadoop Tencent

[GitHub] [hadoop] bilaharith commented on issue #1938: HADOOP-16922. ABFS: Changing User-Agent header

2020-04-21 Thread GitBox
bilaharith commented on issue #1938: URL: https://github.com/apache/hadoop/pull/1938#issuecomment-617102677 At present the User-Agent header would look like: Azure Blob FS/3.4.0-SNAPSHOT (JavaJRE 1.8.0_241; Linux 5.3.0-46-generic; SunJSSE-1.8) MSFT With this PR it would be:

[jira] [Commented] (HADOOP-16963) HADOOP-16582 changed mkdirs() behavior

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088480#comment-17088480 ] Steve Loughran commented on HADOOP-16963: - What HADOOP-16582 does is guarantee that

[jira] [Resolved] (HADOOP-16794) S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16794. - Fix Version/s: 3.3.0 Resolution: Fixed > S3A reverts KMS encryption to the

[jira] [Updated] (HADOOP-16794) S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16794: Parent Issue: HADOOP-15620 (was: HADOOP-16829) > S3A reverts KMS encryption to the

[jira] [Updated] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2020-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13887: Summary: Encrypt S3A data client-side with AWS SDK (S3-CSE) (was: Encrypt S3A data

[jira] [Resolved] (HADOOP-11264) Common side changes for HDFS Erasure coding support

2020-04-21 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HADOOP-11264. -- Hadoop Flags: Reviewed Resolution: Fixed All sub tasks closed. >

[GitHub] [hadoop] hadoop-yetus commented on issue #1971: MAPREDUCE-7276 fix hadoop job fast fail not working issue

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1971: URL: https://github.com/apache/hadoop/pull/1971#issuecomment-617023677 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s |

[GitHub] [hadoop] hadoop-yetus commented on issue #1899: HADOOP-16914 Adding Output Stream Counters in ABFS

2020-04-21 Thread GitBox
hadoop-yetus commented on issue #1899: URL: https://github.com/apache/hadoop/pull/1899#issuecomment-617021845 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 30m 4s |

[GitHub] [hadoop] tiana528 opened a new pull request #1971: MAPREDUCE-7276 fix hadoop job fast fail not working issue

2020-04-21 Thread GitBox
tiana528 opened a new pull request #1971: URL: https://github.com/apache/hadoop/pull/1971 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.