[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

mukund-thakur commented on a change in pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#discussion_r439283351 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ## @@ -4181,79 +4181,114 @@ public

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

mukund-thakur commented on a change in pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#discussion_r439283239 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AFileOperationCost.java ## @@ -168,6 +168,65 @@ public void

[GitHub] [hadoop] steveloughran commented on a change in pull request #2056: HADOOP-17065. Adding Network Counters in ABFS

steveloughran commented on a change in pull request #2056: URL: https://github.com/apache/hadoop/pull/2056#discussion_r439319323 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsStatistic.java ## @@ -57,7 +57,23 @@

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2063: HADOOP-17020. RawFileSystem could localize default block size to avoid sync bottleneck in config

mehakmeet commented on a change in pull request #2063: URL: https://github.com/apache/hadoop/pull/2063#discussion_r439321862 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/RawLocalFileSystem.java ## @@ -518,7 +520,12 @@ public boolean

[GitHub] [hadoop] steveloughran commented on pull request #2063: HADOOP-17020. RawFileSystem could localize default block size to avoid sync bottleneck in config

steveloughran commented on pull request #2063: URL: https://github.com/apache/hadoop/pull/2063#issuecomment-643181214 Looks good. One question though: Is the change on L520 Meant to be part of this patch? I can see it is an optimisation -But it is not listed in the JIRA If you want

[GitHub] [hadoop] hadoop-yetus commented on pull request #2038: HADOOP-17022 Tune S3AFileSystem.listFiles() api.

hadoop-yetus commented on pull request #2038: URL: https://github.com/apache/hadoop/pull/2038#issuecomment-643180766 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 21m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2071: YARN-10313. Add hadoop process id to the suffix of hadoop-unjar directory

hadoop-yetus commented on pull request #2071: URL: https://github.com/apache/hadoop/pull/2071#issuecomment-643399198 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 22m

[jira] [Commented] (HADOOP-12231) setXIncludeAware errror keep logged while calling get from Configuration

[ https://issues.apache.org/jira/browse/HADOOP-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134430#comment-17134430 ] Jeff Evans commented on HADOOP-12231: - Does anyone have a way to suppress this? > setXIncludeAware

[GitHub] [hadoop] Chandson opened a new pull request #2071: YARN-10313. Add hadoop process id to the suffix of hadoop-unjar directory

Chandson opened a new pull request #2071: URL: https://github.com/apache/hadoop/pull/2071 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] hadoop-yetus commented on pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

hadoop-yetus commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-643423265 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] ishaniahuja opened a new pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

ishaniahuja opened a new pull request #2072: URL: https://github.com/apache/hadoop/pull/2072 The PR provides support for AppendBlob in the Hadoop ABFS Driver. The change also adds changes in the existing test case for appendblob based files. The change has been tested against the HBASE

[GitHub] [hadoop] hadoop-yetus commented on pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

hadoop-yetus commented on pull request #2026: URL: https://github.com/apache/hadoop/pull/2026#issuecomment-643405454 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] vinayakumarb merged pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

vinayakumarb merged pull request #2026: URL: https://github.com/apache/hadoop/pull/2026 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (HADOOP-17046) Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes.

[ https://issues.apache.org/jira/browse/HADOOP-17046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-17046: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HADOOP-17046) Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes.

[ https://issues.apache.org/jira/browse/HADOOP-17046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134441#comment-17134441 ] Hudson commented on HADOOP-17046: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18348 (See

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-643439735 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] umamaheswararao commented on pull request #2066: HDFS-15387. FSUsage#DF should consider ViewFSOverloadScheme in processPath.

umamaheswararao commented on pull request #2066: URL: https://github.com/apache/hadoop/pull/2066#issuecomment-643491971 Thank you @jojochuang for review! This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] umamaheswararao merged pull request #2066: HDFS-15387. FSUsage#DF should consider ViewFSOverloadScheme in processPath.

umamaheswararao merged pull request #2066: URL: https://github.com/apache/hadoop/pull/2066 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HADOOP-17063) S3A deleteObjects hanging/retrying forever

[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134609#comment-17134609 ] Dyno commented on HADOOP-17063: --- switch to magic looks working. thanks for your help.

[GitHub] [hadoop] hadoop-yetus commented on pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

hadoop-yetus commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-643549888 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] ishaniahuja commented on pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

ishaniahuja commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-643562997 namespace enabled, current rest version(2019-12-12), private endpoint Tests run: 83, Failures: 0, Errors: 0, Skipped: 0 Tests run: 440, Failures: 0, Errors: 0, Skipped:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2072: HADOOP-17058. ABFS Support for AppendBlob in Hadoop ABFS Driver

hadoop-yetus commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-643567930 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] steveloughran commented on a change in pull request #2014: HADOOP-16854. ABFS: Fix for the OutOfMemoryException in AbfsOutputStream

steveloughran commented on a change in pull request #2014: URL: https://github.com/apache/hadoop/pull/2014#discussion_r439326950 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemFlush.java ## @@ -207,6 +213,92 @@