[jira] [Updated] (HADOOP-16071) Fix typo in DistCp Counters - Bandwidth in Bytes

[ https://issues.apache.org/jira/browse/HADOOP-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-16071: Resolution: Won't Fix Status: Resolved (was: Patch Available) > Fix typo in DistCp

[GitHub] [hadoop] hadoop-yetus commented on issue #1856: YARN-10156: Fix a typo 'complaint' which means quite different in Federation.md

hadoop-yetus commented on issue #1856: YARN-10156: Fix a typo 'complaint' which means quite different in Federation.md URL: https://github.com/apache/hadoop/pull/1856#issuecomment-589918606 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] sungpeo opened a new pull request #1856: YARN-10156: Fix a typo 'complaint' which means quite different in Federation.md

sungpeo opened a new pull request #1856: YARN-10156: Fix a typo 'complaint' which means quite different in Federation.md URL: https://github.com/apache/hadoop/pull/1856 `be complaint to` should be `be compliant with` on the context.

[GitHub] [hadoop] jojochuang commented on a change in pull request #1846: HADOOP-15566. Support Opentracing

jojochuang commented on a change in pull request #1846: HADOOP-15566. Support Opentracing URL: https://github.com/apache/hadoop/pull/1846#discussion_r382865557 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java ##

[GitHub] [hadoop] jojochuang commented on a change in pull request #1846: HADOOP-15566. Support Opentracing

jojochuang commented on a change in pull request #1846: HADOOP-15566. Support Opentracing URL: https://github.com/apache/hadoop/pull/1846#discussion_r382861120 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/tracing/TraceUtils.java ## @@

[GitHub] [hadoop] jojochuang commented on a change in pull request #1846: HADOOP-15566. Support Opentracing

jojochuang commented on a change in pull request #1846: HADOOP-15566. Support Opentracing URL: https://github.com/apache/hadoop/pull/1846#discussion_r382856741 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FsTracer.java ## @@ -49,6

[GitHub] [hadoop] jojochuang commented on a change in pull request #1846: HADOOP-15566. Support Opentracing

jojochuang commented on a change in pull request #1846: HADOOP-15566. Support Opentracing URL: https://github.com/apache/hadoop/pull/1846#discussion_r382858893 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/tracing/TraceUtils.java ## @@

[GitHub] [hadoop] hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move et

hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#issuecomment-589891303 :broken_heart: **-1 overall**

[jira] [Updated] (HADOOP-16794) S3 Encryption is always using default region-specific AWS-managed KMS key

[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-16794: --- Target Version/s: 3.0.4, 3.3.0, 3.1.4, 3.2.2, 2.10.1 [~ste...@apache.org] and

[GitHub] [hadoop] jojochuang commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc.

jojochuang commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#issuecomment-589836552 The javac warnings are expected

[GitHub] [hadoop] steveloughran commented on issue #1847: HADOOP-16859: ABFS: Add unbuffer support to ABFS connector

steveloughran commented on issue #1847: HADOOP-16859: ABFS: Add unbuffer support to ABFS connector URL: https://github.com/apache/hadoop/pull/1847#issuecomment-589812599 +1 don't worry about magic numbers in tests; I don't

[jira] [Updated] (HADOOP-16867) [thirdparty] Add shaded JargerTracer

[ https://issues.apache.org/jira/browse/HADOOP-16867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-16867: -- Fix Version/s: thirdparty-1.0.0 > [thirdparty] Add shaded JargerTracer >

[jira] [Commented] (HADOOP-16875) S3Guard: add support for other MetadataStores

[ https://issues.apache.org/jira/browse/HADOOP-16875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042045#comment-17042045 ] Rafael Acevedo commented on HADOOP-16875: - Hi [~ste...@apache.org], just some additional info:

[jira] [Commented] (HADOOP-16873) Upgrade to Apache ZooKeeper 3.5.7

[ https://issues.apache.org/jira/browse/HADOOP-16873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042040#comment-17042040 ] Wei-Chiu Chuang commented on HADOOP-16873: -- Thanks [~nkalmar]. Looking at RN, not a lot of

[jira] [Updated] (HADOOP-16875) S3Guard: add support for other MetadataStores

[ https://issues.apache.org/jira/browse/HADOOP-16875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafael Acevedo updated HADOOP-16875: Attachment: image-2020-02-21-14-03-28-327.png > S3Guard: add support for other

[jira] [Updated] (HADOOP-16875) S3Guard: add support for other MetadataStores

[ https://issues.apache.org/jira/browse/HADOOP-16875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafael Acevedo updated HADOOP-16875: Attachment: image-2020-02-21-14-02-23-866.png > S3Guard: add support for other

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382650778 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382645746 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382649934 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382648840 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382643267 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382640519 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382647018 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382641208 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382639992 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382643634 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382644337 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382649460 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382645295 ## File path:

[jira] [Updated] (HADOOP-16867) [thirdparty] Add shaded JargerTracer

[ https://issues.apache.org/jira/browse/HADOOP-16867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-16867: Resolution: Fixed Status: Resolved (was: Patch Available) > [thirdparty] Add shaded

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

hadoop-yetus removed a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-589618887 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16875) S3Guard: add support for other MetadataStores

[ https://issues.apache.org/jira/browse/HADOOP-16875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041944#comment-17041944 ] Rafael Acevedo commented on HADOOP-16875: - Hi Steve, I see. About pay-as-you-go tables, they

[GitHub] [hadoop] steveloughran commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

steveloughran commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-589673298 +1; merged with a couple of final fixups of the test (add @Deprecated) to the test class to shut up checkstyle

[GitHub] [hadoop] steveloughran closed pull request #1845: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

steveloughran closed pull request #1845: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1845 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (HADOOP-16711) S3A bucket existence checks to support v2 API and "no checks at all"

[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041895#comment-17041895 ] Hudson commented on HADOOP-16711: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17974 (See

[jira] [Updated] (HADOOP-16711) S3A bucket existence checks to support v2 API and "no checks at all"

[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16711: Description: 1. in S3AFileSystem.initialize(), we check for the bucket existing with

[jira] [Updated] (HADOOP-16711) S3A bucket existence checks to support v2 API and "no checks at all"

[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16711: Summary: S3A bucket existence checks to support v2 API and "no checks at all" (was: Add

[jira] [Resolved] (HADOOP-16711) Add way to skip "verifyBuckets" check in S3A fs init()

[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16711. - Fix Version/s: 3.3.0 Release Note: The probe for an S3 bucket existing now uses

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

hadoop-yetus removed a comment on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-588444854 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16875) S3Guard: add support for other MetadataStores

[ https://issues.apache.org/jira/browse/HADOOP-16875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041835#comment-17041835 ] Steve Loughran commented on HADOOP-16875: - it's expensive if you buy IO capacity, but DDB has

[GitHub] [hadoop] hadoop-yetus commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

hadoop-yetus commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-589627591 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Created] (HADOOP-16877) S3A FS deleteOnExit to skip the exists check

Steve Loughran created HADOOP-16877: --- Summary: S3A FS deleteOnExit to skip the exists check Key: HADOOP-16877 URL: https://issues.apache.org/jira/browse/HADOOP-16877 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

hadoop-yetus commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-589618887 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16706) ITestClientUrlScheme fails for accounts which don't support HTTP

[ https://issues.apache.org/jira/browse/HADOOP-16706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041779#comment-17041779 ] Hudson commented on HADOOP-16706: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17973 (See

[jira] [Resolved] (HADOOP-16706) ITestClientUrlScheme fails for accounts which don't support HTTP

[ https://issues.apache.org/jira/browse/HADOOP-16706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16706. - Fix Version/s: 3.3.0 Resolution: Fixed > ITestClientUrlScheme fails for

[GitHub] [hadoop] steveloughran merged pull request #1844: HADOOP-16706. ITestClientUrlScheme fails for accounts which don't support HTTP

steveloughran merged pull request #1844: HADOOP-16706. ITestClientUrlScheme fails for accounts which don't support HTTP URL: https://github.com/apache/hadoop/pull/1844 This is an automated message from the Apache Git

[GitHub] [hadoop] steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

steveloughran commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382526421 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

hadoop-yetus removed a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-586471959 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

hadoop-yetus removed a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-586260074 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] snvijaya commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-589607680 Have fixed the open comments. @steveloughran - Can you please check. Thanks.

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382523121 ## File path:

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382523369 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382519485 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382512241 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/utils/SASGenerator.java

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382512112 ## File path:

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382511733 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382510841 ## File path:

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382510986 ## File path:

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382510664 ## File path:

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382510394 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382510512 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java

[GitHub] [hadoop] snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

snvijaya commented on a change in pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#discussion_r382510065 ## File path: