[GitHub] [hadoop] liuml07 edited a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
liuml07 edited a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-577053863 Updated `testing.md`. Failing test is not relevant. Tested against us-west-2 with above plan and command ```

[GitHub] [hadoop] liuml07 edited a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
liuml07 edited a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-577053863 Updated `testing.md`. Failing test is not relevant. Tested against us-west-2 with above plan and command `mvn -T

[GitHub] [hadoop] liuml07 commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
liuml07 commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-577053863 Updated `testing.md`. Failing test is not relevant. Tested against us-west-2 with above plan: - default SSE config

[jira] [Assigned] (HADOOP-16824) [thirdparty] port HADOOP-16754 (Fix docker failed to build yetus/hadoop) to thirdparty Dockerfile

2020-01-21 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B reassigned HADOOP-16824: -- Target Version/s: thirdparty-1.0.0 Assignee: Vinayakumar B >

[jira] [Created] (HADOOP-16824) [thirdparty] port HADOOP-16754 (Fix docker failed to build yetus/hadoop) to thirdparty Dockerfile

2020-01-21 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16824: -- Summary: [thirdparty] port HADOOP-16754 (Fix docker failed to build yetus/hadoop) to thirdparty Dockerfile Key: HADOOP-16824 URL:

[jira] [Resolved] (HADOOP-16820) [thirdparty] ChangeLog and ReleaseNote are not packaged by createrelease script

2020-01-21 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HADOOP-16820. Fix Version/s: thirdparty-1.0.0 Hadoop Flags: Reviewed Assignee:

[jira] [Commented] (HADOOP-16820) [thirdparty] ChangeLog and ReleaseNote are not packaged by createrelease script

2020-01-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020838#comment-17020838 ] Hudson commented on HADOOP-16820: - SUCCESS: Integrated in Jenkins build Hadoop-thirdparty-trunk-commit

[GitHub] [hadoop] hadoop-yetus commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are…

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are… URL: https://github.com/apache/hadoop/pull/1815#issuecomment-577028589 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16670) Stripping Submarine code from Hadoop codebase.

2020-01-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020763#comment-17020763 ] Hudson commented on HADOOP-16670: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17890 (See

[jira] [Updated] (HADOOP-16670) Stripping Submarine code from Hadoop codebase.

2020-01-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16670: - Release Note: The Submarine subproject is moved to its own Apache Top Level Project.

[jira] [Updated] (HADOOP-16670) Stripping Submarine code from Hadoop codebase.

2020-01-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-16670: - Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[GitHub] [hadoop] hadoop-yetus commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-576998857 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are…

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are… URL: https://github.com/apache/hadoop/pull/1815#issuecomment-576989997 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-576972274 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] mustafaiman commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are…

2020-01-21 Thread GitBox
mustafaiman commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are… URL: https://github.com/apache/hadoop/pull/1815#issuecomment-576971732 Havent run hadoop-aws tests yet, will update with the test results when I get them.

[GitHub] [hadoop] mustafaiman opened a new pull request #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are…

2020-01-21 Thread GitBox
mustafaiman opened a new pull request #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are… URL: https://github.com/apache/hadoop/pull/1815 … authoritative ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to

[GitHub] [hadoop] hadoop-yetus commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-576965145 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16806) AWS AssumedRoleCredentialProvider needs ExternalId add

2020-01-21 Thread Jon Hartlaub (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Hartlaub updated HADOOP-16806: -- Description: AWS has added a security feature to the assume-role function in the form of the

[jira] [Updated] (HADOOP-16806) AWS AssumedRoleCredentialProvider needs ExternalId add

2020-01-21 Thread Jon Hartlaub (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Hartlaub updated HADOOP-16806: -- Description: AWS has added a security feature to the assume-role function in the form of the

[jira] [Updated] (HADOOP-16806) AWS AssumedRoleCredentialProvider needs ExternalId add

2020-01-21 Thread Jon Hartlaub (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Hartlaub updated HADOOP-16806: -- Description: AWS has added a security feature to the assume-role function in the form of the

[jira] [Updated] (HADOOP-16806) AWS AssumedRoleCredentialProvider needs ExternalId add

2020-01-21 Thread Jon Hartlaub (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Hartlaub updated HADOOP-16806: -- Description: AWS has added a security feature to the assume-role function in the form of the

[GitHub] [hadoop] hadoop-yetus commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-576941328 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-01-21 Thread Ramesh Kumar Thangarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HADOOP-16769: -- Attachment: HADOOP-16769.6.patch Status: Patch Available

[jira] [Updated] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-01-21 Thread Ramesh Kumar Thangarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesh Kumar Thangarajan updated HADOOP-16769: -- Status: Open (was: Patch Available) > LocalDirAllocator to provide

[jira] [Resolved] (HADOOP-16759) Filesystem openFile() builder to take a FileStatus param

2020-01-21 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-16759. Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to

[jira] [Commented] (HADOOP-16759) Filesystem openFile() builder to take a FileStatus param

2020-01-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020618#comment-17020618 ] Hudson commented on HADOOP-16759: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17888 (See

[GitHub] [hadoop] liuml07 merged pull request #1761: HADOOP-16759. Filesystem openFile() builder to take a FileStatus param

2020-01-21 Thread GitBox
liuml07 merged pull request #1761: HADOOP-16759. Filesystem openFile() builder to take a FileStatus param URL: https://github.com/apache/hadoop/pull/1761 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (HADOOP-16814) Add dropped connections metric for Server

2020-01-21 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-16814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020584#comment-17020584 ] Íñigo Goiri commented on HADOOP-16814: -- I'm not sure if it's possible but, is there a way to have

[jira] [Updated] (HADOOP-16793) Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()

2020-01-21 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HADOOP-16793: - Summary: Remove WARN log when ipc connection interrupted in

[jira] [Commented] (HADOOP-16793) Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()

2020-01-21 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020580#comment-17020580 ] Íñigo Goiri commented on HADOOP-16793: -- [~iwasakims] thanks for committing. Just for reference,

[GitHub] [hadoop] hadoop-yetus commented on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1814#issuecomment-576887564 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1785: [Doc] Update abfs.md to include additional configs

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1785: [Doc] Update abfs.md to include additional configs URL: https://github.com/apache/hadoop/pull/1785#issuecomment-576882384 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] karthick-rn commented on a change in pull request #1785: [Doc] Update abfs.md to include additional configs

2020-01-21 Thread GitBox
karthick-rn commented on a change in pull request #1785: [Doc] Update abfs.md to include additional configs URL: https://github.com/apache/hadoop/pull/1785#discussion_r369220894 ## File path: hadoop-tools/hadoop-azure/src/site/markdown/abfs.md ## @@ -857,6 +857,46 @@

[GitHub] [hadoop] karthick-rn commented on a change in pull request #1785: [Doc] Update abfs.md to include additional configs

2020-01-21 Thread GitBox
karthick-rn commented on a change in pull request #1785: [Doc] Update abfs.md to include additional configs URL: https://github.com/apache/hadoop/pull/1785#discussion_r369220894 ## File path: hadoop-tools/hadoop-azure/src/site/markdown/abfs.md ## @@ -857,6 +857,46 @@

[GitHub] [hadoop] karthick-rn commented on a change in pull request #1785: [Doc] Update abfs.md to include additional configs

2020-01-21 Thread GitBox
karthick-rn commented on a change in pull request #1785: [Doc] Update abfs.md to include additional configs URL: https://github.com/apache/hadoop/pull/1785#discussion_r369210633 ## File path: hadoop-tools/hadoop-azure/src/site/markdown/abfs.md ## @@ -857,6 +857,46 @@

[GitHub] [hadoop] vinayakumarb commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-21 Thread GitBox
vinayakumarb commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#issuecomment-576831088 Updated with review comments fix. @steveloughran please review.

[GitHub] [hadoop] vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-21 Thread GitBox
vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r369186603 ## File path: hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml

[GitHub] [hadoop] vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-21 Thread GitBox
vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r369186422 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1810: HADOOP-16746 mkdirs and s3guard auth mode

2020-01-21 Thread GitBox
steveloughran commented on a change in pull request #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#discussion_r369185234 ## File path:

[GitHub] [hadoop] steveloughran commented on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-21 Thread GitBox
steveloughran commented on issue #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1814#issuecomment-576824665 *not yet tested against anything* This is an

[GitHub] [hadoop] steveloughran opened a new pull request #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-01-21 Thread GitBox
steveloughran opened a new pull request #1814: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1814 Currently AWS S3 throttling is initially handled in the AWS SDK, only reaching the S3 client code after it has given up. This

[jira] [Created] (HADOOP-16823) Manage S3 Throttling exclusively in S3A client

2020-01-21 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16823: --- Summary: Manage S3 Throttling exclusively in S3A client Key: HADOOP-16823 URL: https://issues.apache.org/jira/browse/HADOOP-16823 Project: Hadoop Common

[GitHub] [hadoop] mustafaiman commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-21 Thread GitBox
mustafaiman commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-576819167 @steveloughran thanks for the detailed review, i'll adress the comments shortly

[jira] [Resolved] (HADOOP-16821) [pb-upgrade] Use 'o.a.h.thirdparty.protobuf' shaded prefix instead of 'protobuf_3_7'

2020-01-21 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HADOOP-16821. Fix Version/s: thirdparty-1.0.0 Hadoop Flags: Reviewed Assignee:

[jira] [Updated] (HADOOP-16405) Upgrade Wildfly Openssl version to 1.0.7.Final

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16405: Fix Version/s: (was: 3.2.1) 3.2.2 > Upgrade Wildfly Openssl

[jira] [Updated] (HADOOP-16405) Upgrade Wildfly Openssl version to 1.0.7.Final

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16405: Fix Version/s: 3.2.1 > Upgrade Wildfly Openssl version to 1.0.7.Final >

[jira] [Updated] (HADOOP-16410) Hadoop 3.2 azure jars incompatible with alpine 3.9

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16410: Fix Version/s: (was: 3.3.0) 3.2.2 > Hadoop 3.2 azure jars

[jira] [Commented] (HADOOP-16410) Hadoop 3.2 azure jars incompatible with alpine 3.9

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020409#comment-17020409 ] Steve Loughran commented on HADOOP-16410: - I'm closing as done for 3.2.2; the upgrade is in

[jira] [Updated] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16460: Fix Version/s: 3.2.2 > ABFS: fix for Sever Name Indication (SNI) >

[jira] [Comment Edited] (HADOOP-16410) Hadoop 3.2 azure jars incompatible with alpine 3.9

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880222#comment-16880222 ] Steve Loughran edited comment on HADOOP-16410 at 1/21/20 5:32 PM: -- How

[jira] [Commented] (HADOOP-16821) [pb-upgrade] Use 'o.a.h.thirdparty.protobuf' shaded prefix instead of 'protobuf_3_7'

2020-01-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020406#comment-17020406 ] Hudson commented on HADOOP-16821: - SUCCESS: Integrated in Jenkins build Hadoop-thirdparty-trunk-commit

[jira] [Resolved] (HADOOP-16410) Hadoop 3.2 azure jars incompatible with alpine 3.9

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16410. - Fix Version/s: 3.3.0 Resolution: Fixed > Hadoop 3.2 azure jars incompatible

[jira] [Reopened] (HADOOP-16410) Hadoop 3.2 azure jars incompatible with alpine 3.9

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-16410: - > Hadoop 3.2 azure jars incompatible with alpine 3.9 >

[jira] [Commented] (HADOOP-16346) Stabilize S3A OpenSSL support

2020-01-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020386#comment-17020386 ] Hudson commented on HADOOP-16346: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17883 (See

[jira] [Commented] (HADOOP-16767) S3AInputStream reopening does not handle non IO exceptions properly

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020383#comment-17020383 ] Steve Loughran commented on HADOOP-16767: - BTW, you say "drain event". Maybe we should be

[jira] [Resolved] (HADOOP-16346) Stabilize S3A OpenSSL support

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16346. - Fix Version/s: 3.3.0 Resolution: Fixed > Stabilize S3A OpenSSL support >

[GitHub] [hadoop] steveloughran closed pull request #1764: HADOOP-16346: Stabilize S3A OpenSSL support

2020-01-21 Thread GitBox
steveloughran closed pull request #1764: HADOOP-16346: Stabilize S3A OpenSSL support URL: https://github.com/apache/hadoop/pull/1764 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] steveloughran commented on issue #1764: HADOOP-16346: Stabilize S3A OpenSSL support

2020-01-21 Thread GitBox
steveloughran commented on issue #1764: HADOOP-16346: Stabilize S3A OpenSSL support URL: https://github.com/apache/hadoop/pull/1764#issuecomment-576774180 +1, merged in. thanks. This is an automated message

[jira] [Updated] (HADOOP-16050) S3A SSL connections should use OpenSSL

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16050: Summary: S3A SSL connections should use OpenSSL (was: s3a SSL connections should use

[jira] [Updated] (HADOOP-16819) Possible inconsistent state of AbstractDelegationTokenSecretManager

2020-01-21 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-16819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hankó Gergely updated HADOOP-16819: --- Status: Patch Available (was: Open) > Possible inconsistent state of

[GitHub] [hadoop] belugabehr commented on issue #1811: HADOOP-16811: Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-21 Thread GitBox
belugabehr commented on issue #1811: HADOOP-16811: Use JUnit TemporaryFolder Rule in TestFileUtils URL: https://github.com/apache/hadoop/pull/1811#issuecomment-576741345 Yup! Thanks! On Tue, Jan 21, 2020, 9:34 AM Steve Loughran wrote: > LGTM. > you happy with this

[jira] [Updated] (HADOOP-16819) Possible inconsistent state of AbstractDelegationTokenSecretManager

2020-01-21 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-16819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hankó Gergely updated HADOOP-16819: --- Attachment: HADOOP-16819.001.patch > Possible inconsistent state of

[jira] [Commented] (HADOOP-16800) ITestDynamoDBMetadataStore.testTableVersioning failure -DDB deleteItem consistency?

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020310#comment-17020310 ] Steve Loughran commented on HADOOP-16800: - seen again >

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-21 Thread GitBox
hadoop-yetus removed a comment on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-573271018 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #1766: HADOOP-16767 Handle non-IO exceptions in reopen()

2020-01-21 Thread GitBox
steveloughran commented on issue #1766: HADOOP-16767 Handle non-IO exceptions in reopen() URL: https://github.com/apache/hadoop/pull/1766#issuecomment-576716575 Still expecting that declaration of which s3 endpoint you ran the `mvn verify` tests for hadoop-aws. we don't have time to run

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1764: HADOOP-16346: Stabilize S3A OpenSSL support

2020-01-21 Thread GitBox
hadoop-yetus removed a comment on issue #1764: HADOOP-16346: Stabilize S3A OpenSSL support URL: https://github.com/apache/hadoop/pull/1764#issuecomment-566198914 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-21 Thread GitBox
steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r369036615 ## File path:

[jira] [Resolved] (HADOOP-16816) Please remove or minimize need for native libraries "winutils" to run Spark locally on Windows.

2020-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16816. - Fix Version/s: HADOOP-13223 Resolution: Duplicate duplicate of HADOOP-13223;

[GitHub] [hadoop] steveloughran commented on issue #1811: HADOOP-16811: Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-21 Thread GitBox
steveloughran commented on issue #1811: HADOOP-16811: Use JUnit TemporaryFolder Rule in TestFileUtils URL: https://github.com/apache/hadoop/pull/1811#issuecomment-576708890 LGTM. you happy with this yourself? This is an

[GitHub] [hadoop] bgaborg commented on a change in pull request #1810: HADOOP-16746 mkdirs and s3guard auth mode

2020-01-21 Thread GitBox
bgaborg commented on a change in pull request #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#discussion_r368971623 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/S3Guard.java ## @@

[GitHub] [hadoop] bgaborg commented on a change in pull request #1810: HADOOP-16746 mkdirs and s3guard auth mode

2020-01-21 Thread GitBox
bgaborg commented on a change in pull request #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#discussion_r368986839 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/S3Guard.java ## @@

[GitHub] [hadoop] bgaborg commented on a change in pull request #1810: HADOOP-16746 mkdirs and s3guard auth mode

2020-01-21 Thread GitBox
bgaborg commented on a change in pull request #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#discussion_r368973683 ## File path:

[jira] [Comment Edited] (HADOOP-16822) Provide source artifacts for hadoop-client-api

2020-01-21 Thread Karel Kolman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020180#comment-17020180 ] Karel Kolman edited comment on HADOOP-16822 at 1/21/20 12:25 PM: -

[jira] [Updated] (HADOOP-16822) Provide source artifacts for hadoop-client-api

2020-01-21 Thread Karel Kolman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karel Kolman updated HADOOP-16822: -- Attachment: HADOOP-16822-hadoop-client-api-source-jar.patch > Provide source artifacts for

[jira] [Commented] (HADOOP-13989) Remove erroneous source jar option from hadoop-client shade configuration

2020-01-21 Thread Karel Kolman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020182#comment-17020182 ] Karel Kolman commented on HADOOP-13989: --- I was not able to find a "Create shaded sources jars in

[jira] [Updated] (HADOOP-16822) Provide source artifacts for hadoop-client-api

2020-01-21 Thread Karel Kolman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karel Kolman updated HADOOP-16822: -- Status: Patch Available (was: Open) Attaching a proposed patch to generate aggregate

[GitHub] [hadoop] hadoop-yetus commented on issue #1761: HADOOP-16759. Filesystem openFile() builder to take a FileStatus param

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1761: HADOOP-16759. Filesystem openFile() builder to take a FileStatus param URL: https://github.com/apache/hadoop/pull/1761#issuecomment-576655600 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
steveloughran commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-576633149 I'm happy with this patch. Only thing remaining is for me to play with it a bit in real use, which will come after a

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1811: HADOOP-16811: Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-21 Thread GitBox
hadoop-yetus removed a comment on issue #1811: HADOOP-16811: Use JUnit TemporaryFolder Rule in TestFileUtils URL: https://github.com/apache/hadoop/pull/1811#issuecomment-575737327 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
hadoop-yetus removed a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-565581811 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
hadoop-yetus removed a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-565352545 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on a change in pull request #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
steveloughran commented on a change in pull request #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#discussion_r368938322 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
steveloughran commented on a change in pull request #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#discussion_r368938701 ## File path:

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
hadoop-yetus removed a comment on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-575859139 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #1812: HADOOP-16816

2020-01-21 Thread GitBox
steveloughran commented on issue #1812: HADOOP-16816 URL: https://github.com/apache/hadoop/pull/1812#issuecomment-576630898 looks like the PR is against the wrong branch -make sure it's generated against trunk This is an

[jira] [Commented] (HADOOP-16809) Stripping Submarine site from Hadoop site

2020-01-21 Thread Wanqiang Ji (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020122#comment-17020122 ] Wanqiang Ji commented on HADOOP-16809: -- Thanks [~aajisaka] for the review and commit. > Stripping

[jira] [Updated] (HADOOP-16822) Provide source artifacts for hadoop-client-api

2020-01-21 Thread Karel Kolman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karel Kolman updated HADOOP-16822: -- Description: h5. Improvement request The third-party libraries shading hadoop-client-api (&

[jira] [Updated] (HADOOP-16822) Provide source artifacts for hadoop-client-api

2020-01-21 Thread Karel Kolman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karel Kolman updated HADOOP-16822: -- Description: The third-party libraries shading hadoop-client-api (& hadoop-client-runtime)

[GitHub] [hadoop] hadoop-yetus commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table

2020-01-21 Thread GitBox
hadoop-yetus commented on issue #1752: HADOOP-16732. S3Guard to support encrypted DynamoDB table URL: https://github.com/apache/hadoop/pull/1752#issuecomment-576619098 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16822) Provide source artifacts for hadoop-client-api

2020-01-21 Thread Karel Kolman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karel Kolman updated HADOOP-16822: -- Environment: (was: The third-party libraries shading hadoop-client-api (&

[jira] [Updated] (HADOOP-16822) Provide source artifacts for hadoop-client-api

2020-01-21 Thread Karel Kolman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karel Kolman updated HADOOP-16822: -- Description: The third-party libraries shading hadoop-client-api (& hadoop-client-runtime)

[jira] [Created] (HADOOP-16822) Provide source artifacts for hadoop-client-api

2020-01-21 Thread Karel Kolman (Jira)
Karel Kolman created HADOOP-16822: - Summary: Provide source artifacts for hadoop-client-api Key: HADOOP-16822 URL: https://issues.apache.org/jira/browse/HADOOP-16822 Project: Hadoop Common

[jira] [Updated] (HADOOP-16821) [pb-upgrade] Use 'o.a.h.thirdparty.protobuf' shaded prefix instead of 'protobuf_3_7'

2020-01-21 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16821: --- Target Version/s: thirdparty-1.0.0 > [pb-upgrade] Use 'o.a.h.thirdparty.protobuf' shaded

[jira] [Updated] (HADOOP-16821) [pb-upgrade] Use 'o.a.h.thirdparty.protobuf' shaded prefix instead of 'protobuf_3_7'

2020-01-21 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16821: --- Component/s: hadoop-thirdparty > [pb-upgrade] Use 'o.a.h.thirdparty.protobuf' shaded

[jira] [Created] (HADOOP-16821) [pb-upgrade] Use 'o.a.h.thirdparty.protobuf' shaded prefix instead of 'protobuf_3_7'

2020-01-21 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16821: -- Summary: [pb-upgrade] Use 'o.a.h.thirdparty.protobuf' shaded prefix instead of 'protobuf_3_7' Key: HADOOP-16821 URL: https://issues.apache.org/jira/browse/HADOOP-16821

[jira] [Commented] (HADOOP-16793) Redefine log level when ipc connection interrupted in Client#handleSaslConnectionFailure()

2020-01-21 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020108#comment-17020108 ] Masatake Iwasaki commented on HADOOP-16793: --- I missed that the commit message does not

[jira] [Updated] (HADOOP-16793) Redefine log level when ipc connection interrupted in Client#handleSaslConnectionFailure()

2020-01-21 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16793: -- Fix Version/s: 2.10.1 3.2.2 3.1.4

[jira] [Created] (HADOOP-16820) [thirdparty] ChangeLog and ReleaseNote are not packaged by createrelease script

2020-01-21 Thread Vinayakumar B (Jira)
Vinayakumar B created HADOOP-16820: -- Summary: [thirdparty] ChangeLog and ReleaseNote are not packaged by createrelease script Key: HADOOP-16820 URL: https://issues.apache.org/jira/browse/HADOOP-16820

[jira] [Commented] (HADOOP-16793) Redefine log level when ipc connection interrupted in Client#handleSaslConnectionFailure()

2020-01-21 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020067#comment-17020067 ] Masatake Iwasaki commented on HADOOP-16793: --- I'm +1 too, committing this. > Redefine log

[jira] [Commented] (HADOOP-16808) Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin

2020-01-21 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020066#comment-17020066 ] Hudson commented on HADOOP-16808: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17881 (See

  1   2   >