[jira] [Created] (HADOOP-16818) ABFS: Combine append+flush calls for blockblob & appendblob

2020-01-20 Thread Bilahari T H (Jira)
Bilahari T H created HADOOP-16818: - Summary: ABFS: Combine append+flush calls for blockblob & appendblob Key: HADOOP-16818 URL: https://issues.apache.org/jira/browse/HADOOP-16818 Project: Hadoop

[jira] [Commented] (HADOOP-16808) Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin

2020-01-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019852#comment-17019852 ] Hadoop QA commented on HADOOP-16808: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HADOOP-16817) Remove Superfluous Dependency on Zookeeper Recipes

2020-01-20 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor resolved HADOOP-16817. - Resolution: Not A Problem I was able to build with the modified POM, but I do see that

[GitHub] [hadoop] belugabehr closed pull request #1813: HADOOP-16817: Remove Superfluous Dependency on Zookeeper Recipes

2020-01-20 Thread GitBox
belugabehr closed pull request #1813: HADOOP-16817: Remove Superfluous Dependency on Zookeeper Recipes URL: https://github.com/apache/hadoop/pull/1813 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] belugabehr opened a new pull request #1813: HADOOP-16817: Remove Superfluous Dependency on Zookeeper Recipes

2020-01-20 Thread GitBox
belugabehr opened a new pull request #1813: HADOOP-16817: Remove Superfluous Dependency on Zookeeper Recipes URL: https://github.com/apache/hadoop/pull/1813 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull

[jira] [Created] (HADOOP-16817) Remove Superfluous Dependency on Zookeeper Recipes

2020-01-20 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16817: --- Summary: Remove Superfluous Dependency on Zookeeper Recipes Key: HADOOP-16817 URL: https://issues.apache.org/jira/browse/HADOOP-16817 Project: Hadoop Common

[jira] [Updated] (HADOOP-16809) Stripping Submarine site from Hadoop site

2020-01-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16809: --- Fix Version/s: asf-site Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HADOOP-16753) Refactor HAAdmin

2020-01-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019807#comment-17019807 ] Hudson commented on HADOOP-16753: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17880 (See

[jira] [Commented] (HADOOP-16808) Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin

2020-01-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019803#comment-17019803 ] Akira Ajisaka commented on HADOOP-16808: +1, pending Jenkins. > Use forkCount and reuseForks

[jira] [Updated] (HADOOP-16753) Refactor HAAdmin

2020-01-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16753: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Updated] (HADOOP-16753) Refactor HAAdmin

2020-01-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16753: --- Component/s: ha > Refactor HAAdmin > > > Key:

[GitHub] [hadoop] wintsonpryme opened a new pull request #1812: HADOOP-16816

2020-01-20 Thread GitBox
wintsonpryme opened a new pull request #1812: HADOOP-16816 URL: https://github.com/apache/hadoop/pull/1812 Please remove or minimize need for native libraries "winutils" to run Spark locally on Windows This is an automated

[jira] [Created] (HADOOP-16816) Please remove or minimize need for native libraries "winutils" to run Spark locally on Windows.

2020-01-20 Thread mark pettovello (Jira)
mark pettovello created HADOOP-16816: Summary: Please remove or minimize need for native libraries "winutils" to run Spark locally on Windows. Key: HADOOP-16816 URL:

[GitHub] [hadoop] hadoop-yetus commented on issue #1761: HADOOP-16759. Filesystem openFile() builder to take a FileStatus param

2020-01-20 Thread GitBox
hadoop-yetus commented on issue #1761: HADOOP-16759. Filesystem openFile() builder to take a FileStatus param URL: https://github.com/apache/hadoop/pull/1761#issuecomment-576455281 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16811) Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-20 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019760#comment-17019760 ] David Mollitor commented on HADOOP-16811: - [~ste...@apache.org] Green light on YETUS. > Use

[GitHub] [hadoop] steveloughran commented on issue #1761: HADOOP-16759. Filesystem openFile() builder to take a FileStatus param

2020-01-20 Thread GitBox
steveloughran commented on issue #1761: HADOOP-16759. Filesystem openFile() builder to take a FileStatus param URL: https://github.com/apache/hadoop/pull/1761#issuecomment-576429973 Latest iteration -tested s3 ireland *Address the checkstyle issues. * Adds some tests of the

[GitHub] [hadoop] hadoop-yetus commented on issue #1811: HADOOP-16811: Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-20 Thread GitBox
hadoop-yetus commented on issue #1811: HADOOP-16811: Use JUnit TemporaryFolder Rule in TestFileUtils URL: https://github.com/apache/hadoop/pull/1811#issuecomment-576418689 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran closed pull request #1791: HADOOP-16785: wasb to raise IOE if write() invoked on a closed stream

2020-01-20 Thread GitBox
steveloughran closed pull request #1791: HADOOP-16785: wasb to raise IOE if write() invoked on a closed stream URL: https://github.com/apache/hadoop/pull/1791 This is an automated message from the Apache Git Service. To

[jira] [Commented] (HADOOP-16785) Improve wasb and abfs resilience on double close() calls

2020-01-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019631#comment-17019631 ] Hudson commented on HADOOP-16785: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17879 (See

[GitHub] [hadoop] steveloughran closed pull request #1809: HADOOP-16785. abfs close()

2020-01-20 Thread GitBox
steveloughran closed pull request #1809: HADOOP-16785. abfs close() URL: https://github.com/apache/hadoop/pull/1809 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] steveloughran commented on issue #1809: HADOOP-16785. abfs close()

2020-01-20 Thread GitBox
steveloughran commented on issue #1809: HADOOP-16785. abfs close() URL: https://github.com/apache/hadoop/pull/1809#issuecomment-576346612 merged to branch-3.2+ This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] steveloughran commented on issue #1809: HADOOP-16785. abfs close()

2020-01-20 Thread GitBox
steveloughran commented on issue #1809: HADOOP-16785. abfs close() URL: https://github.com/apache/hadoop/pull/1809#issuecomment-576344568 thanks This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HADOOP-16811) Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-20 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16811: Fix Version/s: 3.3.0 > Use JUnit TemporaryFolder Rule in TestFileUtils >

[jira] [Updated] (HADOOP-16811) Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-20 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16811: Affects Version/s: 3.2 > Use JUnit TemporaryFolder Rule in TestFileUtils >

[jira] [Updated] (HADOOP-16811) Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-20 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16811: Component/s: test > Use JUnit TemporaryFolder Rule in TestFileUtils >

[GitHub] [hadoop] steveloughran commented on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode

2020-01-20 Thread GitBox
steveloughran commented on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#issuecomment-576340720 latest PR is up; tested s3 ireland with and without ddb, at scale * Out of date entries only propagate from S3 to DDB *when

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode

2020-01-20 Thread GitBox
hadoop-yetus removed a comment on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#issuecomment-575762302 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode

2020-01-20 Thread GitBox
hadoop-yetus removed a comment on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#issuecomment-576333644 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1785: [Doc] Update abfs.md to include additional configs

2020-01-20 Thread GitBox
hadoop-yetus removed a comment on issue #1785: [Doc] Update abfs.md to include additional configs URL: https://github.com/apache/hadoop/pull/1785#issuecomment-569341471 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1785: [Doc] Update abfs.md to include additional configs

2020-01-20 Thread GitBox
hadoop-yetus removed a comment on issue #1785: [Doc] Update abfs.md to include additional configs URL: https://github.com/apache/hadoop/pull/1785#issuecomment-569310404 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16746) S3A empty dir markers are not created in s3guard as authoritative

2020-01-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16746: Priority: Critical (was: Major) > S3A empty dir markers are not created in s3guard as

[jira] [Updated] (HADOOP-16746) S3A empty dir markers are not created in s3guard as authoritative

2020-01-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16746: Summary: S3A empty dir markers are not created in s3guard as authoritative (was: s3a

[jira] [Commented] (HADOOP-16807) Enable Filesystem caching to optionally include URI Path

2020-01-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019569#comment-17019569 ] Steve Loughran commented on HADOOP-16807: - maybe we should cover this explicitly more in the

[GitHub] [hadoop] hadoop-yetus commented on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode

2020-01-20 Thread GitBox
hadoop-yetus commented on issue #1810: HADOOP-16746 mkdirs and s3guard auth mode URL: https://github.com/apache/hadoop/pull/1810#issuecomment-576333644 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] vinayakumarb commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
vinayakumarb commented on issue #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#issuecomment-576247014 > Big diff -but needs to go in everywhere. > > 1. Its unfortunate it mixes

[GitHub] [hadoop] vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r368509854 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-20 Thread GitBox
steveloughran commented on a change in pull request #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#discussion_r368497927 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AUtils.java

[GitHub] [hadoop] steveloughran commented on a change in pull request #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-20 Thread GitBox
steveloughran commented on a change in pull request #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#discussion_r368079266 ## File path:

[GitHub] [hadoop] vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r368491682 ## File path:

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext.

2020-01-20 Thread GitBox
hadoop-yetus removed a comment on issue #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext. URL: https://github.com/apache/hadoop/pull/1679#issuecomment-550514714 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[jira] [Commented] (HADOOP-16811) Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019395#comment-17019395 ] Steve Loughran commented on HADOOP-16811: - version, target fix, component=test... > Use JUnit

[jira] [Commented] (HADOOP-16806) AWS AssumedRoleCredentialProvider needs ExternalId add

2020-01-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019392#comment-17019392 ] Steve Loughran commented on HADOOP-16806: - Thanks Please note the specific policy regarding

[GitHub] [hadoop] steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r368480875 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r368481012 ## File path:

[GitHub] [hadoop] vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r368480193 ## File path: hadoop-common-project/hadoop-registry/pom.xml

[GitHub] [hadoop] vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
vinayakumarb commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r368480252 ## File path: hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml

[GitHub] [hadoop] steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r368479253 ## File path: hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml

[GitHub] [hadoop] steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency

2020-01-20 Thread GitBox
steveloughran commented on a change in pull request #1635: HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency URL: https://github.com/apache/hadoop/pull/1635#discussion_r368478787 ## File path: hadoop-common-project/hadoop-registry/pom.xml

[jira] [Commented] (HADOOP-16670) Stripping Submarine code from Hadoop codebase.

2020-01-20 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019357#comment-17019357 ] Zhankun Tang commented on HADOOP-16670: --- [~aajisaka], sorry for the late reply. I updated the

[jira] [Commented] (HADOOP-16814) Add dropped connections metric for Server

2020-01-20 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019338#comment-17019338 ] Fei Hui commented on HADOOP-16814: -- [~elgoiri] [~ayushtkn] Could you please take a look. > Add