[jira] [Updated] (HADOOP-16548) ABFS: Config to enable/disable flush operation

2019-09-12 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-16548: --- Attachment: HADOOP-16548.patch > ABFS: Config to enable/disable flush operation >

[GitHub] [hadoop] lokeshj1703 commented on issue #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out.

2019-09-12 Thread GitBox
lokeshj1703 commented on issue #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out. URL: https://github.com/apache/hadoop/pull/1430#issuecomment-531097629 @bshashikant Thanks for working on this! Can we also check if TestContainerSmallFile failure is related?

[jira] [Created] (HADOOP-16569) improve TLS performance for NativeAzureFileSystem

2019-09-12 Thread Steven Rand (Jira)
Steven Rand created HADOOP-16569: Summary: improve TLS performance for NativeAzureFileSystem Key: HADOOP-16569 URL: https://issues.apache.org/jira/browse/HADOOP-16569 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on issue #1436: HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1436: HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs URL: https://github.com/apache/hadoop/pull/1436#issuecomment-531057753 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-12 Thread GitBox
hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435#discussion_r323990891 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on issue #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435#issuecomment-531046239 :broken_heart: **-1 overall** | Vote | Subsystem |

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-12 Thread GitBox
hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435#discussion_r323990885 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-12 Thread GitBox
hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435#discussion_r323990902 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-12 Thread GitBox
hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435#discussion_r323990878 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-12 Thread GitBox
hadoop-yetus commented on a change in pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435#discussion_r323990870 ## File path:

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out.

2019-09-12 Thread GitBox
xiaoyuyao commented on a change in pull request #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out. URL: https://github.com/apache/hadoop/pull/1430#discussion_r323984092 ## File path:

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out.

2019-09-12 Thread GitBox
xiaoyuyao commented on a change in pull request #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out. URL: https://github.com/apache/hadoop/pull/1430#discussion_r323983697 ## File path:

[GitHub] [hadoop] xiaoyuyao merged pull request #1418: HDDS-2089: Add createPipeline CLI.

2019-09-12 Thread GitBox
xiaoyuyao merged pull request #1418: HDDS-2089: Add createPipeline CLI. URL: https://github.com/apache/hadoop/pull/1418 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] sahilTakiar opened a new pull request #1436: HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs

2019-09-12 Thread GitBox
sahilTakiar opened a new pull request #1436: HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs URL: https://github.com/apache/hadoop/pull/1436 [HDFS-14846](https://issues.apache.org/jira/browse/HDFS-14846): libhdfs tests are failing on trunk due to jni usage bugs

[GitHub] [hadoop] nandakumar131 opened a new pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.

2019-09-12 Thread GitBox
nandakumar131 opened a new pull request #1435: HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. URL: https://github.com/apache/hadoop/pull/1435 After #1423 hdds/ozone no more relies on hadoop parent pom, so we have to use separate

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
hadoop-yetus commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#discussion_r314769222 ## File path: hadoop-ozone/dist/src/main/smoketest/s3/MultipartUpload.robot ## @@ -200,3 +200,24

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
hadoop-yetus commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#discussion_r312740496 ## File path: hadoop-ozone/dist/src/main/smoketest/s3/MultipartUpload.robot ## @@ -200,3 +200,24

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
hadoop-yetus commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#discussion_r315708896 ## File path: hadoop-ozone/dist/src/main/smoketest/s3/MultipartUpload.robot ## @@ -200,3 +200,24

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#issuecomment-526197265 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#issuecomment-527276378 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#issuecomment-525862802 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#issuecomment-52616 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#issuecomment-525885449 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] elek commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket

2019-09-12 Thread GitBox
elek commented on a change in pull request #1277: HDDS-1054. List Multipart uploads in a bucket URL: https://github.com/apache/hadoop/pull/1277#discussion_r323920792 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/OzoneBucket.java ## @@

[GitHub] [hadoop] hadoop-yetus commented on issue #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar URL: https://github.com/apache/hadoop/pull/1434#issuecomment-530956782 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-530952381 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] elek opened a new pull request #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar

2019-09-12 Thread GitBox
elek opened a new pull request #1434: HDDS-2120. Remove hadoop classes from ozonefs-current jar URL: https://github.com/apache/hadoop/pull/1434 We have two kind of ozone file system jars: current and legacy. current is designed to work only with exactly the same hadoop version which is

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928795#comment-16928795 ] stack commented on HADOOP-13363: One thought, just use the hbase-thirdparty jar? Shaded protobuf,

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread stack (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928784#comment-16928784 ] stack commented on HADOOP-13363: On your #1 and #2 choices above, #1 works for us. Cost is negligible

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread Allen Wittenauer (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928778#comment-16928778 ] Allen Wittenauer commented on HADOOP-13363: --- Since I'm the originator of this JIRA issue, I

[jira] [Resolved] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16566. - Resolution: Fixed > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-530930833 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928767#comment-16928767 ] Steve Loughran commented on HADOOP-16547: - to recreate the problem you also need to set the

[GitHub] [hadoop] hadoop-yetus commented on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3 URL: https://github.com/apache/hadoop/pull/1160#issuecomment-530923330 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime |

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928746#comment-16928746 ] Vinayakumar B commented on HADOOP-13363: I have created subtasks to proceed step-by-step. Kept

[jira] [Updated] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-13363: --- Status: Open (was: Patch Available) > Upgrade protobuf from 2.5.0 to something newer >

[jira] [Commented] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928735#comment-16928735 ] Hudson commented on HADOOP-16566: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17288 (See

[jira] [Commented] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928734#comment-16928734 ] Gabor Bota commented on HADOOP-16566: - +1 by [~ste...@apache.org] on #1433 PR. Committing. >

[GitHub] [hadoop] bgaborg merged pull request #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
bgaborg merged pull request #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433 This is an automated message

[GitHub] [hadoop] steveloughran commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
steveloughran commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433#issuecomment-530916390 +1, with the note that DurationInfo exists to do all this timing and

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928726#comment-16928726 ] Steve Loughran commented on HADOOP-16547: - actually, there's a simpler way to verify the move;

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928722#comment-16928722 ] Steve Loughran commented on HADOOP-16547: - latest patch will seem to do the load, but need to

[jira] [Commented] (HADOOP-16568) S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928715#comment-16928715 ] Steve Loughran commented on HADOOP-16568: - {code} 2019-09-12 17:31:39,678 [main] DEBUG

[jira] [Created] (HADOOP-16568) S3A FullCredentialsTokenBinding fails if local credentials are unset

2019-09-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16568: --- Summary: S3A FullCredentialsTokenBinding fails if local credentials are unset Key: HADOOP-16568 URL: https://issues.apache.org/jira/browse/HADOOP-16568

[GitHub] [hadoop] bgaborg commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
bgaborg commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433#issuecomment-530905783 tested against ireland. No new errors, but I'm still getting

[jira] [Commented] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928709#comment-16928709 ] Steve Loughran commented on HADOOP-16565: - Once you have identified the cause, add a new entry

[jira] [Updated] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16565: Component/s: fs/s3 > Fix "com.amazonaws.SdkClientException: Unable to find a region via

[jira] [Updated] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16565: Affects Version/s: 3.3.0 > Fix "com.amazonaws.SdkClientException: Unable to find a

[jira] [Commented] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928706#comment-16928706 ] Steve Loughran commented on HADOOP-16565: - looks like I deliberately choose london for STS''

[GitHub] [hadoop] hadoop-yetus commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433#issuecomment-530899366 :broken_heart: **-1 overall** | Vote |

[jira] [Resolved] (HADOOP-16423) S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log)

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16423. - Resolution: Fixed > S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log) >

[jira] [Commented] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928693#comment-16928693 ] Gabor Bota commented on HADOOP-16566: - maybe, but it would be better to update guava everywhere. >

[jira] [Work started] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16566 started by Gabor Bota. --- > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[jira] [Commented] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928679#comment-16928679 ] Steve Loughran commented on HADOOP-16566: - is there any way for us to tweak checkstyle/findbugs

[GitHub] [hadoop] steveloughran commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
steveloughran commented on issue #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433#issuecomment-530888108 tested?

[GitHub] [hadoop] nandakumar131 closed pull request #1410: HDDS-2076. Read fails because the block cannot be located in the container

2019-09-12 Thread GitBox
nandakumar131 closed pull request #1410: HDDS-2076. Read fails because the block cannot be located in the container URL: https://github.com/apache/hadoop/pull/1410 This is an automated message from the Apache Git Service.

[jira] [Updated] (HADOOP-16562) [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16562: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed

[GitHub] [hadoop] bgaborg opened a new pull request #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread GitBox
bgaborg opened a new pull request #1433: HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch URL: https://github.com/apache/hadoop/pull/1433 Change-Id: Ied43ef1522dfc6a1210d6fc58c38d8208824931b

[jira] [Created] (HADOOP-16567) S3A Secret access to fall back to XML if credential provider raises IOE.

2019-09-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16567: --- Summary: S3A Secret access to fall back to XML if credential provider raises IOE. Key: HADOOP-16567 URL: https://issues.apache.org/jira/browse/HADOOP-16567

[GitHub] [hadoop] hadoop-yetus commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530840432 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Created] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16566: --- Summary: S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch Key: HADOOP-16566 URL: https://issues.apache.org/jira/browse/HADOOP-16566

[jira] [Updated] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16566: Component/s: fs/s3 > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[jira] [Updated] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16566: Affects Version/s: 3.3.0 > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[GitHub] [hadoop] hadoop-yetus commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530821490 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-530813915 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530800476 @arp7 @bharatviswa504 Some acceptance tests are failing because the initialization of an `OzoneConfiguration`

[GitHub] [hadoop] hadoop-yetus commented on issue #1431: HDDS-1569 Support creating multiple pipelines with same datanode

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1431: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop/pull/1431#issuecomment-530799657 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] smengcl edited a comment on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
smengcl edited a comment on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530794042 As for the unit test failures for the latest commit, I tested that: ```

[GitHub] [hadoop] smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids

2019-09-12 Thread GitBox
smengcl commented on issue #1360: HDDS-2007. Make ozone fs shell command work with OM HA service ids URL: https://github.com/apache/hadoop/pull/1360#issuecomment-530794042 As for the unit test failures for the latest commit, I tested that:

[jira] [Created] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16565: --- Summary: Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain." Key: HADOOP-16565 URL: https://issues.apache.org/jira/browse/HADOOP-16565

[GitHub] [hadoop] hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432#issuecomment-530788673 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform

[jira] [Updated] (HADOOP-16557) [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16557: --- Assignee: Vinayakumar B Status: Patch Available (was: Open) > [pb-upgrade] Upgrade

[GitHub] [hadoop] vinayakumarb opened a new pull request #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread GitBox
vinayakumarb opened a new pull request #1432: HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 URL: https://github.com/apache/hadoop/pull/1432 This is an automated message from the Apache Git Service. To respond

[jira] [Updated] (HADOOP-16557) [pb-upgrade] Upgrade protobuf.version to 3.7.1

2019-09-12 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HADOOP-16557: --- Summary: [pb-upgrade] Upgrade protobuf.version to 3.7.1 (was: Upgrade protobuf.version to

[GitHub] [hadoop] hadoop-yetus commented on issue #1418: HDDS-2089: Add createPipeline CLI.

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1418: HDDS-2089: Add createPipeline CLI. URL: https://github.com/apache/hadoop/pull/1418#issuecomment-530781902 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| |

[jira] [Commented] (HADOOP-16562) [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928453#comment-16928453 ] Hudson commented on HADOOP-16562: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17284 (See

[GitHub] [hadoop] vinayakumarb merged pull request #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread GitBox
vinayakumarb merged pull request #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable URL: https://github.com/apache/hadoop/pull/1429 This is an automated message from the Apache Git

[GitHub] [hadoop] hadoop-yetus commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-530779279 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16423) S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log)

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928449#comment-16928449 ] Gabor Bota commented on HADOOP-16423: - +1 from [~ste...@apache.org] on PR #1208. Committing.

[jira] [Commented] (HADOOP-16423) S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log)

2019-09-12 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928447#comment-16928447 ] Hudson commented on HADOOP-16423: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17283 (See

[jira] [Created] (HADOOP-16564) S3Guarld fsck: Add docs to the first iteration (S3->ddbMS, -verify)

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16564: --- Summary: S3Guarld fsck: Add docs to the first iteration (S3->ddbMS, -verify) Key: HADOOP-16564 URL: https://issues.apache.org/jira/browse/HADOOP-16564 Project: Hadoop

[GitHub] [hadoop] bgaborg merged pull request #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)

2019-09-12 Thread GitBox
bgaborg merged pull request #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log) URL: https://github.com/apache/hadoop/pull/1208 This is an automated message from the Apache Git

[jira] [Created] (HADOOP-16563) S3Guard fsck: Detect if a directory if authoritative and highlight errors if detected in it

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16563: --- Summary: S3Guard fsck: Detect if a directory if authoritative and highlight errors if detected in it Key: HADOOP-16563 URL: https://issues.apache.org/jira/browse/HADOOP-16563

[GitHub] [hadoop] bgaborg commented on issue #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)

2019-09-12 Thread GitBox
bgaborg commented on issue #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log) URL: https://github.com/apache/hadoop/pull/1208#issuecomment-530776300 Created followup: https://issues.apache.org/jira/browse/HADOOP-16563 Committing.

[GitHub] [hadoop] brahmareddybattula commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread GitBox
brahmareddybattula commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable URL: https://github.com/apache/hadoop/pull/1429#issuecomment-530769758 +1 This is an automated

[GitHub] [hadoop] hadoop-yetus commented on issue #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#issuecomment-530767466 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] mukund-thakur edited a comment on issue #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-12 Thread GitBox
mukund-thakur edited a comment on issue #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#issuecomment-530764029 > yes. It's a change in behaviour, but probably a good one. A test will verify that things fail the way we

[GitHub] [hadoop] mukund-thakur commented on issue #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-12 Thread GitBox
mukund-thakur commented on issue #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#issuecomment-530764029 > yes. It's a change in behaviour, but probably a good one. A test will verify that things fail the way we expect

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp

2019-09-12 Thread GitBox
mukund-thakur commented on a change in pull request #1404: HDFS-13660 Copy file till the source file length during distcp URL: https://github.com/apache/hadoop/pull/1404#discussion_r323663047 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on issue #1428: HADOOP-16556. Fix some alerts raised by LGTM

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1428: HADOOP-16556. Fix some alerts raised by LGTM URL: https://github.com/apache/hadoop/pull/1428#issuecomment-530755828 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out.

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1430: HDDS-2117. ContainerStateMachine#writeStateMachineData times out. URL: https://github.com/apache/hadoop/pull/1430#issuecomment-530754957 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3 URL: https://github.com/apache/hadoop/pull/1160#issuecomment-527286087 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1160: HADOOP-16458 LocatedFileStatusFetcher.getFileStatuses failing intermittently with s3 URL: https://github.com/apache/hadoop/pull/1160#issuecomment-525951689 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] timmylicheng opened a new pull request #1431: HDDS-1569 Support creating multiple pipelines with same datanode

2019-09-12 Thread GitBox
timmylicheng opened a new pull request #1431: HDDS-1569 Support creating multiple pipelines with same datanode URL: https://github.com/apache/hadoop/pull/1431 #HDDS-1569 Use PipelinePlacementPolicy to support creating multiple pipelines with same datanode

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-528125833 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-12 Thread GitBox
hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-529876473 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran closed pull request #1407: HADOOP-16490. Avoid/handle cached 404s during S3A file creation

2019-09-12 Thread GitBox
steveloughran closed pull request #1407: HADOOP-16490. Avoid/handle cached 404s during S3A file creation URL: https://github.com/apache/hadoop/pull/1407 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] steveloughran commented on issue #1407: HADOOP-16490. Avoid/handle cached 404s during S3A file creation

2019-09-12 Thread GitBox
steveloughran commented on issue #1407: HADOOP-16490. Avoid/handle cached 404s during S3A file creation URL: https://github.com/apache/hadoop/pull/1407#issuecomment-530749745 this is now committed -Thanks for the reviews!

[GitHub] [hadoop] steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log)

2019-09-12 Thread GitBox
steveloughran commented on issue #1208: HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log) URL: https://github.com/apache/hadoop/pull/1208#issuecomment-530748126 # +1 As well as all the automated tests, did some manual command line operations.

[GitHub] [hadoop] hadoop-yetus commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable

2019-09-12 Thread GitBox
hadoop-yetus commented on issue #1429: HADOOP-16562. [pb-upgrade] Update docker image to have 3.7.1 protoc executable URL: https://github.com/apache/hadoop/pull/1429#issuecomment-530746447 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

  1   2   >