[GitHub] [hadoop] hadoop-yetus commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#issuecomment-532556334 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1467: HADOOP-16583. Minor fixes to S3 testing instructions

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1467: HADOOP-16583. Minor fixes to S3 testing instructions URL: https://github.com/apache/hadoop/pull/1467#issuecomment-532566040 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] sidseth commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
sidseth commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#discussion_r325572365 ## File path:

[jira] [Updated] (HADOOP-16583) Minor fixes to S3 testing instructions

2019-09-18 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HADOOP-16583: Status: Patch Available (was: Open) > Minor fixes to S3 testing instructions >

[GitHub] [hadoop] bgaborg merged pull request #1454: HADOOP-16565. Region must be provided when requesting session credentials or SdkClientException will be thrown

2019-09-18 Thread GitBox
bgaborg merged pull request #1454: HADOOP-16565. Region must be provided when requesting session credentials or SdkClientException will be thrown URL: https://github.com/apache/hadoop/pull/1454 This is an automated message

[jira] [Commented] (HADOOP-15226) Über-JIRA: S3Guard Phase III: Hadoop 3.2 features

2019-09-18 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932116#comment-16932116 ] Zhankun Tang commented on HADOOP-15226: --- [~ste...@apache.org], any plan to backport this to

[jira] [Updated] (HADOOP-16580) Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException

2019-09-18 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated HADOOP-16580: Attachment: HADOOP-16580.002.patch > Disable retry of FailoverOnNetworkExceptionRetry in case of

[GitHub] [hadoop] steveloughran commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
steveloughran commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#discussion_r325566547 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
steveloughran commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#discussion_r325566952 ## File path:

[GitHub] [hadoop] sidseth commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
sidseth commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#discussion_r325572582 ## File path:

[GitHub] [hadoop] sidseth commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
sidseth commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#discussion_r325572620 ## File path:

[GitHub] [hadoop] sidseth opened a new pull request #1467: HADOOP-16583. Minor fixes to S3 testing instructions

2019-09-18 Thread GitBox
sidseth opened a new pull request #1467: HADOOP-16583. Minor fixes to S3 testing instructions URL: https://github.com/apache/hadoop/pull/1467 Documentation update only. No tests erquired. ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need

[GitHub] [hadoop] sidseth commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
sidseth commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#issuecomment-532538523 Updated. Have left the timeouts on the test, since these tests don't need the default 10 minute timeout.

[jira] [Commented] (HADOOP-16580) Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException

2019-09-18 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932195#comment-16932195 ] Adam Antal commented on HADOOP-16580: - Patchset v2 takes care of one of the checkstyle issue - I'd

[jira] [Commented] (HADOOP-16565) Region must be provided when requesting session credentials or SdkClientException will be thrown

2019-09-18 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932218#comment-16932218 ] Hudson commented on HADOOP-16565: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17322 (See

[GitHub] [hadoop] steveloughran commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-18 Thread GitBox
steveloughran commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-532593024 tested: s3 ireland; didnt rerun the manual tests this time.

[GitHub] [hadoop] sidseth commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
sidseth commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#issuecomment-532602688 Had forgotten how difficult it is to get a patch into Hadoop. Are there any published coding standards or

[GitHub] [hadoop] adoroszlai commented on issue #1468: HDDS-2138. OM bucket operations do not add up

2019-09-18 Thread GitBox
adoroszlai commented on issue #1468: HDDS-2138. OM bucket operations do not add up URL: https://github.com/apache/hadoop/pull/1468#issuecomment-532604818 /label ozone This is an automated message from the Apache Git Service.

[GitHub] [hadoop] hadoop-yetus commented on issue #1455: HDDS-2137 : OzoneUtils to verify resourceName using HddsClientUtils

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1455: HDDS-2137 : OzoneUtils to verify resourceName using HddsClientUtils URL: https://github.com/apache/hadoop/pull/1455#issuecomment-532575247 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] adoroszlai commented on issue #1461: HDDS-2142. OM metrics mismatch (abort multipart request)

2019-09-18 Thread GitBox
adoroszlai commented on issue #1461: HDDS-2142. OM metrics mismatch (abort multipart request) URL: https://github.com/apache/hadoop/pull/1461#issuecomment-532578694 Thanks @arp7 for reviewing the fix and @bharatviswa504 for reviewing and merging it.

[jira] [Commented] (HADOOP-16565) Region must be provided when requesting session credentials or SdkClientException will be thrown

2019-09-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932216#comment-16932216 ] Gabor Bota commented on HADOOP-16565: - +1 from [~ste...@apache.org] on PR 1454. Committing. >

[GitHub] [hadoop] steveloughran commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
steveloughran commented on a change in pull request #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#discussion_r325567156 ## File path:

[GitHub] [hadoop] virajjasani commented on a change in pull request #1455: HDDS-2137 : OzoneUtils to verify resourceName using HddsClientUtils

2019-09-18 Thread GitBox
virajjasani commented on a change in pull request #1455: HDDS-2137 : OzoneUtils to verify resourceName using HddsClientUtils URL: https://github.com/apache/hadoop/pull/1455#discussion_r325517082 ## File path:

[GitHub] [hadoop] adoroszlai commented on issue #1460: HDDS-2136. OM block allocation metric not paired with its failures

2019-09-18 Thread GitBox
adoroszlai commented on issue #1460: HDDS-2136. OM block allocation metric not paired with its failures URL: https://github.com/apache/hadoop/pull/1460#issuecomment-532577970 Thanks @bharatviswa504 for reviewing and merging it.

[GitHub] [hadoop] adoroszlai opened a new pull request #1468: HDDS-2138. OM bucket operations do not add up

2019-09-18 Thread GitBox
adoroszlai opened a new pull request #1468: HDDS-2138. OM bucket operations do not add up URL: https://github.com/apache/hadoop/pull/1468 ## What changes were proposed in this pull request? Display S3 bucket operations in the "Bucket" chart, since `numBucketOps` (counter for total

[GitHub] [hadoop] hadoop-yetus commented on issue #1365: HDDS-1949. Missing or error-prone test cleanup

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1365: HDDS-1949. Missing or error-prone test cleanup URL: https://github.com/apache/hadoop/pull/1365#issuecomment-532627112 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #1467: HADOOP-16583. Minor fixes to S3 testing instructions

2019-09-18 Thread GitBox
steveloughran commented on issue #1467: HADOOP-16583. Minor fixes to S3 testing instructions URL: https://github.com/apache/hadoop/pull/1467#issuecomment-532611103 I am really confused now. Our POM does set those properties through specific profiles, s3guard and dynamo. But at the same

[jira] [Commented] (HADOOP-12155) NetUtils.wrapException to handle SSL exceptions

2019-09-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932269#comment-16932269 ] Hadoop QA commented on HADOOP-12155: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16582) LocalFileSystem's mkdirs() does not work as expected under viewfs.

2019-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932278#comment-16932278 ] Steve Loughran commented on HADOOP-16582: - LGTM +1 pending fixing the checkstyle warnings. >

[GitHub] [hadoop] hadoop-yetus commented on issue #1462: HDDS-2141. Missing total number of operations

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1462: HDDS-2141. Missing total number of operations URL: https://github.com/apache/hadoop/pull/1462#issuecomment-532625264 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-18 Thread GitBox
steveloughran commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-532618252 will do This is an automated message from the Apache

[GitHub] [hadoop] hadoop-yetus commented on issue #1468: HDDS-2138. OM bucket operations do not add up

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1468: HDDS-2138. OM bucket operations do not add up URL: https://github.com/apache/hadoop/pull/1468#issuecomment-532624988 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-18 Thread GitBox
steveloughran commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-532659681 added tests; tested s3 ireland This is an automated

[jira] [Assigned] (HADOOP-12155) NetUtils.wrapException to handle SSL exceptions

2019-09-18 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned HADOOP-12155: - Assignee: (was: Bibin A Chundatt) > NetUtils.wrapException to handle SSL

[jira] [Commented] (HADOOP-15226) Über-JIRA: S3Guard Phase III: Hadoop 3.2 features

2019-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932267#comment-16932267 ] Steve Loughran commented on HADOOP-15226: - Not really, no. I did a backport the critical

[GitHub] [hadoop] elek commented on issue #1465: HDDS-2143. Rename classes under package org.apache.hadoop.utils.

2019-09-18 Thread GitBox
elek commented on issue #1465: HDDS-2143. Rename classes under package org.apache.hadoop.utils. URL: https://github.com/apache/hadoop/pull/1465#issuecomment-532626462 /label ozone This is an automated message from the Apache

[GitHub] [hadoop] elek closed pull request #1341: HDDS-2022. Add additional freon tests

2019-09-18 Thread GitBox
elek closed pull request #1341: HDDS-2022. Add additional freon tests URL: https://github.com/apache/hadoop/pull/1341 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] elek closed pull request #1451: HDDS-2134. OM Metrics graphs include empty request type

2019-09-18 Thread GitBox
elek closed pull request #1451: HDDS-2134. OM Metrics graphs include empty request type URL: https://github.com/apache/hadoop/pull/1451 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] steveloughran commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
steveloughran commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#issuecomment-532618818 > Had forgotten how difficult it is to get a patch into Hadoop. Are there any published coding standards or

[jira] [Commented] (HADOOP-16580) Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException

2019-09-18 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932280#comment-16932280 ] Gergely Pollak commented on HADOOP-16580: - Hi [~adam.antal] thank you for the patch! The

[jira] [Commented] (HADOOP-16580) Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException

2019-09-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932284#comment-16932284 ] Hadoop QA commented on HADOOP-16580: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#issuecomment-532628681 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] elek commented on issue #1341: HDDS-2022. Add additional freon tests

2019-09-18 Thread GitBox
elek commented on issue #1341: HDDS-2022. Add additional freon tests URL: https://github.com/apache/hadoop/pull/1341#issuecomment-532649343 Merged to the trunk. Thanks @adoroszlai and @arp7 the reviews. This is an automated

[GitHub] [hadoop] adoroszlai commented on issue #1451: HDDS-2134. OM Metrics graphs include empty request type

2019-09-18 Thread GitBox
adoroszlai commented on issue #1451: HDDS-2134. OM Metrics graphs include empty request type URL: https://github.com/apache/hadoop/pull/1451#issuecomment-532657058 Thanks @elek for reviewing and committing it. This is an

[GitHub] [hadoop] adoroszlai commented on issue #1462: HDDS-2141. Missing total number of operations

2019-09-18 Thread GitBox
adoroszlai commented on issue #1462: HDDS-2141. Missing total number of operations URL: https://github.com/apache/hadoop/pull/1462#issuecomment-532666465 /retest This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #568: HADOOP-15691 Add PathCapabilities to FS and FC to complement StreamCapabilities

2019-09-18 Thread GitBox
hadoop-yetus removed a comment on issue #568: HADOOP-15691 Add PathCapabilities to FS and FC to complement StreamCapabilities URL: https://github.com/apache/hadoop/pull/568#issuecomment-485056931 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[jira] [Updated] (HADOOP-16582) LocalFileSystem's mkdirs() does not work as expected under viewfs.

2019-09-18 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-16582: Attachment: HADOOP-16582.1.patch > LocalFileSystem's mkdirs() does not work as expected under

[GitHub] [hadoop] elek closed pull request #1465: HDDS-2143. Rename classes under package org.apache.hadoop.utils.

2019-09-18 Thread GitBox
elek closed pull request #1465: HDDS-2143. Rename classes under package org.apache.hadoop.utils. URL: https://github.com/apache/hadoop/pull/1465 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] elek closed pull request #1387: HDDS-2065. Implement OMNodeDetails#toString

2019-09-18 Thread GitBox
elek closed pull request #1387: HDDS-2065. Implement OMNodeDetails#toString URL: https://github.com/apache/hadoop/pull/1387 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] ChenSammi opened a new pull request #1469: HDDS-2034. Async RATIS pipeline creation and destroy through heartbea…

2019-09-18 Thread GitBox
ChenSammi opened a new pull request #1469: HDDS-2034. Async RATIS pipeline creation and destroy through heartbea… URL: https://github.com/apache/hadoop/pull/1469 …t commands. https://issues.apache.org/jira/browse/HDDS-2034?filter=-1

[GitHub] [hadoop] bharatviswa504 commented on issue #1387: HDDS-2065. Implement OMNodeDetails#toString

2019-09-18 Thread GitBox
bharatviswa504 commented on issue #1387: HDDS-2065. Implement OMNodeDetails#toString URL: https://github.com/apache/hadoop/pull/1387#issuecomment-532746543 Thank You @elek for sharing info. This is an automated message from

[jira] [Work stopped] (HADOOP-16520) race condition in DDB table init and waiting threads

2019-09-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16520 stopped by Gabor Bota. --- > race condition in DDB table init and waiting threads >

[jira] [Assigned] (HADOOP-16484) S3A to warn or fail if S3Guard is disabled

2019-09-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16484: --- Assignee: Gabor Bota > S3A to warn or fail if S3Guard is disabled >

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-18 Thread GitBox
hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-532391837 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Created] (HADOOP-16585) [Tool:NNloadGeneratorMR] Multiple threads are using same id for creating file LoadGenerator#write

2019-09-18 Thread Ranith Sardar (Jira)
Ranith Sardar created HADOOP-16585: -- Summary: [Tool:NNloadGeneratorMR] Multiple threads are using same id for creating file LoadGenerator#write Key: HADOOP-16585 URL:

[jira] [Commented] (HADOOP-16580) Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException

2019-09-18 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932522#comment-16932522 ] Adam Antal commented on HADOOP-16580: - Thanks for the review [~shuzirra], let me give you a bit

[GitHub] [hadoop] elek closed pull request #1455: HDDS-2137 : OzoneUtils to verify resourceName using HddsClientUtils

2019-09-18 Thread GitBox
elek closed pull request #1455: HDDS-2137 : OzoneUtils to verify resourceName using HddsClientUtils URL: https://github.com/apache/hadoop/pull/1455 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-18 Thread GitBox
hadoop-yetus removed a comment on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-531284055 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16582) LocalFileSystem's mkdirs() does not work as expected under viewfs.

2019-09-18 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932514#comment-16932514 ] Kihwal Lee commented on HADOOP-16582: - Also fixed the existing mkdirs() method, which had the same

[GitHub] [hadoop] adoroszlai commented on issue #1468: HDDS-2138. OM bucket operations do not add up

2019-09-18 Thread GitBox
adoroszlai commented on issue #1468: HDDS-2138. OM bucket operations do not add up URL: https://github.com/apache/hadoop/pull/1468#issuecomment-532717453 Thanks @elek for reviewing and committing it. This is an automated

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #568: HADOOP-15691 Add PathCapabilities to FS and FC to complement StreamCapabilities

2019-09-18 Thread GitBox
hadoop-yetus removed a comment on issue #568: HADOOP-15691 Add PathCapabilities to FS and FC to complement StreamCapabilities URL: https://github.com/apache/hadoop/pull/568#issuecomment-486043659 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] steveloughran commented on issue #568: HADOOP-15691 Add PathCapabilities to FS and FC to complement StreamCapabilities

2019-09-18 Thread GitBox
steveloughran commented on issue #568: HADOOP-15691 Add PathCapabilities to FS and FC to complement StreamCapabilities URL: https://github.com/apache/hadoop/pull/568#issuecomment-532696623 all checksums are legit, will fix ```

[jira] [Updated] (HADOOP-16585) [Tool:NNloadGeneratorMR] Multiple threads are using same id for creating file LoadGenerator#write

2019-09-18 Thread Ranith Sardar (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranith Sardar updated HADOOP-16585: --- Description: {code:java} // id would be same for multiple file, so it may occur file not

[GitHub] [hadoop] hadoop-yetus commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402#issuecomment-532681274 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] elek closed pull request #1468: HDDS-2138. OM bucket operations do not add up

2019-09-18 Thread GitBox
elek closed pull request #1468: HDDS-2138. OM bucket operations do not add up URL: https://github.com/apache/hadoop/pull/1468 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Commented] (HADOOP-16581) ValueQueue does not trigger an async refill when number of values falls below watermark

2019-09-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932659#comment-16932659 ] Erik Krogen commented on HADOOP-16581: -- The change LGTM, ping [~xiaochen] who I see has some

[GitHub] [hadoop] adoroszlai commented on issue #1470: HDDS-2147. Include dumpstream in test report

2019-09-18 Thread GitBox
adoroszlai commented on issue #1470: HDDS-2147. Include dumpstream in test report URL: https://github.com/apache/hadoop/pull/1470#issuecomment-532772320 /label ozone This is an automated message from the Apache Git Service.

[GitHub] [hadoop] adoroszlai opened a new pull request #1470: HDDS-2147. Include dumpstream in test report

2019-09-18 Thread GitBox
adoroszlai opened a new pull request #1470: HDDS-2147. Include dumpstream in test report URL: https://github.com/apache/hadoop/pull/1470 ## What changes were proposed in this pull request? Copy `*.dumpstream` files to the unit test report dir. It may help finding out the cause of

[GitHub] [hadoop] steveloughran commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit.

2019-09-18 Thread GitBox
steveloughran commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit. URL: https://github.com/apache/hadoop/pull/1442#issuecomment-532793888 Note that the thread tests go beyond just asking the committers if they have a thread pool; they verify that there

[GitHub] [hadoop] xiaoyuyao commented on issue #1369: HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao.

2019-09-18 Thread GitBox
xiaoyuyao commented on issue #1369: HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/1369#issuecomment-532768160 /retest This is an automated message from the

[GitHub] [hadoop] bshashikant merged pull request #1420: HDDS-2032. Ozone client should retry writes in case of any ratis/stateMachine exceptions.

2019-09-18 Thread GitBox
bshashikant merged pull request #1420: HDDS-2032. Ozone client should retry writes in case of any ratis/stateMachine exceptions. URL: https://github.com/apache/hadoop/pull/1420 This is an automated message from the Apache

[GitHub] [hadoop] xiaoyuyao commented on issue #1466: HDDS-2144. MR job failing on secure Ozone cluster.

2019-09-18 Thread GitBox
xiaoyuyao commented on issue #1466: HDDS-2144. MR job failing on secure Ozone cluster. URL: https://github.com/apache/hadoop/pull/1466#issuecomment-532767551 LGTM, +1. This is an automated message from the Apache Git

[GitHub] [hadoop] bgaborg merged pull request #1402: HADOOP-16547. make sure that s3guard prune sets up the FS

2019-09-18 Thread GitBox
bgaborg merged pull request #1402: HADOOP-16547. make sure that s3guard prune sets up the FS URL: https://github.com/apache/hadoop/pull/1402 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit.

2019-09-18 Thread GitBox
hadoop-yetus removed a comment on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit. URL: https://github.com/apache/hadoop/pull/1442#issuecomment-531357838 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit.

2019-09-18 Thread GitBox
steveloughran commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit. URL: https://github.com/apache/hadoop/pull/1442#issuecomment-532790384 Tested, s3a ireland. FWIW, I'm planning to backport the thread cleanup and extra asserts to branches -3.1 and

[jira] [Created] (HADOOP-16586) ITestS3GuardFsck fails when nun using a local metastore

2019-09-18 Thread Siddharth Seth (Jira)
Siddharth Seth created HADOOP-16586: --- Summary: ITestS3GuardFsck fails when nun using a local metastore Key: HADOOP-16586 URL: https://issues.apache.org/jira/browse/HADOOP-16586 Project: Hadoop

[GitHub] [hadoop] elek commented on a change in pull request #1452: HDDS-2121. Create a shaded ozone filesystem (client) jar

2019-09-18 Thread GitBox
elek commented on a change in pull request #1452: HDDS-2121. Create a shaded ozone filesystem (client) jar URL: https://github.com/apache/hadoop/pull/1452#discussion_r325769031 ## File path: hadoop-ozone/ozonefs-lib-current/pom.xml ## @@ -83,6 +63,78 @@ true

[GitHub] [hadoop] xkrogen commented on a change in pull request #1463: HADOOP-16581. Revise ValueQueue to correctly replenish queues that go…

2019-09-18 Thread GitBox
xkrogen commented on a change in pull request #1463: HADOOP-16581. Revise ValueQueue to correctly replenish queues that go… URL: https://github.com/apache/hadoop/pull/1463#discussion_r325778045 ## File path:

[GitHub] [hadoop] xkrogen commented on a change in pull request #1463: HADOOP-16581. Revise ValueQueue to correctly replenish queues that go…

2019-09-18 Thread GitBox
xkrogen commented on a change in pull request #1463: HADOOP-16581. Revise ValueQueue to correctly replenish queues that go… URL: https://github.com/apache/hadoop/pull/1463#discussion_r325778180 ## File path:

[GitHub] [hadoop] xkrogen commented on a change in pull request #1463: HADOOP-16581. Revise ValueQueue to correctly replenish queues that go…

2019-09-18 Thread GitBox
xkrogen commented on a change in pull request #1463: HADOOP-16581. Revise ValueQueue to correctly replenish queues that go… URL: https://github.com/apache/hadoop/pull/1463#discussion_r325779945 ## File path:

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932692#comment-16932692 ] Gabor Bota commented on HADOOP-16547: - +1 on PR 1402. Committed. > s3guard prune command doesn't

[jira] [Resolved] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16547. - Resolution: Fixed > s3guard prune command doesn't get AWS auth chain from FS >

[GitHub] [hadoop] dineshchitlangia commented on issue #1471: HDDS-2148. Remove redundant code in CreateBucketHandler.java

2019-09-18 Thread GitBox
dineshchitlangia commented on issue #1471: HDDS-2148. Remove redundant code in CreateBucketHandler.java URL: https://github.com/apache/hadoop/pull/1471#issuecomment-532863533 failures unrelated to patch This is an automated

[GitHub] [hadoop] arp7 commented on issue #1448: HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet

2019-09-18 Thread GitBox
arp7 commented on issue #1448: HDDS-2110. Arbitrary file can be downloaded with the help of ProfilerServlet URL: https://github.com/apache/hadoop/pull/1448#issuecomment-532864393 Can this be committed? This is an automated

[GitHub] [hadoop] hadoop-yetus commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1332: HADOOP-16445. Allow separate custom signing algorithms for S3 and DDB URL: https://github.com/apache/hadoop/pull/1332#issuecomment-532875805 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1369: HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao.

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1369: HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/1369#issuecomment-532860471 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1471: HDDS-2148. Remove redundant code in CreateBucketHandler.java

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1471: HDDS-2148. Remove redundant code in CreateBucketHandler.java URL: https://github.com/apache/hadoop/pull/1471#issuecomment-532873227 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] RogPodge commented on a change in pull request #1399: HADOOP-16543: Cached DNS name resolution error

2019-09-18 Thread GitBox
RogPodge commented on a change in pull request #1399: HADOOP-16543: Cached DNS name resolution error URL: https://github.com/apache/hadoop/pull/1399#discussion_r325903846 ## File path:

[GitHub] [hadoop] hanishakoneru opened a new pull request #1472: HDDS-2150. Update dependency versions to avoid security vulnerabilities.

2019-09-18 Thread GitBox
hanishakoneru opened a new pull request #1472: HDDS-2150. Update dependency versions to avoid security vulnerabilities. URL: https://github.com/apache/hadoop/pull/1472 The following dependency versions have known security vulnerabilities. We should update them to recent/ later versions.

[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when nun using a local metastore

2019-09-18 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HADOOP-16586: Description: Most of these tests fail if running against a local metastore with a

[GitHub] [hadoop] dineshchitlangia opened a new pull request #1471: HDDS-2148. Remove redundant code in CreateBucketHandler.java

2019-09-18 Thread GitBox
dineshchitlangia opened a new pull request #1471: HDDS-2148. Remove redundant code in CreateBucketHandler.java URL: https://github.com/apache/hadoop/pull/1471 Removed redundant code, so no tests modified/added. This is

[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when nun using a local metastore

2019-09-18 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HADOOP-16586: Description: Most of these tests fail if running against a local metastore with a

[jira] [Commented] (HADOOP-16582) LocalFileSystem's mkdirs() does not work as expected under viewfs.

2019-09-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932734#comment-16932734 ] Hadoop QA commented on HADOOP-16582: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] sidseth commented on issue #1467: HADOOP-16583. Minor fixes to S3 testing instructions

2019-09-18 Thread GitBox
sidseth commented on issue #1467: HADOOP-16583. Minor fixes to S3 testing instructions URL: https://github.com/apache/hadoop/pull/1467#issuecomment-532811794 Interesting. Now I'm confused. That command ran the tests, and skipped them when dynamo was skipped. Have been having a torrid

[jira] [Commented] (HADOOP-16570) S3A committers leak threads on job/task commit

2019-09-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932742#comment-16932742 ] Steve Loughran commented on HADOOP-16570: - Even when you set the # of threads to 0, so

[GitHub] [hadoop] bharatviswa504 commented on issue #1466: HDDS-2144. MR job failing on secure Ozone cluster.

2019-09-18 Thread GitBox
bharatviswa504 commented on issue #1466: HDDS-2144. MR job failing on secure Ozone cluster. URL: https://github.com/apache/hadoop/pull/1466#issuecomment-532852312 Thank You @xiaoyuyao for the review. I have committed this to the trunk.

[GitHub] [hadoop] hadoop-yetus commented on issue #1469: HDDS-2034. Async RATIS pipeline creation and destroy through heartbea…

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1469: HDDS-2034. Async RATIS pipeline creation and destroy through heartbea… URL: https://github.com/apache/hadoop/pull/1469#issuecomment-532857571 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit.

2019-09-18 Thread GitBox
hadoop-yetus commented on issue #1442: HADOOP-16570. S3A committers leak threads on job/task commit. URL: https://github.com/apache/hadoop/pull/1442#issuecomment-532857835 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when nun using a local metastore

2019-09-18 Thread Siddharth Seth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HADOOP-16586: Summary: ITestS3GuardFsck, others fails when nun using a local metastore (was:

[GitHub] [hadoop] dineshchitlangia commented on issue #1471: HDDS-2148. Remove redundant code in CreateBucketHandler.java

2019-09-18 Thread GitBox
dineshchitlangia commented on issue #1471: HDDS-2148. Remove redundant code in CreateBucketHandler.java URL: https://github.com/apache/hadoop/pull/1471#issuecomment-532811572 @xiaoyuyao Pls help to review/commit this. TIA.

  1   2   >