[jira] [Commented] (HADOOP-16314) Make sure all end point URL is covered by the same AuthenticationFilter

2019-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842844#comment-16842844 ] Hadoop QA commented on HADOOP-16314: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #654: HADOOP-15183 S3Guard store becomes inconsistent after partial failure of rename

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #654: HADOOP-15183 S3Guard store becomes inconsistent after partial failure of rename URL: https://github.com/apache/hadoop/pull/654#issuecomment-493639110 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |:

[jira] [Commented] (HADOOP-16320) Workaround bug with commons-configuration to be able to emit Ganglia metrics to multiple sink servers

2019-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842839#comment-16842839 ] Hadoop QA commented on HADOOP-16320: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #827: HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer.

2019-05-17 Thread GitBox
hadoop-yetus commented on a change in pull request #827: HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/827#discussion_r285322909 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/

[GitHub] [hadoop] hadoop-yetus commented on issue #827: HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer.

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #827: HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/827#issuecomment-493636338 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[jira] [Updated] (HADOOP-16320) Workaround bug with commons-configuration to be able to emit Ganglia metrics to multiple sink servers

2019-05-17 Thread Thomas Poepping (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated HADOOP-16320: - Attachment: HADOOP-16320.patch > Workaround bug with commons-configuration to be able t

[jira] [Commented] (HADOOP-16320) Workaround bug with commons-configuration to be able to emit Ganglia metrics to multiple sink servers

2019-05-17 Thread Thomas Poepping (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842821#comment-16842821 ] Thomas Poepping commented on HADOOP-16320: -- Bug in commons-configuration was f

[jira] [Updated] (HADOOP-16320) Workaround bug with commons-configuration to be able to emit Ganglia metrics to multiple sink servers

2019-05-17 Thread Thomas Poepping (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated HADOOP-16320: - Status: Patch Available (was: Open) > Workaround bug with commons-configuration to be

[jira] [Created] (HADOOP-16320) Workaround bug with commons-configuration to be able to emit Ganglia metrics to multiple sink servers

2019-05-17 Thread Thomas Poepping (JIRA)
Thomas Poepping created HADOOP-16320: Summary: Workaround bug with commons-configuration to be able to emit Ganglia metrics to multiple sink servers Key: HADOOP-16320 URL: https://issues.apache.org/jira/browse

[jira] [Assigned] (HADOOP-16314) Make sure all end point URL is covered by the same AuthenticationFilter

2019-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned HADOOP-16314: -- Assignee: Prabhu Joseph > Make sure all end point URL is covered by the same AuthenticationF

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #830: HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options.

2019-05-17 Thread GitBox
xiaoyuyao commented on a change in pull request #830: HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options. URL: https://github.com/apache/hadoop/pull/830#discussion_r285313507 ## File path: hadoop-ozone/tools/src/main/java/org/apache

[jira] [Commented] (HADOOP-16092) Move the source of hadoop/ozone containers to the same repository

2019-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842799#comment-16842799 ] Eric Yang commented on HADOOP-16092: {quote}The release process of older versions (

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #830: HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options.

2019-05-17 Thread GitBox
xiaoyuyao commented on a change in pull request #830: HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options. URL: https://github.com/apache/hadoop/pull/830#discussion_r285312730 ## File path: hadoop-ozone/tools/src/main/java/org/apache

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #810: HDDS-1512. Implement DoubleBuffer in OzoneManager.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #810: HDDS-1512. Implement DoubleBuffer in OzoneManager. URL: https://github.com/apache/hadoop/pull/810#discussion_r285311016 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDou

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #810: HDDS-1512. Implement DoubleBuffer in OzoneManager.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #810: HDDS-1512. Implement DoubleBuffer in OzoneManager. URL: https://github.com/apache/hadoop/pull/810#discussion_r285311016 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDou

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #810: HDDS-1512. Implement DoubleBuffer in OzoneManager.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #810: HDDS-1512. Implement DoubleBuffer in OzoneManager. URL: https://github.com/apache/hadoop/pull/810#discussion_r285310539 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDou

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #810: HDDS-1512. Implement DoubleBuffer in OzoneManager.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #810: HDDS-1512. Implement DoubleBuffer in OzoneManager. URL: https://github.com/apache/hadoop/pull/810#discussion_r285310539 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/ratis/OzoneManagerDou

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285305076 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -106,6 +142,40 @@

[GitHub] [hadoop] bharatviswa504 commented on issue #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
bharatviswa504 commented on issue #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#issuecomment-493617081 Thank You @arp7 for the review. I have addressed the review comments. This is an a

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285306662 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/PartialTableCache.java ## @@ -0,0

[jira] [Comment Edited] (HADOOP-16312) Remove dumb-init from hadoop-runner image

2019-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842649#comment-16842649 ] Eric Yang edited comment on HADOOP-16312 at 5/17/19 10:21 PM: ---

[GitHub] [hadoop] hadoop-yetus commented on issue #754: HDDS-1065. OM and DN should persist SCM certificate as the trust root. Contributed by Ajay Kumar.

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #754: HDDS-1065. OM and DN should persist SCM certificate as the trust root. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/754#issuecomment-493615837 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285305397 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/TableCache.java ## @@ -0,0 +1,63

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285305076 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -106,6 +142,40 @@

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285304435 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -69,8 +79,34 @@ p

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285304280 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -31,13 +37,16 @@

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #725: HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit A…

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #725: HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit A… URL: https://github.com/apache/hadoop/pull/725#discussion_r285303293 ## File path: phantomjsdriver.log ## @@ -0,0 +1,6 @@ +[INFO - 2019-05-13T

[jira] [Commented] (HADOOP-16312) Remove dumb-init from hadoop-runner image

2019-05-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842649#comment-16842649 ] Eric Yang commented on HADOOP-16312: {quote}Do you suggest to keep dumb-init and us

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285302472 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/TableCache.java ## @@ -0,0 +1,63 @@ +/* + *

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285301711 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -69,8 +79,34 @@ public boole

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285301960 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -106,6 +142,40 @@ public voi

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285302353 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/PartialTableCache.java ## @@ -0,0 +1,92 @@ +

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r285301379 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -31,13 +37,16 @@ */ publi

[GitHub] [hadoop] ben-roling edited a comment on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
ben-roling edited a comment on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493536331 > The failures in ITestS3AMiscOperations seem to be related to the fact tha

[jira] [Commented] (HADOOP-13656) fs -expunge to take a filesystem

2019-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842633#comment-16842633 ] Hadoop QA commented on HADOOP-13656: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Updated] (HADOOP-16314) Make sure all end point URL is covered by the same AuthenticationFilter

2019-05-17 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated HADOOP-16314: --- Status: Patch Available (was: Open) > Make sure all end point URL is covered by the same A

[jira] [Updated] (HADOOP-16314) Make sure all end point URL is covered by the same AuthenticationFilter

2019-05-17 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated HADOOP-16314: --- Attachment: HADOOP-16314-001.patch > Make sure all end point URL is covered by the same Aut

[jira] [Commented] (HADOOP-16319) ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted fail with default encryption enabled on bucket

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842596#comment-16842596 ] Steve Loughran commented on HADOOP-16319: - Looks like from the S3 client direct

[jira] [Updated] (HADOOP-16319) ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted fail with default encryption enabled on bucket

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16319: Issue Type: Sub-task (was: Improvement) Parent: HADOOP-15620 > ITestS3AMiscOpera

[jira] [Commented] (HADOOP-16203) ITestS3AContractGetFileStatusV1List may have consistency issues

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842573#comment-16842573 ] Steve Loughran commented on HADOOP-16203: - reported again. The list test calls

[GitHub] [hadoop] jnp commented on a change in pull request #826: HDDS-1517. AllocateBlock call fails with ContainerNotFoundException.

2019-05-17 Thread GitBox
jnp commented on a change in pull request #826: HDDS-1517. AllocateBlock call fails with ContainerNotFoundException. URL: https://github.com/apache/hadoop/pull/826#discussion_r285285507 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/Containe

[GitHub] [hadoop] jnp commented on a change in pull request #826: HDDS-1517. AllocateBlock call fails with ContainerNotFoundException.

2019-05-17 Thread GitBox
jnp commented on a change in pull request #826: HDDS-1517. AllocateBlock call fails with ContainerNotFoundException. URL: https://github.com/apache/hadoop/pull/826#discussion_r285284257 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/SCMConta

[GitHub] [hadoop] jnp commented on a change in pull request #826: HDDS-1517. AllocateBlock call fails with ContainerNotFoundException.

2019-05-17 Thread GitBox
jnp commented on a change in pull request #826: HDDS-1517. AllocateBlock call fails with ContainerNotFoundException. URL: https://github.com/apache/hadoop/pull/826#discussion_r285283814 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/Containe

[GitHub] [hadoop] hadoop-yetus commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493566358 :confetti_ball: **+1 overall** | Vote | Subsystem | R

[GitHub] [hadoop] hadoop-yetus commented on issue #798: HDDS-1499. OzoneManager Cache.

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#issuecomment-493563512 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | re

[jira] [Commented] (HADOOP-16312) Remove dumb-init from hadoop-runner image

2019-05-17 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842393#comment-16842393 ] Elek, Marton commented on HADOOP-16312: --- Thanks to explain it [~eyang] bq. The p

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #828: HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar.

2019-05-17 Thread GitBox
xiaoyuyao commented on a change in pull request #828: HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/828#discussion_r285247846 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OzoneAcl.

[jira] [Commented] (HADOOP-16092) Move the source of hadoop/ozone containers to the same repository

2019-05-17 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842385#comment-16842385 ] Elek, Marton commented on HADOOP-16092: --- bq. Elek, Marton does this address your

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #828: HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar.

2019-05-17 Thread GitBox
xiaoyuyao commented on a change in pull request #828: HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/828#discussion_r285247445 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OzoneAcl.

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #828: HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar.

2019-05-17 Thread GitBox
xiaoyuyao commented on a change in pull request #828: HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/828#discussion_r285245362 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneConst

[GitHub] [hadoop] hadoop-yetus commented on issue #826: HDDS-1517. AllocateBlock call fails with ContainerNotFoundException.

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #826: HDDS-1517. AllocateBlock call fails with ContainerNotFoundException. URL: https://github.com/apache/hadoop/pull/826#issuecomment-493557580 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[jira] [Commented] (HADOOP-13656) fs -expunge to take a filesystem

2019-05-17 Thread Shweta (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842369#comment-16842369 ] Shweta commented on HADOOP-13656: - Thank you [~ste...@apache.org] for your review. I

[jira] [Updated] (HADOOP-13656) fs -expunge to take a filesystem

2019-05-17 Thread Shweta (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shweta updated HADOOP-13656: Attachment: HADOOP-13656.006.patch > fs -expunge to take a filesystem >

[GitHub] [hadoop] ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493546070 > Now I'll run the suite one more time against a bucket with versioning enabled.

[GitHub] [hadoop] ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493536331 > The failures in ITestS3AMiscOperations seem to be related to the fact that I re

[jira] [Created] (HADOOP-16319) ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted fail with default encryption enabled on bucket

2019-05-17 Thread Ben Roling (JIRA)
Ben Roling created HADOOP-16319: --- Summary: ITestS3AMiscOperations.testEmptyFileChecksums and ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted fail with default encryption enabled on bucket Key: HADOOP-16319

[GitHub] [hadoop] ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493531516 I pushed a fast-forward to the latest commit from #824 into this PR. Also,

[GitHub] [hadoop] hadoop-yetus commented on issue #654: HADOOP-15183 S3Guard store becomes inconsistent after partial failure of rename

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #654: HADOOP-15183 S3Guard store becomes inconsistent after partial failure of rename URL: https://github.com/apache/hadoop/pull/654#issuecomment-493528331 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |:

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/829#discussion_r285193337 ## File path: hadoop-hdds/container-s

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.

2019-05-17 Thread GitBox
bharatviswa504 commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/829#discussion_r285193246 ## File path: hadoop-hdds/container-s

[jira] [Commented] (HADOOP-15563) Full S3Guard Support for on demand DDB tables

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842284#comment-16842284 ] Steve Loughran commented on HADOOP-15563: - * change ITestDynamoDBMetadataStore

[GitHub] [hadoop] bshashikant edited a comment on issue #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.

2019-05-17 Thread GitBox
bshashikant edited a comment on issue #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/829#issuecomment-493504166 Thanks @mukul1987 for working on this. i am +1 on this. The p

[GitHub] [hadoop] bshashikant commented on issue #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.

2019-05-17 Thread GitBox
bshashikant commented on issue #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/829#issuecomment-493504166 Thanks @mukul1987 for working on this. The patch looks good to me. P

[GitHub] [hadoop] hadoop-yetus commented on issue #824: HADOOP-16085: S3Guard versioning: get ITestS3ARemoteFileChanged to work consistently

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #824: HADOOP-16085: S3Guard versioning: get ITestS3ARemoteFileChanged to work consistently URL: https://github.com/apache/hadoop/pull/824#issuecomment-493496245 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #824: HADOOP-16085: S3Guard versioning: get ITestS3ARemoteFileChanged to work consistently

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #824: HADOOP-16085: S3Guard versioning: get ITestS3ARemoteFileChanged to work consistently URL: https://github.com/apache/hadoop/pull/824#issuecomment-493494210 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493491918 I've looked at all your changes and they look good to me. I'll pull them into thi

[GitHub] [hadoop] jiwq commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.

2019-05-17 Thread GitBox
jiwq commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/829#discussion_r285148899 ## File path: hadoop-hdds/container-service/src

[GitHub] [hadoop] jiwq commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.

2019-05-17 Thread GitBox
jiwq commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/829#discussion_r285152336 ## File path: hadoop-ozone/integration-test/src

[GitHub] [hadoop] jiwq commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.

2019-05-17 Thread GitBox
jiwq commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/829#discussion_r285151145 ## File path: hadoop-hdds/server-scm/src/main/j

[GitHub] [hadoop] jiwq commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.

2019-05-17 Thread GitBox
jiwq commented on a change in pull request #829: HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/829#discussion_r285156634 ## File path: hadoop-hdds/container-service/src

[jira] [Commented] (HADOOP-16248) MutableQuantiles leak memory under heavy load

2019-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842225#comment-16842225 ] Hudson commented on HADOOP-16248: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Updated] (HADOOP-16248) MutableQuantiles leak memory under heavy load

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16248: Component/s: metrics > MutableQuantiles leak memory under heavy load > --

[jira] [Assigned] (HADOOP-16248) MutableQuantiles leak memory under heavy load

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16248: --- Assignee: Alexis Daboville > MutableQuantiles leak memory under heavy load > -

[jira] [Updated] (HADOOP-16248) MutableQuantiles leak memory under heavy load

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16248: Resolution: Fixed Fix Version/s: 3.1.3 2.9.3

[jira] [Updated] (HADOOP-16248) MutableQuantiles leak memory under heavy load

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16248: Summary: MutableQuantiles leak memory under heavy load (was: Fix MutableQuantiles memory

[GitHub] [hadoop] steveloughran commented on issue #824: HADOOP-16085: S3Guard versioning: get ITestS3ARemoteFileChanged to work consistently

2019-05-17 Thread GitBox
steveloughran commented on issue #824: HADOOP-16085: S3Guard versioning: get ITestS3ARemoteFileChanged to work consistently URL: https://github.com/apache/hadoop/pull/824#issuecomment-493454196 tested: s3 london, versioned store, s3guard auth mode. Also tested versioning tests agains

[jira] [Commented] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-17 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842145#comment-16842145 ] Gabor Bota commented on HADOOP-16279: - last_updated field is not updated in the cur

[jira] [Commented] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842139#comment-16842139 ] Steve Loughran commented on HADOOP-16279: - addition: looking the raw DDB table

[jira] [Updated] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16279: Attachment: Screenshot 2019-05-17 at 13.21.26.png > S3Guard: Implement time-based (TTL) e

[GitHub] [hadoop] hadoop-yetus commented on issue #831: HDDS-1487. Bootstrap React framework for Recon UI

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #831: HDDS-1487. Bootstrap React framework for Recon UI URL: https://github.com/apache/hadoop/pull/831#issuecomment-493416133 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:-

[GitHub] [hadoop] steveloughran commented on issue #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request

2019-05-17 Thread GitBox
steveloughran commented on issue #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request URL: https://github.com/apache/hadoop/pull/606#issuecomment-493415705 closing as a WONTFIX; HADOOP-16085 shows up some issues in the AWS SDK which make this a

[GitHub] [hadoop] steveloughran closed pull request #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request

2019-05-17 Thread GitBox
steveloughran closed pull request #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request URL: https://github.com/apache/hadoop/pull/606 This is an automated message from the Apache

[jira] [Updated] (HADOOP-16190) S3A copyFile operation to include source versionID or etag in the copy request

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16190: Resolution: Duplicate Status: Resolved (was: Patch Available) I was about to tag

[jira] [Updated] (HADOOP-16190) S3A copyFile operation to include source versionID or etag in the copy request

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16190: Affects Version/s: (was: 3.2.0) 2.9.2 3.

[jira] [Work started] (HADOOP-15604) Bulk commits of S3A MPUs place needless excessive load on S3 & S3Guard

2019-05-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-15604 started by Steve Loughran. --- > Bulk commits of S3A MPUs place needless excessive load on S3 & S3Guard

[GitHub] [hadoop] steveloughran commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
steveloughran commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493411963 Also: * Adding something to the test docs about versioned stores. * s3gu

[GitHub] [hadoop] steveloughran commented on a change in pull request #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
steveloughran commented on a change in pull request #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#discussion_r285060816 ## File path: hadoop-tools/hadoop-aws/src/main/java

[GitHub] [hadoop] steveloughran commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

2019-05-17 Thread GitBox
steveloughran commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-493397821 OK, I'll do the following * tweak the tests as proposed to switch auth optio

[GitHub] [hadoop] vivekratnavel opened a new pull request #831: HDDS-1487. Bootstrap React framework for Recon UI

2019-05-17 Thread GitBox
vivekratnavel opened a new pull request #831: HDDS-1487. Bootstrap React framework for Recon UI URL: https://github.com/apache/hadoop/pull/831 Bootstrap React with Typescript, Ant, LESS and other necessary libraries for Recon UI. This PR also adds necessary changes to recon pom.xml

[GitHub] [hadoop] hadoop-yetus commented on issue #830: HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options.

2019-05-17 Thread GitBox
hadoop-yetus commented on issue #830: HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options. URL: https://github.com/apache/hadoop/pull/830#issuecomment-493370392 :broken_heart: **-1 overall** | Vote | Subsystem | Run

[GitHub] [hadoop] iamcaoxudong opened a new pull request #830: HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options.

2019-05-17 Thread GitBox
iamcaoxudong opened a new pull request #830: HDDS-1530. Freon support big files larger than 2GB and add --bufferSize and --validateWrites options. URL: https://github.com/apache/hadoop/pull/830 https://issues.apache.org/jira/browse/HDDS-1530