[jira] [Commented] (HADOOP-15958) Revisiting LICENSE and NOTICE files

2019-06-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867206#comment-16867206 ] Akira Ajisaka commented on HADOOP-15958: The 006 patch is ready for review. Upd

[jira] [Updated] (HADOOP-15958) Revisiting LICENSE and NOTICE files

2019-06-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15958: --- Attachment: HADOOP-15958.006.patch > Revisiting LICENSE and NOTICE files >

[jira] [Assigned] (HADOOP-16381) The JSON License is included in binary tarball via azure-documentdb:1.16.2

2019-06-18 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks reassigned HADOOP-16381: -- Assignee: Sushil Ks > The JSON License is included in binary tarball via azure-documentdb:1.

[jira] [Comment Edited] (HADOOP-15958) Revisiting LICENSE and NOTICE files

2019-06-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867198#comment-16867198 ] Akira Ajisaka edited comment on HADOOP-15958 at 6/19/19 4:12 AM:

[jira] [Commented] (HADOOP-15958) Revisiting LICENSE and NOTICE files

2019-06-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867198#comment-16867198 ] Akira Ajisaka commented on HADOOP-15958: Thanks [~jojochuang] for the comment.

[jira] [Updated] (HADOOP-15958) Revisiting LICENSE and NOTICE files

2019-06-18 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15958: --- Attachment: HADOOP-15958.005.patch > Revisiting LICENSE and NOTICE files >

[jira] [Created] (HADOOP-16381) The JSON License is included in binary tarball via azure-documentdb:1.16.2

2019-06-18 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HADOOP-16381: -- Summary: The JSON License is included in binary tarball via azure-documentdb:1.16.2 Key: HADOOP-16381 URL: https://issues.apache.org/jira/browse/HADOOP-16381 Proj

[jira] [Commented] (HADOOP-15976) NameNode Performance degradation When Single LdapServer become a bottleneck in Ldap-based mapping module

2019-06-18 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867191#comment-16867191 ] Shen Yinjie commented on HADOOP-15976: -- [~jojochuang] ,[~fengyongshe] can not spar

[GitHub] [hadoop] hadoop-yetus commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers…

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers… URL: https://github.com/apache/hadoop/pull/987#issuecomment-503360653 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] hadoop-yetus commented on issue #930: HDDS-1651. Create a http.policy config for Ozone

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #930: HDDS-1651. Create a http.policy config for Ozone URL: https://github.com/apache/hadoop/pull/930#issuecomment-503359575 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:--

[GitHub] [hadoop] hadoop-yetus commented on issue #951: HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #951: HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename URL: https://github.com/apache/hadoop/pull/951#issuecomment-503358538 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |

[GitHub] [hadoop] DadanielZ edited a comment on issue #988: HADOOP-16376. ABFS: Override access() to no-op.

2019-06-18 Thread GitBox
DadanielZ edited a comment on issue #988: HADOOP-16376. ABFS: Override access() to no-op. URL: https://github.com/apache/hadoop/pull/988#issuecomment-503355935 @steveloughran cherry-picked from trunk All tests passed for my west us account: non-xns account Tests run: 35, Failur

[GitHub] [hadoop] DadanielZ commented on issue #988: HADOOP-16376. ABFS: Override access() to no-op.

2019-06-18 Thread GitBox
DadanielZ commented on issue #988: HADOOP-16376. ABFS: Override access() to no-op. URL: https://github.com/apache/hadoop/pull/988#issuecomment-503355935 @steveloughran cherry picked from trunk All tests passed for my west us account: non-xns account Tests run: 35, Failures: 0,

[GitHub] [hadoop] DadanielZ closed pull request #971: HADOOP-16376: Override access() to no-up

2019-06-18 Thread GitBox
DadanielZ closed pull request #971: HADOOP-16376: Override access() to no-up URL: https://github.com/apache/hadoop/pull/971 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] DadanielZ commented on issue #971: HADOOP-16376: Override access() to no-up

2019-06-18 Thread GitBox
DadanielZ commented on issue #971: HADOOP-16376: Override access() to no-up URL: https://github.com/apache/hadoop/pull/971#issuecomment-503349907 Thanks for the review, closing this pr as it has been committed into trunk. This

[GitHub] [hadoop] DadanielZ opened a new pull request #988: HADOOP-16376. ABFS: Override access() to no-op.

2019-06-18 Thread GitBox
DadanielZ opened a new pull request #988: HADOOP-16376. ABFS: Override access() to no-op. URL: https://github.com/apache/hadoop/pull/988 Contributed by Da Zhou. Change-Id: Ia0024bba32250189a87eb6247808b2473c331ed0 This

[GitHub] [hadoop] hadoop-yetus commented on issue #965: HDDS-1684. OM should create Ratis related dirs only if ratis is enabled

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #965: HDDS-1684. OM should create Ratis related dirs only if ratis is enabled URL: https://github.com/apache/hadoop/pull/965#issuecomment-503344804 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] hanishakoneru merged pull request #965: HDDS-1684. OM should create Ratis related dirs only if ratis is enabled

2019-06-18 Thread GitBox
hanishakoneru merged pull request #965: HDDS-1684. OM should create Ratis related dirs only if ratis is enabled URL: https://github.com/apache/hadoop/pull/965 This is an automated message from the Apache Git Service. To resp

[GitHub] [hadoop] hanishakoneru commented on issue #965: HDDS-1684. OM should create Ratis related dirs only if ratis is enabled

2019-06-18 Thread GitBox
hanishakoneru commented on issue #965: HDDS-1684. OM should create Ratis related dirs only if ratis is enabled URL: https://github.com/apache/hadoop/pull/965#issuecomment-503344562 Test failures are unrelated and fixed 1 checkstyle issue (unused import). Will merge the PR. Thanks for the r

[GitHub] [hadoop] vivekratnavel commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers…

2019-06-18 Thread GitBox
vivekratnavel commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers… URL: https://github.com/apache/hadoop/pull/987#issuecomment-503339287 @swagle @avijayanhwx @bharatviswa504 Please review this when you find time -

[GitHub] [hadoop] vivekratnavel commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers…

2019-06-18 Thread GitBox
vivekratnavel commented on issue #987: HDDS-1685. Recon: Add support for 'start' query param to containers… URL: https://github.com/apache/hadoop/pull/987#issuecomment-503339320 /label ozone This is an automated message from

[GitHub] [hadoop] vivekratnavel opened a new pull request #987: HDDS-1685. Recon: Add support for 'start' query param to containers…

2019-06-18 Thread GitBox
vivekratnavel opened a new pull request #987: HDDS-1685. Recon: Add support for 'start' query param to containers… URL: https://github.com/apache/hadoop/pull/987 …and containers/{id} endpoints This PR adds support to "start" query param to seek to the given key in RocksDB for contai

[jira] [Commented] (HADOOP-16377) Moving logging APIs over to slf4j

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867095#comment-16867095 ] Steve Loughran commented on HADOOP-16377: - org.slfj imports shouldn't be added

[jira] [Commented] (HADOOP-16350) Ability to tell Hadoop not to request KMS Information from Remote NN

2019-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867085#comment-16867085 ] Hadoop QA commented on HADOOP-16350: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #984: HDDS-1674 Make ScmBlockLocationProtocol message type based

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #984: HDDS-1674 Make ScmBlockLocationProtocol message type based URL: https://github.com/apache/hadoop/pull/984#issuecomment-503330311 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[jira] [Updated] (HADOOP-16350) Ability to tell Hadoop not to request KMS Information from Remote NN

2019-06-18 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-16350: Attachment: HADOOP-16350.01.patch > Ability to tell Hadoop not to request KMS Information from Re

[jira] [Updated] (HADOOP-16350) Ability to tell Hadoop not to request KMS Information from Remote NN

2019-06-18 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-16350: Status: Patch Available (was: Open) > Ability to tell Hadoop not to request KMS Information from

[jira] [Updated] (HADOOP-16350) Ability to tell Hadoop not to request KMS Information from Remote NN

2019-06-18 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-16350: Attachment: HADOOP-16350.00.patch > Ability to tell Hadoop not to request KMS Information from Re

[GitHub] [hadoop] anuengineer merged pull request #982: HDDS-1702. Optimize Ozone Recon build time

2019-06-18 Thread GitBox
anuengineer merged pull request #982: HDDS-1702. Optimize Ozone Recon build time URL: https://github.com/apache/hadoop/pull/982 This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [hadoop] hadoop-yetus commented on issue #986: [HDDS-1690] ContainerController should provide a way to retrieve cont…

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #986: [HDDS-1690] ContainerController should provide a way to retrieve cont… URL: https://github.com/apache/hadoop/pull/986#issuecomment-503309105 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|---

[GitHub] [hadoop] sahilTakiar commented on issue #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
sahilTakiar commented on issue #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#issuecomment-503303248 @steveloughran addressed your comments. Hadoop QA looks happy as well. Re-ran the S3A te

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #986: [HDDS-1690] ContainerController should provide a way to retrieve cont…

2019-06-18 Thread GitBox
bharatviswa504 commented on a change in pull request #986: [HDDS-1690] ContainerController should provide a way to retrieve cont… URL: https://github.com/apache/hadoop/pull/986#discussion_r295013673 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/c

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #986: [HDDS-1690] ContainerController should provide a way to retrieve cont…

2019-06-18 Thread GitBox
bharatviswa504 commented on a change in pull request #986: [HDDS-1690] ContainerController should provide a way to retrieve cont… URL: https://github.com/apache/hadoop/pull/986#discussion_r295012141 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/c

[GitHub] [hadoop] hadoop-yetus commented on issue #951: HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #951: HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename URL: https://github.com/apache/hadoop/pull/951#issuecomment-503284327 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |

[jira] [Issue Comment Deleted] (HADOOP-16363) S3Guard DDB store prune() doesn't translate AWS exceptions to IOEs

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16363: Comment: was deleted (was: Fixed in HADOOP-15183 with a new exception {{TableDeleteTimeou

[jira] [Commented] (HADOOP-16364) S3Guard table destroy to map IllegalArgumentExceptions to IOEs

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866982#comment-16866982 ] Steve Loughran commented on HADOOP-16364: - Fixed in HADOOP-15183 with a new exc

[GitHub] [hadoop] hgadre opened a new pull request #986: [HDDS-1690] ContainerController should provide a way to retrieve cont…

2019-06-18 Thread GitBox
hgadre opened a new pull request #986: [HDDS-1690] ContainerController should provide a way to retrieve cont… URL: https://github.com/apache/hadoop/pull/986 …ainers per volume Added an API in ContainerSet (and ContainerController) which exposes an iterator of containers for a spec

[GitHub] [hadoop] hadoop-yetus commented on issue #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/852#issuecomment-503267973 :broken_heart: **-1 overall**

[GitHub] [hadoop] bharatviswa504 edited a comment on issue #954: HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints

2019-06-18 Thread GitBox
bharatviswa504 edited a comment on issue #954: HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints URL: https://github.com/apache/hadoop/pull/954#issuecomment-503197062 Test failures look's not related to this patch. I will commit this to the trunk. Thank Y

[jira] [Commented] (HADOOP-16379) S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866932#comment-16866932 ] Hadoop QA commented on HADOOP-16379: | (/) *{color:green}+1 overall{color}* | \\ \\

[GitHub] [hadoop] hadoop-yetus commented on issue #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#issuecomment-503262336 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comme

[GitHub] [hadoop] bharatviswa504 commented on issue #980: Update RocksDB version to 6.0.1

2019-06-18 Thread GitBox
bharatviswa504 commented on issue #980: Update RocksDB version to 6.0.1 URL: https://github.com/apache/hadoop/pull/980#issuecomment-503250956 I found the Jira for this. Thank You @anuengineer for the review. I have committed this to the trunk. -

[GitHub] [hadoop] bharatviswa504 merged pull request #980: Update RocksDB version to 6.0.1

2019-06-18 Thread GitBox
bharatviswa504 merged pull request #980: Update RocksDB version to 6.0.1 URL: https://github.com/apache/hadoop/pull/980 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[jira] [Commented] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866895#comment-16866895 ] Steve Loughran commented on HADOOP-16340: - [~rlevas] -you can now have hadoop-c

[GitHub] [hadoop] hadoop-yetus commented on issue #984: HDDS-1674 Make ScmBlockLocationProtocol message type based

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #984: HDDS-1674 Make ScmBlockLocationProtocol message type based URL: https://github.com/apache/hadoop/pull/984#issuecomment-503230601 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[jira] [Commented] (HADOOP-16377) Moving logging APIs over to slf4j

2019-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866852#comment-16866852 ] Hadoop QA commented on HADOOP-16377: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] supratimdeka commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Suprati

2019-06-18 Thread GitBox
supratimdeka commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/852#discussion_r294930618 ## File path: hadoop-hd

[GitHub] [hadoop] supratimdeka commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Suprati

2019-06-18 Thread GitBox
supratimdeka commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/852#discussion_r294930277 ## File path: hadoop-hd

[GitHub] [hadoop] supratimdeka commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Suprati

2019-06-18 Thread GitBox
supratimdeka commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/852#discussion_r294930181 ## File path: hadoop-hd

[GitHub] [hadoop] hadoop-yetus commented on issue #985: HADOOP-16380. ITestS3AContractRootDir failing on trunk

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #985: HADOOP-16380. ITestS3AContractRootDir failing on trunk URL: https://github.com/apache/hadoop/pull/985#issuecomment-503221021 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[GitHub] [hadoop] goiri commented on a change in pull request #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE…

2019-06-18 Thread GitBox
goiri commented on a change in pull request #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE… URL: https://github.com/apache/hadoop/pull/977#discussion_r294922980 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/h

[GitHub] [hadoop] bharatviswa504 edited a comment on issue #980: Update RocksDB version to 6.0.1

2019-06-18 Thread GitBox
bharatviswa504 edited a comment on issue #980: Update RocksDB version to 6.0.1 URL: https://github.com/apache/hadoop/pull/980#issuecomment-503197955 Test failures look unrelated to this patch. Thank You @avijayanhwx for the contribution. Is there a Jira associated with this, so that I ca

[GitHub] [hadoop] bharatviswa504 edited a comment on issue #980: Update RocksDB version to 6.0.1

2019-06-18 Thread GitBox
bharatviswa504 edited a comment on issue #980: Update RocksDB version to 6.0.1 URL: https://github.com/apache/hadoop/pull/980#issuecomment-503197955 Test failures look unrelated to this patch. I will commit this to the trunk. Thank You @avijayanhwx for the contribution. Is there a Jira

[GitHub] [hadoop] bharatviswa504 commented on issue #980: Update RocksDB version to 6.0.1

2019-06-18 Thread GitBox
bharatviswa504 commented on issue #980: Update RocksDB version to 6.0.1 URL: https://github.com/apache/hadoop/pull/980#issuecomment-503197955 Test failures look unrelated to this patch. I will commit this to the trunk. Thank You @avijayanhwx for the contribution. -

[GitHub] [hadoop] bharatviswa504 edited a comment on issue #954: HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints

2019-06-18 Thread GitBox
bharatviswa504 edited a comment on issue #954: HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints URL: https://github.com/apache/hadoop/pull/954#issuecomment-503197062 Test failures look related to this patch. I will commit this to the trunk. Thank You @vi

[GitHub] [hadoop] bharatviswa504 commented on issue #954: HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints

2019-06-18 Thread GitBox
bharatviswa504 commented on issue #954: HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints URL: https://github.com/apache/hadoop/pull/954#issuecomment-503197062 Test failures look related to this patch. I will commit this to the trunk. ---

[GitHub] [hadoop] bharatviswa504 merged pull request #954: HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints

2019-06-18 Thread GitBox
bharatviswa504 merged pull request #954: HDDS-1670. Add limit support to /api/containers and /api/containers/{id} endpoints URL: https://github.com/apache/hadoop/pull/954 This is an automated message from the Apache Git Serv

[GitHub] [hadoop] steveloughran commented on issue #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
steveloughran commented on issue #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#issuecomment-503175068 LGTM, some changes around the testing. Checkstyle has a complaint which needs to be addresse

[GitHub] [hadoop] steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#discussion_r294870610 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/had

[GitHub] [hadoop] steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#discussion_r294867813 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/had

[GitHub] [hadoop] steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#discussion_r294867813 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/had

[GitHub] [hadoop] steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#discussion_r294867505 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/had

[GitHub] [hadoop] steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#discussion_r294866544 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/had

[GitHub] [hadoop] steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#discussion_r294866058 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/had

[GitHub] [hadoop] steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats

2019-06-18 Thread GitBox
steveloughran commented on a change in pull request #983: HADOOP-16379: S3AInputStream#unbuffer should merge input stream stats into fs-wide stats URL: https://github.com/apache/hadoop/pull/983#discussion_r294865239 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/had

[jira] [Commented] (HADOOP-16378) RawLocalFileStatus throws exception if a file is created and deleted quickly

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1689#comment-1689 ] Steve Loughran commented on HADOOP-16378: - I'd prefer moving off shell entirely

[jira] [Updated] (HADOOP-16380) ITestS3AContractRootDir failing on trunk: tombstones mislead about directory empty status

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16380: Affects Version/s: 3.2.0 3.0.3 3.1.2 > ITes

[jira] [Commented] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866651#comment-16866651 ] Steve Loughran commented on HADOOP-14936: - adding HADOOP-16380, consistency-rel

[jira] [Updated] (HADOOP-16380) ITestS3AContractRootDir failing on trunk: tombstones mislead about directory empty status

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16380: Description: If S3AFileSystem does an S3 LIST restricted to a single object to see if a

[jira] [Commented] (HADOOP-16380) ITestS3AContractRootDir failing on trunk: tombstones mislead about directory empty status

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866642#comment-16866642 ] Steve Loughran commented on HADOOP-16380: - note: some of my rename optimisation

[GitHub] [hadoop] steveloughran edited a comment on issue #985: HADOOP-16380. ITestS3AContractRootDir failing on trunk

2019-06-18 Thread GitBox
steveloughran edited a comment on issue #985: HADOOP-16380. ITestS3AContractRootDir failing on trunk URL: https://github.com/apache/hadoop/pull/985#issuecomment-503155299 My S3 store was somehow out of sync w/ s3guard: the table has the file s3a://hwdev-steve-ireland-new/fork-0007/test/tes

[GitHub] [hadoop] steveloughran commented on issue #985: HADOOP-16380. ITestS3AContractRootDir failing on trunk

2019-06-18 Thread GitBox
steveloughran commented on issue #985: HADOOP-16380. ITestS3AContractRootDir failing on trunk URL: https://github.com/apache/hadoop/pull/985#issuecomment-503155299 My S3 store was somehow out of sync w/ s3guard: the table has a fork-0007 ## underlying problem. ``` java.lang.As

[GitHub] [hadoop] steveloughran opened a new pull request #985: HADOOP-16380. ITestS3AContractRootDir failing on trunk

2019-06-18 Thread GitBox
steveloughran opened a new pull request #985: HADOOP-16380. ITestS3AContractRootDir failing on trunk URL: https://github.com/apache/hadoop/pull/985 Cause: tombstones mislead about directory empty status This is not the fix, though it provides diagnostics about the problem with more

[jira] [Commented] (HADOOP-16380) ITestS3AContractRootDir failing on trunk: tombstones mislead about directory empty status

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866605#comment-16866605 ] Steve Loughran commented on HADOOP-16380: - Note, there are some other places wh

[jira] [Commented] (HADOOP-16380) ITestS3AContractRootDir failing on trunk: tombstones mislead about directory empty status

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866597#comment-16866597 ] Steve Loughran commented on HADOOP-16380: - Cause (Which you can verify by chang

[GitHub] [hadoop] hadoop-yetus commented on issue #984: HDDS-1674 Make ScmBlockLocationProtocol message type based

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #984: HDDS-1674 Make ScmBlockLocationProtocol message type based URL: https://github.com/apache/hadoop/pull/984#issuecomment-503126050 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[jira] [Updated] (HADOOP-16380) ITestS3AContractRootDir failing on trunk

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16380: Priority: Critical (was: Major) > ITestS3AContractRootDir failing on trunk > ---

[jira] [Updated] (HADOOP-16380) ITestS3AContractRootDir failing on trunk: tombstones mislead about directory empty status

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16380: Summary: ITestS3AContractRootDir failing on trunk: tombstones mislead about directory emp

[GitHub] [hadoop] hadoop-yetus commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE…

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE… URL: https://github.com/apache/hadoop/pull/977#issuecomment-503083218 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] ehiggs commented on a change in pull request #743: HADOOP-11452 make rename/3 public

2019-06-18 Thread GitBox
ehiggs commented on a change in pull request #743: HADOOP-11452 make rename/3 public URL: https://github.com/apache/hadoop/pull/743#discussion_r294778507 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/RenameHelper.java ## @@ -0,0

[GitHub] [hadoop] hadoop-yetus commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE…

2019-06-18 Thread GitBox
hadoop-yetus commented on issue #977: (HDFS-14541)when evictableMmapped or evictable size is zero, do not throw NoSuchE… URL: https://github.com/apache/hadoop/pull/977#issuecomment-503077874 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16377) Moving logging APIs over to slf4j

2019-06-18 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866544#comment-16866544 ] Prabhu Joseph commented on HADOOP-16377: [~jojochuang] Below places are left wi

[jira] [Resolved] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

2019-06-18 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16184. - Resolution: Fixed > S3Guard: Handle OOB deletions and creation of a file which has a tombstone

[jira] [Updated] (HADOOP-16377) Moving logging APIs over to slf4j

2019-06-18 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated HADOOP-16377: --- Status: Patch Available (was: Open) > Moving logging APIs over to slf4j >

[jira] [Updated] (HADOOP-16377) Moving logging APIs over to slf4j

2019-06-18 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated HADOOP-16377: --- Attachment: HADOOP-16377-001.patch > Moving logging APIs over to slf4j > --

[GitHub] [hadoop] sodonnel commented on issue #984: HDDS-1674 Make ScmBlockLocationProtocol message type based

2019-06-18 Thread GitBox
sodonnel commented on issue #984: HDDS-1674 Make ScmBlockLocationProtocol message type based URL: https://github.com/apache/hadoop/pull/984#issuecomment-503054397 /label ozone This is an automated message from the Apache Git

[GitHub] [hadoop] sodonnel opened a new pull request #984: HDDS-1674 Make ScmBlockLocationProtocol message type based

2019-06-18 Thread GitBox
sodonnel opened a new pull request #984: HDDS-1674 Make ScmBlockLocationProtocol message type based URL: https://github.com/apache/hadoop/pull/984 This PR is a first attempt at refactoring the ScmBlockLocationProtocol using a single message type as is used in the OzoneManagerProtocol. In t

[jira] [Commented] (HADOOP-13980) S3Guard CLI: Add fsck check command

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866468#comment-16866468 ] Steve Loughran commented on HADOOP-13980: - Extra inconsistency I've managed to

[GitHub] [hadoop] steveloughran commented on issue #951: HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename

2019-06-18 Thread GitBox
steveloughran commented on issue #951: HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename URL: https://github.com/apache/hadoop/pull/951#issuecomment-503045141 Last little refactoring caused whitespace issues. Will fix ``` ./hadoop-tools/hadoop-aws/src/m

[GitHub] [hadoop] steveloughran closed pull request #879: HADOOP-15563 S3Guard to create on-demand DDB tables

2019-06-18 Thread GitBox
steveloughran closed pull request #879: HADOOP-15563 S3Guard to create on-demand DDB tables URL: https://github.com/apache/hadoop/pull/879 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] steveloughran removed a comment on issue #879: HADOOP-15563 S3Guard to create on-demand DDB tables

2019-06-18 Thread GitBox
steveloughran removed a comment on issue #879: HADOOP-15563 S3Guard to create on-demand DDB tables URL: https://github.com/apache/hadoop/pull/879#issuecomment-503038386 Last little refactoring caused whitespace issues. Will fix ``` ./hadoop-tools/hadoop-aws/src/main/java/org/apache/h

[jira] [Commented] (HADOOP-15893) fs.TrashPolicyDefault: can't create trash directory and race condition

2019-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866454#comment-16866454 ] Hadoop QA commented on HADOOP-15893: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] steveloughran commented on issue #879: HADOOP-15563 S3Guard to create on-demand DDB tables

2019-06-18 Thread GitBox
steveloughran commented on issue #879: HADOOP-15563 S3Guard to create on-demand DDB tables URL: https://github.com/apache/hadoop/pull/879#issuecomment-503038386 Last little refactoring caused whitespace issues. Will fix ``` ./hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs

[jira] [Created] (HADOOP-16380) ITestS3AContractRootDir failing on trunk

2019-06-18 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16380: --- Summary: ITestS3AContractRootDir failing on trunk Key: HADOOP-16380 URL: https://issues.apache.org/jira/browse/HADOOP-16380 Project: Hadoop Common Issu

[jira] [Commented] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866432#comment-16866432 ] Steve Loughran commented on HADOOP-16184: - Gabor: is this fixed in HADOOP-16279

[jira] [Assigned] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2019-06-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-14936: --- Assignee: Steve Loughran > S3Guard: remove "experimental" from documentation > ---

[GitHub] [hadoop] nandakumar131 commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Suprat

2019-06-18 Thread GitBox
nandakumar131 commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/852#discussion_r294696511 ## File path: hadoop-h

[GitHub] [hadoop] nandakumar131 commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Suprat

2019-06-18 Thread GitBox
nandakumar131 commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/852#discussion_r294695045 ## File path: hadoop-h

[GitHub] [hadoop] nandakumar131 commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Suprat

2019-06-18 Thread GitBox
nandakumar131 commented on a change in pull request #852: HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/852#discussion_r294698496 ## File path: hadoop-h

[GitHub] [hadoop] ehiggs commented on a change in pull request #743: HADOOP-11452 make rename/3 public

2019-06-18 Thread GitBox
ehiggs commented on a change in pull request #743: HADOOP-11452 make rename/3 public URL: https://github.com/apache/hadoop/pull/743#discussion_r294688267 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FSExceptionMessages.java ## @@ -5

  1   2   >