[jira] [Commented] (HADOOP-16417) abfs can't access storage account without password

2019-07-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886720#comment-16886720 ] Masatake Iwasaki commented on HADOOP-16417: --- Attached 000 does not work. I g

[jira] [Updated] (HADOOP-16398) Exports Hadoop metrics to Prometheus

2019-07-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16398: --- Status: Patch Available (was: Open) > Exports Hadoop metrics to Prometheus > -

[jira] [Updated] (HADOOP-16398) Exports Hadoop metrics to Prometheus

2019-07-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16398: --- Attachment: HADOOP-16398.001.patch > Exports Hadoop metrics to Prometheus > ---

[jira] [Updated] (HADOOP-16417) abfs can't access storage account without password

2019-07-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16417: -- Attachment: HADOOP-16417.000.patch > abfs can't access storage account without passwo

[GitHub] [hadoop] bharatviswa504 commented on issue #1100: HDDS-1802. Add Eviction policy for table cache.

2019-07-16 Thread GitBox
bharatviswa504 commented on issue #1100: HDDS-1802. Add Eviction policy for table cache. URL: https://github.com/apache/hadoop/pull/1100#issuecomment-512111723 /retest This is an automated message from the Apache Git Service.

[jira] [Assigned] (HADOOP-16398) Exports Hadoop metrics to Prometheus

2019-07-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-16398: -- Assignee: Akira Ajisaka > Exports Hadoop metrics to Prometheus > ---

[jira] [Commented] (HADOOP-16378) RawLocalFileStatus throws exception if a file is created and deleted quickly

2019-07-16 Thread K S (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886671#comment-16886671 ] K S commented on HADOOP-16378: -- Hey [~ste...@apache.org]. Sorry but I have unfortunately n

[jira] [Commented] (HADOOP-15958) Revisiting LICENSE and NOTICE files

2019-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886665#comment-16886665 ] Hadoop QA commented on HADOOP-15958: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #1100: HDDS-1802. Add Eviction policy for table cache.

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1100: HDDS-1802. Add Eviction policy for table cache. URL: https://github.com/apache/hadoop/pull/1100#issuecomment-512083973 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:-

[GitHub] [hadoop] hunshenshi commented on issue #1104: HDFS-14318:dn cannot be recognized and must be restarted to recognize the Repaired disk

2019-07-16 Thread GitBox
hunshenshi commented on issue #1104: HDFS-14318:dn cannot be recognized and must be restarted to recognize the Repaired disk URL: https://github.com/apache/hadoop/pull/1104#issuecomment-512076519 @xiaoyuyao ok. I will read it. Thanks for your proposal. -

[GitHub] [hadoop] hunshenshi commented on issue #1104: HDFS-14318:dn cannot be recognized and must be restarted to recognize the Repaired disk

2019-07-16 Thread GitBox
hunshenshi commented on issue #1104: HDFS-14318:dn cannot be recognized and must be restarted to recognize the Repaired disk URL: https://github.com/apache/hadoop/pull/1104#issuecomment-512076033 > 1. Would you like to add new unit test to cover this update? > 2. It is better to submit s

[GitHub] [hadoop] hunshenshi closed pull request #538: HDFS-14318:dn cannot be recognized and must be restarted to recognize the Repaired disk

2019-07-16 Thread GitBox
hunshenshi closed pull request #538: HDFS-14318:dn cannot be recognized and must be restarted to recognize the Repaired disk URL: https://github.com/apache/hadoop/pull/538 This is an automated message from the Apache Git Ser

[GitHub] [hadoop] hadoop-yetus commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model URL: https://github.com/apache/hadoop/pull/1063#issuecomment-512070364 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] anuengineer commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model

2019-07-16 Thread GitBox
anuengineer commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model URL: https://github.com/apache/hadoop/pull/1063#issuecomment-512061464 When you commit the next JIRA, you might want to take care of 2 CheckStyle and 3 JavaDoc. If you click on the links yo

[jira] [Updated] (HADOOP-15958) Revisiting LICENSE and NOTICE files

2019-07-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15958: --- Attachment: HADOOP-15958.007.patch > Revisiting LICENSE and NOTICE files >

[jira] [Commented] (HADOOP-15958) Revisiting LICENSE and NOTICE files

2019-07-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886595#comment-16886595 ] Akira Ajisaka commented on HADOOP-15958: 007 patch * Updated the bundled depend

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304179189 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/req

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304178640 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/req

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304178640 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/req

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #966: HDDS-1686. Remove check to get from openKeyTable in acl implementatio…

2019-07-16 Thread GitBox
xiaoyuyao commented on a change in pull request #966: HDDS-1686. Remove check to get from openKeyTable in acl implementatio… URL: https://github.com/apache/hadoop/pull/966#discussion_r304178181 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyMan

[GitHub] [hadoop] xiaoyuyao commented on issue #966: HDDS-1686. Remove check to get from openKeyTable in acl implementatio…

2019-07-16 Thread GitBox
xiaoyuyao commented on issue #966: HDDS-1686. Remove check to get from openKeyTable in acl implementatio… URL: https://github.com/apache/hadoop/pull/966#issuecomment-512051705 /retest This is an automated message from the Apa

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304177406 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/req

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304177261 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/req

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304176464 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/req

[jira] [Commented] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886570#comment-16886570 ] Hudson commented on HADOOP-15729: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] mackrorysd merged pull request #1075: HADOOP-15729. [s3a] Allow core threads to time out.

2019-07-16 Thread GitBox
mackrorysd merged pull request #1075: HADOOP-15729. [s3a] Allow core threads to time out. URL: https://github.com/apache/hadoop/pull/1075 This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304175893 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/res

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304175893 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/res

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304175519 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/res

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304173803 ## File path: hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/req

[GitHub] [hadoop] hanishakoneru merged pull request #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model

2019-07-16 Thread GitBox
hanishakoneru merged pull request #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model URL: https://github.com/apache/hadoop/pull/1063 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hanishakoneru commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model

2019-07-16 Thread GitBox
hanishakoneru commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model URL: https://github.com/apache/hadoop/pull/1063#issuecomment-512045807 Thank you all for the reviews. This is an automated

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304172499 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/req

[GitHub] [hadoop] arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1088: HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1088#discussion_r304172499 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/req

[GitHub] [hadoop] hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-512043093 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |:--

[GitHub] [hadoop] hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108#issuecomment-512040420 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |:--

[jira] [Commented] (HADOOP-11621) s3a doesn't consider blobs with trailing / and content-length >0 as directories

2019-07-16 Thread Al Johri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886545#comment-16886545 ] Al Johri commented on HADOOP-11621: --- This tripped me up pretty hard today. It would b

[jira] [Updated] (HADOOP-16386) FindBugs warning in branch-2: GlobalStorageStatistics defines non-transient non-serializable instance field map

2019-07-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16386: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.3

[GitHub] [hadoop] hadoop-yetus commented on issue #1075: HADOOP-15729. [s3a] Allow core threads to time out.

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1075: HADOOP-15729. [s3a] Allow core threads to time out. URL: https://github.com/apache/hadoop/pull/1075#issuecomment-512027139 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[GitHub] [hadoop] hadoop-yetus commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model URL: https://github.com/apache/hadoop/pull/1063#issuecomment-512026513 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] bharatviswa504 commented on issue #923: HDDS-1654. Ensure container state on datanode gets synced to disk whennever state change happens.

2019-07-16 Thread GitBox
bharatviswa504 commented on issue #923: HDDS-1654. Ensure container state on datanode gets synced to disk whennever state change happens. URL: https://github.com/apache/hadoop/pull/923#issuecomment-512003747 This patch needs to be rebased I believe, previously there is a bug where acceptan

[GitHub] [hadoop] hadoop-yetus commented on issue #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#issuecomment-511998035 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131579 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/K

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131563 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/s

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131570 ## File path: hadoop-ozone/objectstore-service/src/main/java/org/apache/hadoop/ozon

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131597 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/K

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131588 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/K

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131536 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/s

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131520 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/web/utils/O

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131509 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131474 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OzoneAcl.ja

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131558 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/s

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131491 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OzoneAcl.ja

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131482 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OzoneAcl.ja

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131466 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OzoneAcl.ja

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131499 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
hadoop-yetus commented on a change in pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#discussion_r304131524 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/web/utils/O

[GitHub] [hadoop] bharatviswa504 opened a new pull request #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer.

2019-07-16 Thread GitBox
bharatviswa504 opened a new pull request #1108: HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. URL: https://github.com/apache/hadoop/pull/1108 This is an automated message from the Apache Git Ser

[GitHub] [hadoop] mackrorysd commented on issue #1075: HADOOP-15729. [s3a] Allow core threads to time out.

2019-07-16 Thread GitBox
mackrorysd commented on issue #1075: HADOOP-15729. [s3a] Allow core threads to time out. URL: https://github.com/apache/hadoop/pull/1075#issuecomment-511994253 Thanks. Adding an auxFs.close call, and also taking care of closing tinyThreadPoolFs. ---

[GitHub] [hadoop] steveloughran commented on issue #1106: HADOOP-16380. S3A non-recursive deletion of root to return false

2019-07-16 Thread GitBox
steveloughran commented on issue #1106: HADOOP-16380. S3A non-recursive deletion of root to return false URL: https://github.com/apache/hadoop/pull/1106#issuecomment-511993151 I need to look at the source a bit more here; I think we need to make sure the behaviour on an rm (root, recursive

[GitHub] [hadoop] steveloughran commented on a change in pull request #1106: HADOOP-16380. S3A non-recursive deletion of root to return false

2019-07-16 Thread GitBox
steveloughran commented on a change in pull request #1106: HADOOP-16380. S3A non-recursive deletion of root to return false URL: https://github.com/apache/hadoop/pull/1106#discussion_r304124133 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSyst

[GitHub] [hadoop] steveloughran commented on issue #1075: HADOOP-15729. [s3a] Allow core threads to time out.

2019-07-16 Thread GitBox
steveloughran commented on issue #1075: HADOOP-15729. [s3a] Allow core threads to time out. URL: https://github.com/apache/hadoop/pull/1075#issuecomment-511989878 BTW, I'm +1 pending the auxFs.close call This is an automated

[jira] [Commented] (HADOOP-16430) S3AFilesystem.delete to incrementally update s3guard with deletions

2019-07-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886461#comment-16886461 ] Steve Loughran commented on HADOOP-16430: - Attached: screenshot of on-demand DD

[jira] [Updated] (HADOOP-16430) S3AFilesystem.delete to incrementally update s3guard with deletions

2019-07-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16430: Attachment: Screenshot 2019-07-16 at 22.08.31.png > S3AFilesystem.delete to incrementally

[jira] [Commented] (HADOOP-16430) S3AFilesystem.delete to incrementally update s3guard with deletions

2019-07-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886460#comment-16886460 ] Steve Loughran commented on HADOOP-16430: - h3. s3guard + local + single file de

[jira] [Commented] (HADOOP-16430) S3AFilesystem.delete to incrementally update s3guard with deletions

2019-07-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886455#comment-16886455 ] Steve Loughran commented on HADOOP-16430: - For the curious h3. single file del

[GitHub] [hadoop] hadoop-yetus commented on issue #1107: HDDS-1813. Fix false warning from ozones3 acceptance test. Contribute…

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1107: HDDS-1813. Fix false warning from ozones3 acceptance test. Contribute… URL: https://github.com/apache/hadoop/pull/1107#issuecomment-511981080 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] xiaoyuyao merged pull request #1107: HDDS-1813. Fix false warning from ozones3 acceptance test. Contribute…

2019-07-16 Thread GitBox
xiaoyuyao merged pull request #1107: HDDS-1813. Fix false warning from ozones3 acceptance test. Contribute… URL: https://github.com/apache/hadoop/pull/1107 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] hanishakoneru commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model

2019-07-16 Thread GitBox
hanishakoneru commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model URL: https://github.com/apache/hadoop/pull/1063#issuecomment-511977786 /retest This is an automated message from the Apach

[GitHub] [hadoop] bharatviswa504 edited a comment on issue #1100: HDDS-1802. Add Eviction policy for table cache.

2019-07-16 Thread GitBox
bharatviswa504 edited a comment on issue #1100: HDDS-1802. Add Eviction policy for table cache. URL: https://github.com/apache/hadoop/pull/1100#issuecomment-511971954 > Capturing our offline discussion. We discussed the following: > > 1. Populate full cache on process startup (mentio

[GitHub] [hadoop] bharatviswa504 commented on issue #1100: HDDS-1802. Add Eviction policy for table cache.

2019-07-16 Thread GitBox
bharatviswa504 commented on issue #1100: HDDS-1802. Add Eviction policy for table cache. URL: https://github.com/apache/hadoop/pull/1100#issuecomment-511971954 > Capturing our offline discussion. We discussed the following: > > 1. Populate full cache on process startup (mentioned by

[GitHub] [hadoop] arp7 commented on issue #1100: HDDS-1802. Add Eviction policy for table cache.

2019-07-16 Thread GitBox
arp7 commented on issue #1100: HDDS-1802. Add Eviction policy for table cache. URL: https://github.com/apache/hadoop/pull/1100#issuecomment-511968524 Capturing our offline discussion. We discussed the following: 1. Populate full cache on process startup (mentioned by Bharat). 1. Move d

[GitHub] [hadoop] anuengineer closed pull request #1074: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. Contributed by Ajay Kumar.

2019-07-16 Thread GitBox
anuengineer closed pull request #1074: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/1074 This is an automated message from the Apa

[GitHub] [hadoop] anuengineer closed pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
anuengineer closed pull request #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101 This is an automated message from the Apache Git Service. To respo

[GitHub] [hadoop] anuengineer commented on issue #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
anuengineer commented on issue #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#issuecomment-511966295 I have committed this to trunk and cleaned up all the white space issues. Thanks for the patch. -

[GitHub] [hadoop] anuengineer commented on issue #1074: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. Contributed by Ajay Kumar.

2019-07-16 Thread GitBox
anuengineer commented on issue #1074: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/1074#issuecomment-511966060 I have committed this to trunk. Thanks for your work @ajayydv --

[GitHub] [hadoop] bharatviswa504 commented on a change in pull request #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model

2019-07-16 Thread GitBox
bharatviswa504 commented on a change in pull request #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model URL: https://github.com/apache/hadoop/pull/1063#discussion_r304093467 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request

[GitHub] [hadoop] xiaoyuyao merged pull request #1094: HDDS-1787. NPE thrown while trying to find DN closest to client.

2019-07-16 Thread GitBox
xiaoyuyao merged pull request #1094: HDDS-1787. NPE thrown while trying to find DN closest to client. URL: https://github.com/apache/hadoop/pull/1094 This is an automated message from the Apache Git Service. To respond to th

[GitHub] [hadoop] xiaoyuyao commented on issue #1094: HDDS-1787. NPE thrown while trying to find DN closest to client.

2019-07-16 Thread GitBox
xiaoyuyao commented on issue #1094: HDDS-1787. NPE thrown while trying to find DN closest to client. URL: https://github.com/apache/hadoop/pull/1094#issuecomment-511960824 +1, I will merge it shortly. This is an automated me

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #1094: HDDS-1787. NPE thrown while trying to find DN closest to client.

2019-07-16 Thread GitBox
xiaoyuyao commented on a change in pull request #1094: HDDS-1787. NPE thrown while trying to find DN closest to client. URL: https://github.com/apache/hadoop/pull/1094#discussion_r304089740 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/SCMBloc

[GitHub] [hadoop] hanishakoneru commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model

2019-07-16 Thread GitBox
hanishakoneru commented on issue #1063: HDDS-1775. Make OM KeyDeletingService compatible with HA model URL: https://github.com/apache/hadoop/pull/1063#issuecomment-511958269 Thanks for the reviews @anuengineer and @bharatviswa504. I have opened a new Jira HDDS-1814 to address the Java 8

[GitHub] [hadoop] arp7 commented on a change in pull request #1076: HDDS-1782. Add an option to MiniOzoneChaosCluster to read files multiple times. Contributed by Mukul Kumar Singh.

2019-07-16 Thread GitBox
arp7 commented on a change in pull request #1076: HDDS-1782. Add an option to MiniOzoneChaosCluster to read files multiple times. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/1076#discussion_r304086677 ## File path: hadoop-ozone/integration-test/src

[GitHub] [hadoop] xiaoyuyao opened a new pull request #1107: HDDS-1813. Fix false warning from ozones3 acceptance test. Contribute…

2019-07-16 Thread GitBox
xiaoyuyao opened a new pull request #1107: HDDS-1813. Fix false warning from ozones3 acceptance test. Contribute… URL: https://github.com/apache/hadoop/pull/1107 …d by Xiaoyu Yao. This is an automated message from the Apache

[GitHub] [hadoop] xiaoyuyao commented on issue #1104: HDFS-14318:dn cannot be recognized and must be restarted to recognize the Repaired disk

2019-07-16 Thread GitBox
xiaoyuyao commented on issue #1104: HDFS-14318:dn cannot be recognized and must be restarted to recognize the Repaired disk URL: https://github.com/apache/hadoop/pull/1104#issuecomment-511948283 Thanks @hunshenshi for reporting the issue and the PR. Agree it would be great if you can add

[GitHub] [hadoop] hadoop-yetus commented on issue #1106: HADOOP-16380. S3A non-recursive deletion of root to return false

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1106: HADOOP-16380. S3A non-recursive deletion of root to return false URL: https://github.com/apache/hadoop/pull/1106#issuecomment-511930358 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] hadoop-yetus commented on issue #1085: HDDS-1785. OOM error in Freon due to the concurrency handling

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1085: HDDS-1785. OOM error in Freon due to the concurrency handling URL: https://github.com/apache/hadoop/pull/1085#issuecomment-511923959 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] xiaoyuyao commented on issue #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
xiaoyuyao commented on issue #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#issuecomment-511918432 The smoke test failure does not repro locally. Trigger another jenkins run. ---

[GitHub] [hadoop] xiaoyuyao commented on issue #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. …

2019-07-16 Thread GitBox
xiaoyuyao commented on issue #1101: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. … URL: https://github.com/apache/hadoop/pull/1101#issuecomment-511918227 /retest This is an automated message from the A

[GitHub] [hadoop] mukul1987 commented on a change in pull request #1073: HDDS-1780. TestFailureHandlingByClient tests are flaky.

2019-07-16 Thread GitBox
mukul1987 commented on a change in pull request #1073: HDDS-1780. TestFailureHandlingByClient tests are flaky. URL: https://github.com/apache/hadoop/pull/1073#discussion_r304037907 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientGrpc.java ###

[GitHub] [hadoop] mukul1987 commented on a change in pull request #1073: HDDS-1780. TestFailureHandlingByClient tests are flaky.

2019-07-16 Thread GitBox
mukul1987 commented on a change in pull request #1073: HDDS-1780. TestFailureHandlingByClient tests are flaky. URL: https://github.com/apache/hadoop/pull/1073#discussion_r304038165 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientGrpc.java ###

[GitHub] [hadoop] bharatviswa504 commented on issue #923: HDDS-1654. Ensure container state on datanode gets synced to disk whennever state change happens.

2019-07-16 Thread GitBox
bharatviswa504 commented on issue #923: HDDS-1654. Ensure container state on datanode gets synced to disk whennever state change happens. URL: https://github.com/apache/hadoop/pull/923#issuecomment-511909146 +1 LGTM. This

[GitHub] [hadoop] hadoop-yetus commented on issue #1077: HADOOP-XXXXX. S3Guard tombstones can mislead about directory empty status and other fixes - wip

2019-07-16 Thread GitBox
hadoop-yetus commented on issue #1077: HADOOP-X. S3Guard tombstones can mislead about directory empty status and other fixes - wip URL: https://github.com/apache/hadoop/pull/1077#issuecomment-511908482 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtim

[GitHub] [hadoop] bgaborg commented on issue #1106: HADOOP-16380. S3A non-recursive deletion of root to return false

2019-07-16 Thread GitBox
bgaborg commented on issue #1106: HADOOP-16380. S3A non-recursive deletion of root to return false URL: https://github.com/apache/hadoop/pull/1106#issuecomment-511907901 Tests run against ireland with known tesMRJob errors. There was an error but cleared on the rerun -

[GitHub] [hadoop] bgaborg opened a new pull request #1106: HADOOP-16380. S3A non-recursive deletion of root to return false

2019-07-16 Thread GitBox
bgaborg opened a new pull request #1106: HADOOP-16380. S3A non-recursive deletion of root to return false URL: https://github.com/apache/hadoop/pull/1106 This is an automated message from the Apache Git Service. To respond t

[jira] [Commented] (HADOOP-16433) Filter expired entries and tombstones when listing with MetadataStore#listChildren

2019-07-16 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886294#comment-16886294 ] Gabor Bota commented on HADOOP-16433: - Old deprecated description from HADOOP-16380

[jira] [Commented] (HADOOP-16380) S3A non-recursive deletion of root to return false

2019-07-16 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886293#comment-16886293 ] Gabor Bota commented on HADOOP-16380: - The following should be fixed to wrap the fi

[GitHub] [hadoop] adoroszlai commented on a change in pull request #1073: HDDS-1780. TestFailureHandlingByClient tests are flaky.

2019-07-16 Thread GitBox
adoroszlai commented on a change in pull request #1073: HDDS-1780. TestFailureHandlingByClient tests are flaky. URL: https://github.com/apache/hadoop/pull/1073#discussion_r304001568 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.

[jira] [Updated] (HADOOP-16433) Filter expired entries and tombstones when listing with MetadataStore#listChildren

2019-07-16 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16433: Description: Currently, we don't filter out entries in {{listChildren}} implementations. This ca

[jira] [Updated] (HADOOP-16433) Filter expired entries and tombstones when listing with MetadataStore#listChildren

2019-07-16 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16433: Description: Currently, we don't filter out entries in {{listChildren}} implementations. This ca

[jira] [Created] (HADOOP-16433) Filter expired entries and tombstones when listing with MetadataStore#listChildren

2019-07-16 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16433: --- Summary: Filter expired entries and tombstones when listing with MetadataStore#listChildren Key: HADOOP-16433 URL: https://issues.apache.org/jira/browse/HADOOP-16433 Pr

  1   2   >