[GitHub] [hadoop] bshashikant opened a new pull request #820: Disable the sync flag by default during chunk writes in Datanode.

bshashikant opened a new pull request #820: Disable the sync flag by default during chunk writes in Datanode. URL: https://github.com/apache/hadoop/pull/820 This is an automated message from the Apache Git Service. To

[jira] [Updated] (HADOOP-16287) KerberosAuthenticationHandler Trusted Proxy Support for Knox

[ https://issues.apache.org/jira/browse/HADOOP-16287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated HADOOP-16287: --- Attachment: HADOOP-16287-007.patch > KerberosAuthenticationHandler Trusted Proxy Support

[jira] [Commented] (HADOOP-16269) ABFS: add listFileStatus with StartFrom

[ https://issues.apache.org/jira/browse/HADOOP-16269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840009#comment-16840009 ] Da Zhou commented on HADOOP-16269: -- [~ste...@apache.org], [~fabbri] Thanks for the help! Yes I think

[GitHub] [hadoop] hadoop-yetus commented on issue #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM.

hadoop-yetus commented on issue #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM. URL: https://github.com/apache/hadoop/pull/819#issuecomment-492489629 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] DadanielZ commented on a change in pull request #787: HADOOP-16251. ABFS: add FSMainOperationsBaseTest

DadanielZ commented on a change in pull request #787: HADOOP-16251. ABFS: add FSMainOperationsBaseTest URL: https://github.com/apache/hadoop/pull/787#discussion_r284074114 ## File path:

[GitHub] [hadoop] arp7 commented on issue #812: HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka

arp7 commented on issue #812: HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/812#issuecomment-492477977 +1. Added _ozone_ label to trigger full precommit run.

[GitHub] [hadoop] hadoop-yetus commented on issue #812: HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka

hadoop-yetus commented on issue #812: HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/812#issuecomment-492478705 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] arp7 commented on issue #812: HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka

arp7 commented on issue #812: HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/812#issuecomment-492478112 @supratimdeka the jenkins run flagged 3 unit test failures. Can you please confirm they are

[GitHub] [hadoop] hadoop-yetus commented on issue #812: HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka

hadoop-yetus commented on issue #812: HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka URL: https://github.com/apache/hadoop/pull/812#issuecomment-492474086 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] avijayanhwx commented on issue #799: HDDS-1451 : SCMBlockManager findPipeline and createPipeline are not lock protected.

avijayanhwx commented on issue #799: HDDS-1451 : SCMBlockManager findPipeline and createPipeline are not lock protected. URL: https://github.com/apache/hadoop/pull/799#issuecomment-492473735 /retest This is an automated

[jira] [Commented] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839902#comment-16839902 ] wujinhu commented on HADOOP-16306: -- Thanks [~cheersyang] > AliyunOSS: Remove temporary files when

[GitHub] [hadoop] sahilTakiar commented on issue #816: HDFS-14482: Crash when using libhdfs with bad classpath

sahilTakiar commented on issue #816: HDFS-14482: Crash when using libhdfs with bad classpath URL: https://github.com/apache/hadoop/pull/816#issuecomment-492470371 If libhdfs fails to create the `env`, then `hdfsThreadDestructor` should be called on the `ThreadLocalState`, which looks like

[GitHub] [hadoop] iamgd67 commented on issue #817: HDFS-14303: scan only meta file produce block dir structure check warn fix

iamgd67 commented on issue #817: HDFS-14303: scan only meta file produce block dir structure check warn fix URL: https://github.com/apache/hadoop/pull/817#issuecomment-492470457 Testing runed test-patch locally, all pass

[GitHub] [hadoop] hadoop-yetus commented on issue #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM.

hadoop-yetus commented on issue #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM. URL: https://github.com/apache/hadoop/pull/819#issuecomment-492464828 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM.

hadoop-yetus commented on issue #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM. URL: https://github.com/apache/hadoop/pull/819#issuecomment-492460520 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] anuengineer commented on a change in pull request #814: HDDS-1518. Use /etc/ozone for configuration inside docker-compose

anuengineer commented on a change in pull request #814: HDDS-1518. Use /etc/ozone for configuration inside docker-compose URL: https://github.com/apache/hadoop/pull/814#discussion_r284043722 ## File path: Dockerfile ## @@ -36,7 +36,9 @@ RUN chown hadoop /opt ADD scripts

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r284026725 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/TableCache.java ## @@ -0,0 +1,73 @@ +/* + *

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r284034704 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/FullTableCache.java ## @@ -0,0 +1,67 @@

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r284033851 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/FullTableCache.java ## @@ -0,0 +1,67 @@

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r284036222 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmMetadataManagerImpl.java ## @@ -245,42

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r284036830 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -69,8 +94,40 @@ public

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r284037057 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/TypedTable.java ## @@ -69,8 +94,40 @@ public

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r284025787 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/CacheValue.java ## @@ -0,0 +1,63 @@ +/** +

[GitHub] [hadoop] arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache.

arp7 commented on a change in pull request #798: HDDS-1499. OzoneManager Cache. URL: https://github.com/apache/hadoop/pull/798#discussion_r284026725 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/cache/TableCache.java ## @@ -0,0 +1,73 @@ +/* + *

[GitHub] [hadoop] hadoop-yetus commented on issue #804: HDDS-1496. Support partial chunk reads and checksum verification

hadoop-yetus commented on issue #804: HDDS-1496. Support partial chunk reads and checksum verification URL: https://github.com/apache/hadoop/pull/804#issuecomment-492446479 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] avijayanhwx commented on issue #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM.

avijayanhwx commented on issue #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM. URL: https://github.com/apache/hadoop/pull/819#issuecomment-492446311 \label ozone This is an

[GitHub] [hadoop] avijayanhwx opened a new pull request #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM.

avijayanhwx opened a new pull request #819: HDDS-1501 : Create a Recon task interface to update internal DB on updates from OM. URL: https://github.com/apache/hadoop/pull/819 This is an automated message from the Apache

[jira] [Commented] (HADOOP-16298) Manage/Renew delegation tokens for externally scheduled jobs

[ https://issues.apache.org/jira/browse/HADOOP-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839856#comment-16839856 ] Don Bosco Durai commented on HADOOP-16298: -- [~clayb] I like the overall approach. This nicely

[GitHub] [hadoop] arp7 commented on issue #725: HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit A…

arp7 commented on issue #725: HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit A… URL: https://github.com/apache/hadoop/pull/725#issuecomment-492431277 /retest This is an automated message from the Apache

[GitHub] [hadoop] hadoop-yetus commented on issue #745: HDDS-1441. Remove usage of getRetryFailureException. (swagle)

hadoop-yetus commented on issue #745: HDDS-1441. Remove usage of getRetryFailureException. (swagle) URL: https://github.com/apache/hadoop/pull/745#issuecomment-492429717 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839805#comment-16839805 ] Hudson commented on HADOOP-16306: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16550 (See

[jira] [Commented] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839800#comment-16839800 ] Weiwei Yang commented on HADOOP-16306: -- Just committed to trunk and cherried picked to all

[jira] [Updated] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-16306: - Fix Version/s: 2.9.3 > AliyunOSS: Remove temporary files when upload small files to OSS >

[jira] [Updated] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-16306: - Fix Version/s: 2.10.0 > AliyunOSS: Remove temporary files when upload small files to OSS >

[jira] [Updated] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-16306: - Fix Version/s: 3.0.4 > AliyunOSS: Remove temporary files when upload small files to OSS >

[jira] [Updated] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-16306: - Fix Version/s: 3.2.1 > AliyunOSS: Remove temporary files when upload small files to OSS >

[jira] [Updated] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-16306: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Status:

[jira] [Updated] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HADOOP-16306: - Fix Version/s: 3.1.3 > AliyunOSS: Remove temporary files when upload small files to OSS >

[jira] [Commented] (HADOOP-16306) AliyunOSS: Remove temporary files when upload small files to OSS

[ https://issues.apache.org/jira/browse/HADOOP-16306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839795#comment-16839795 ] Weiwei Yang commented on HADOOP-16306: -- Hi [~wujinhu] Patch looks good to me, +1. I am committing

[GitHub] [hadoop] ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

ben-roling commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-492367884 Thanks Steve, hope you have a great trip. I've seen the

[jira] [Commented] (HADOOP-16117) Upgrade to latest AWS SDK

[ https://issues.apache.org/jira/browse/HADOOP-16117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839688#comment-16839688 ] Steve Loughran commented on HADOOP-16117: - PR filed for yetus to notice:

[GitHub] [hadoop] steveloughran commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite

steveloughran commented on issue #794: HADOOP-16085: use object version or etags to protect against inconsistent read after replace/overwrite URL: https://github.com/apache/hadoop/pull/794#issuecomment-492349726 I'm travelling right now & can't review this until wed/thur -it's got

[GitHub] [hadoop] toddlipcon merged pull request #816: HDFS-14482: Crash when using libhdfs with bad classpath

toddlipcon merged pull request #816: HDFS-14482: Crash when using libhdfs with bad classpath URL: https://github.com/apache/hadoop/pull/816 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-16092) Move the source of hadoop/ozone containers to the same repository

[ https://issues.apache.org/jira/browse/HADOOP-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839669#comment-16839669 ] Eric Yang commented on HADOOP-16092: [~elek] you are miss-quoting me incorrectly. My preference is

[GitHub] [hadoop] elek commented on issue #810: HDDS-1512. Implement DoubleBuffer in OzoneManager.

elek commented on issue #810: HDDS-1512. Implement DoubleBuffer in OzoneManager. URL: https://github.com/apache/hadoop/pull/810#issuecomment-492215253 /retest This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] steveloughran commented on issue #818: HADOOP-116117 Update AWS SDK to 1.11.549.

steveloughran commented on issue #818: HADOOP-116117 Update AWS SDK to 1.11.549. URL: https://github.com/apache/hadoop/pull/818#issuecomment-492205720 Testing * full s3a tests run in auth+nonauth, scale against s3 ireland * test output reviewed TODO: * switch to v4 auth

[GitHub] [hadoop] steveloughran opened a new pull request #818: HADOOP-116117 Update AWS SDK to 1.11.549.

steveloughran opened a new pull request #818: HADOOP-116117 Update AWS SDK to 1.11.549. URL: https://github.com/apache/hadoop/pull/818 Contributed by Steve Loughran. Change-Id: Iff125bf3e2f409ae7fd0d05440f4f7ba38c24331

[GitHub] [hadoop] hadoop-yetus commented on issue #804: HDDS-1496. Support partial chunk reads and checksum verification

hadoop-yetus commented on issue #804: HDDS-1496. Support partial chunk reads and checksum verification URL: https://github.com/apache/hadoop/pull/804#issuecomment-492170527 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] lokeshj1703 commented on issue #813: HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server

lokeshj1703 commented on issue #813: HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server URL: https://github.com/apache/hadoop/pull/813#issuecomment-492158491 @mukul1987 @xiaoyuyao Thanks for reviewing the PR! I have merged it to trunk.

[GitHub] [hadoop] lokeshj1703 merged pull request #813: HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server

lokeshj1703 merged pull request #813: HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server URL: https://github.com/apache/hadoop/pull/813 This is an automated message from the Apache Git

[jira] [Commented] (HADOOP-16092) Move the source of hadoop/ozone containers to the same repository

[ https://issues.apache.org/jira/browse/HADOOP-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839240#comment-16839240 ] Elek, Marton commented on HADOOP-16092: --- I am confused a little as this issue is suggested by you

[GitHub] [hadoop] lokeshj1703 commented on issue #813: HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server

lokeshj1703 commented on issue #813: HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server URL: https://github.com/apache/hadoop/pull/813#issuecomment-492154367 > Do we need to update ozone with a new Ratis release to take the newly added config?

[jira] [Commented] (HADOOP-16287) KerberosAuthenticationHandler Trusted Proxy Support for Knox

[ https://issues.apache.org/jira/browse/HADOOP-16287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839213#comment-16839213 ] Hadoop QA commented on HADOOP-16287: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] elek commented on a change in pull request #814: HDDS-1518. Use /etc/ozone for configuration inside docker-compose

elek commented on a change in pull request #814: HDDS-1518. Use /etc/ozone for configuration inside docker-compose URL: https://github.com/apache/hadoop/pull/814#discussion_r283688185 ## File path: Dockerfile ## @@ -36,7 +36,9 @@ RUN chown hadoop /opt ADD scripts /opt/

[GitHub] [hadoop] elek commented on issue #815: HDDS-1522. Provide intellij runConfiguration for Ozone components

elek commented on issue #815: HDDS-1522. Provide intellij runConfiguration for Ozone components URL: https://github.com/apache/hadoop/pull/815#issuecomment-492132655 /retest This is an automated message from the Apache Git

[jira] [Commented] (HADOOP-16287) KerberosAuthenticationHandler Trusted Proxy Support for Knox

[ https://issues.apache.org/jira/browse/HADOOP-16287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839156#comment-16839156 ] Prabhu Joseph commented on HADOOP-16287: [~eyang] Have added new filter initializer

[jira] [Updated] (HADOOP-16287) KerberosAuthenticationHandler Trusted Proxy Support for Knox

[ https://issues.apache.org/jira/browse/HADOOP-16287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated HADOOP-16287: --- Attachment: HADOOP-16287-006.patch > KerberosAuthenticationHandler Trusted Proxy Support

[GitHub] [hadoop] hadoop-yetus commented on issue #804: HDDS-1496. Support partial chunk reads and checksum verification

hadoop-yetus commented on issue #804: HDDS-1496. Support partial chunk reads and checksum verification URL: https://github.com/apache/hadoop/pull/804#issuecomment-492098851 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] iamgd67 opened a new pull request #817: HDFS-14303: scan only meta file produce block dir structure check warn fix

iamgd67 opened a new pull request #817: HDFS-14303: scan only meta file produce block dir structure check warn fix URL: https://github.com/apache/hadoop/pull/817 when scan a only meta file but no block file block, will produce a block structure warn eg: WARN DirectoryScanner:? -

[jira] [Commented] (HADOOP-16112) Delete the baseTrashPath's subDir leads to don't modify baseTrashPath

[ https://issues.apache.org/jira/browse/HADOOP-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839141#comment-16839141 ] Lisheng Sun commented on HADOOP-16112: -- Test failures are not caused by this patch.  > Delete the

[GitHub] [hadoop] sahilTakiar commented on issue #784: HADOOP-16050: s3a SSL connections should use OpenSSL

sahilTakiar commented on issue #784: HADOOP-16050: s3a SSL connections should use OpenSSL URL: https://github.com/apache/hadoop/pull/784#issuecomment-492091474 @steveloughran is this good to be merged now? This is an