[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10534: - Target Version/s: 2.8.0, 2.7.3, 2.9.0, 2.6.5, 3.0.0-alpha1 (was: 3.0.0-alpha1) > NameNode WebUI should

[jira] [Reopened] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-10534: -- > NameNode WebUI should display DataNode usage rate with a certain percentile >

[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10534: - Fix Version/s: (was: 3.0.0-alpha1) > NameNode WebUI should display DataNode usage rate with a certain

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348500#comment-15348500 ] Zhe Zhang commented on HDFS-10534: -- Should this (adding a metric and adding it to web UI) be considered

[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10534: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1 Status:

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347028#comment-15347028 ] Zhe Zhang commented on HDFS-10534: -- Thanks [~kaisasak] for the update! +1 on v5 patch after Jenkins. >

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345777#comment-15345777 ] Zhe Zhang commented on HDFS-8940: - Thanks for the insight [~cmccabe]! bq. You would probably want an HA

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345772#comment-15345772 ] Zhe Zhang commented on HDFS-10530: -- Thanks [~demongaorui] for reporting this. Yes I believe the right

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345544#comment-15345544 ] Zhe Zhang commented on HDFS-8940: - This is a very useful optimization. Thanks [~mingma] for proposing the

[jira] [Commented] (HDFS-10220) A large number of expired leases can make namenode unresponsive and cause failover

[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345509#comment-15345509 ] Zhe Zhang commented on HDFS-10220: -- Agreed. HDFS-6757 made a pretty big change which is hard to get

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345455#comment-15345455 ] Zhe Zhang commented on HDFS-10473: -- Thanks [~umamaheswararao] and [~jingzhao]! Just caught up on this,

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345386#comment-15345386 ] Zhe Zhang commented on HDFS-10534: -- Thanks [~lewuathe]! Latest patch LGTM overall. A few minors: # Can we

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Attachment: HDFS-10544.03.patch Thought more about the two options. I think we should use the simpler

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342578#comment-15342578 ] Zhe Zhang commented on HDFS-7859: - Thanks! > Erasure Coding: Persist erasure coding policies in NameNode >

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7859: Labels: BB2015-05-TBR hdfs-ec-3.0-must-do (was: BB2015-05-TBR) > Erasure Coding: Persist erasure coding

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337336#comment-15337336 ] Zhe Zhang commented on HDFS-7859: - I think this is a blocker for EC release in 3.0-alpah1. [~xinwei]

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337269#comment-15337269 ] Zhe Zhang commented on HDFS-10534: -- Thanks Kai! Patch looks pretty good. However I think we should make

[jira] [Commented] (HDFS-10220) A large number of expired leases can make namenode unresponsive and cause failover

[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337125#comment-15337125 ] Zhe Zhang commented on HDFS-10220: -- [~ashangit], [~raviprak] I think this is a valid fix for 2.8~2.6. LMK

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Attachment: HDFS-10544.02.patch Uploading v2 patch. So we have 2 alternatives: * v1 patch: add

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Attachment: HDFS-10544.01.patch v0 patch didn't work because {{HAUtil#useLogicalUri}} expects an URI

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Attachment: HDFS-10544.00.patch Submitting initial patch. {{HAUtil#useLogicalUri}} can potentially be

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Status: Patch Available (was: Open) > Balancer doesn't work with IPFailoverProxyProvider >

[jira] [Created] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

Zhe Zhang created HDFS-10544: Summary: Balancer doesn't work with IPFailoverProxyProvider Key: HDFS-10544 URL: https://issues.apache.org/jira/browse/HDFS-10544 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

Zhe Zhang created HDFS-10534: Summary: NameNode WebUI should display DataNode usage rate with a certain percentile Key: HDFS-10534 URL: https://issues.apache.org/jira/browse/HDFS-10534 Project: Hadoop

[jira] [Commented] (HDFS-10407) Erasure Coding: Rename CorruptReplicasMap to CorruptRedundancyMap in BlockManager to more generic

[ https://issues.apache.org/jira/browse/HDFS-10407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332162#comment-15332162 ] Zhe Zhang commented on HDFS-10407: -- Thanks for the work Rakesh. This is actually a pretty tricky one. I

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332129#comment-15332129 ] Zhe Zhang commented on HDFS-10467: -- Read more about the design and patch. Looks really interesting. Great

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330596#comment-15330596 ] Zhe Zhang commented on HDFS-10473: -- Sure! > Allow only suitable storage policies to be set on striped

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330163#comment-15330163 ] Zhe Zhang commented on HDFS-10473: -- Thanks Uma for the patch and Jing for the comments. The v3 patch

[jira] [Updated] (HDFS-10473) Allow only suitable storage policies to be set on striped files

[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10473: - Hadoop Flags: Reviewed > Allow only suitable storage policies to be set on striped files >

[jira] [Commented] (HDFS-10495) Block should be marked as missing if the all the replicas are on Decommissioned nodes.

[ https://issues.apache.org/jira/browse/HDFS-10495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324840#comment-15324840 ] Zhe Zhang commented on HDFS-10495: -- Thanks Rushabh for reporting this. Looks like we need the bug fix in

[jira] [Updated] (HDFS-10495) Block should be marked as missing if the all the replicas are on Decommissioned nodes.

[ https://issues.apache.org/jira/browse/HDFS-10495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10495: - Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.8.0) > Block should be marked as missing if the all the

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322086#comment-15322086 ] Zhe Zhang commented on HDFS-9924: - My 2 cents: I think the async feature should be done in a feature

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319564#comment-15319564 ] Zhe Zhang commented on HDFS-10467: -- Thanks. Impressive that only {{12 deletions(-)}} :) > Router-based

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319050#comment-15319050 ] Zhe Zhang commented on HDFS-9806: - Another thought is, maybe we can leverage caching policies and

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Labels: encryption namenode scalability (was: encryption) > getFileEncryptionInfo should return quickly

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Labels: encryption (was: ) > getFileEncryptionInfo should return quickly for non-encrypted cluster >

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.5 Status: Resolved

[jira] [Commented] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318791#comment-15318791 ] Zhe Zhang commented on HDFS-10458: -- Committed to branch-2 and branch-2.8. Now only waiting for branch-2.6

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFS-10458-branch-2.6.01.patch I verified branch-2 patch Jenkins failures, all pass locally.

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317952#comment-15317952 ] Zhe Zhang commented on HDFS-10467: -- Thanks [~elgoiri]! I think most likely we will cut a feature branch

[jira] [Comment Edited] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317925#comment-15317925 ] Zhe Zhang edited comment on HDFS-10467 at 6/7/16 6:05 AM: -- Thanks for the design

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317925#comment-15317925 ] Zhe Zhang commented on HDFS-10467: -- Thanks for the design doc and patch [~elgoiri], very interesting

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFS-10458-branch-2.00.patch Thanks Wangda for pointing this out. Yes I believe it is a JDK

[jira] [Commented] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317877#comment-15317877 ] Zhe Zhang commented on HDFS-10458: -- Jenkins run [results |

[jira] [Commented] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317875#comment-15317875 ] Zhe Zhang commented on HDFS-10458: -- Thanks for the update [~leftnoteasy]. I did build locally before

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Fix Version/s: 3.0.0-alpha1 2.7.3 2.8.0 > getFileEncryptionInfo

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFS-10458-branch-2.6.00.patch All reported branch-2.7 failures are unrelated and pass

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Target Version/s: 2.8.0, 2.7.3, 2.6.5, 3.0.0-alpha1 (was: 2.6.5) > getFileEncryptionInfo should return

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFS-10458-branch-2.7.00.patch Back porting to 2.7 not clean. Attaching patch to trigger

[jira] [Commented] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317234#comment-15317234 ] Zhe Zhang commented on HDFS-10458: -- Thanks [~shv]. Will commit to trunk ~ branch-2.6 after the latest

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFS-10458.05.patch Updating patch to address unit test failures. Thanks [~shv] for the

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFS-10458.04.patch Not sure why Yetus failed to build. Attaching patch again. >

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFS-10458.03.patch Thanks for the suggestion [~shv]. Attaching new patch. Right now we are

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314609#comment-15314609 ] Zhe Zhang commented on HDFS-9806: - Thanks for posting the design and PoC [~chris.douglas]! It's really

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314349#comment-15314349 ] Zhe Zhang commented on HDFS-10473: -- Thanks [~umamaheswararao] for proposing the idea. I agree that we can

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313112#comment-15313112 ] Zhe Zhang commented on HDFS-10301: -- Thanks for the discussions [~cmccabe], [~shv],[~redvine] I think the

[jira] [Commented] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311759#comment-15311759 ] Zhe Zhang commented on HDFS-10458: -- Thanks for the comment [~shv]. I started updating the patch using

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFSA-10458.02.patch Oops missed a {{!}} in if condition. > getFileEncryptionInfo should

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFSA-10458.01.patch Thanks [~shv] for the review. Attaching new patch to take the

[jira] [Updated] (HDFS-10236) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3]

[ https://issues.apache.org/jira/browse/HDFS-10236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10236: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1 Status:

[jira] [Updated] (HDFS-10236) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3]

[ https://issues.apache.org/jira/browse/HDFS-10236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10236: - Labels: reviewed (was: ) > Erasure Coding: Rename replication-based names in BlockManager to more >

[jira] [Updated] (HDFS-10236) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3]

[ https://issues.apache.org/jira/browse/HDFS-10236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10236: - Thanks Rakesh. +1 on the patch, I'm committing it soon. > Erasure Coding: Rename replication-based names in

[jira] [Commented] (HDFS-10236) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3]

[ https://issues.apache.org/jira/browse/HDFS-10236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301581#comment-15301581 ] Zhe Zhang commented on HDFS-10236: -- Thanks Rakesh for the work. Path LGTM overall. A few issues: # I

[jira] [Comment Edited] (HDFS-10236) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3]

[ https://issues.apache.org/jira/browse/HDFS-10236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301581#comment-15301581 ] Zhe Zhang edited comment on HDFS-10236 at 5/26/16 5:56 AM: --- Thanks Rakesh for

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Component/s: namenode encryption > getFileEncryptionInfo should return quickly for

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Attachment: HDFS-10458.00.patch {{trunk}} already has a method to get number of EZs without locking.

[jira] [Updated] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

[ https://issues.apache.org/jira/browse/HDFS-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10458: - Status: Patch Available (was: Open) > getFileEncryptionInfo should return quickly for non-encrypted

[jira] [Created] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

Zhe Zhang created HDFS-10458: Summary: getFileEncryptionInfo should return quickly for non-encrypted cluster Key: HDFS-10458 URL: https://issues.apache.org/jira/browse/HDFS-10458 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298604#comment-15298604 ] Zhe Zhang commented on HDFS-10301: -- [~cmccabe] Just a quick note that it's a new JIRA rule that you have

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292351#comment-15292351 ] Zhe Zhang commented on HDFS-7240: - Thanks for the discussions [~andrew.wang] [~anu]. I'm still trying to

[jira] [Updated] (HDFS-10172) hdfs erasurecode command should remove the redundant -usage option

[ https://issues.apache.org/jira/browse/HDFS-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10172: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-10172) hdfs erasurecode command should remove the redundant -usage option

[ https://issues.apache.org/jira/browse/HDFS-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10172: - Hadoop Flags: Reviewed Thanks [~yuanbo]! Patch 02 LGTM, +1 and I'm committing to trunk shortly. > hdfs

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277091#comment-15277091 ] Zhe Zhang commented on HDFS-9924: - Echoing Andrew that a design doc should be added. In particular, does

[jira] [Updated] (HDFS-10368) Erasure Coding: Deprecate replication-related config keys

[ https://issues.apache.org/jira/browse/HDFS-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10368: - Labels: hdfs-ec-3.0-must-do (was: ) > Erasure Coding: Deprecate replication-related config keys >

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9869: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Committed

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9869: Hadoop Flags: Reviewed Thanks Rakesh for the update. +1 on the latest patch. Committing to trunk shortly.

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252320#comment-15252320 ] Zhe Zhang commented on HDFS-9806: - Thanks Chris, I think we were drafting comments at same time :) Looking

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252312#comment-15252312 ] Zhe Zhang commented on HDFS-9806: - Thanks [~cnauroth] for the discussion! Yes, HADOOP-12077 and my PoC are

[jira] [Commented] (HDFS-10172) hdfs erasurecode command should remove the redundant -usage option

[ https://issues.apache.org/jira/browse/HDFS-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251428#comment-15251428 ] Zhe Zhang commented on HDFS-10172: -- Thanks for checking all Jenkins test failures Yuanbo. Yes I believe

[jira] [Commented] (HDFS-9806) Allow HDFS block replicas to be provided by an external storage system

[ https://issues.apache.org/jira/browse/HDFS-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250993#comment-15250993 ] Zhe Zhang commented on HDFS-9806: - Thanks [~chris.douglas] for proposing the work and [~virajith] for the

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249363#comment-15249363 ] Zhe Zhang commented on HDFS-9869: - bq. How about keeping only the recent property name |

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246771#comment-15246771 ] Zhe Zhang commented on HDFS-9869: - Thanks Rakesh for the update. Path LGTM overall. A few remaining minor

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245203#comment-15245203 ] Zhe Zhang commented on HDFS-7859: - Thanks Kia and Rakesh for reactivating the discussion. I agree that at

[jira] [Updated] (HDFS-8430) Erasure coding: compute file checksum for stripe files

[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8430: Labels: hdfs-ec-3.0-must-do (was: ) > Erasure coding: compute file checksum for stripe files >

[jira] [Commented] (HDFS-10172) hdfs erasurecode command should remove the redundant -usage option

[ https://issues.apache.org/jira/browse/HDFS-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238063#comment-15238063 ] Zhe Zhang commented on HDFS-10172: -- Thanks Wei-Chiu for reporting the issue and Yuanbo for the fix.

[jira] [Updated] (HDFS-10172) hdfs erasurecode command should remove the redundant -usage option

[ https://issues.apache.org/jira/browse/HDFS-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10172: - Component/s: erasure-coding > hdfs erasurecode command should remove the redundant -usage option >

[jira] [Updated] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9918: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9869: Labels: hdfs-ec-3.0-must-do (was: ) > Erasure Coding: Rename replication-based names in BlockManager to

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231367#comment-15231367 ] Zhe Zhang commented on HDFS-7661: - Thanks for the helpful discussion [~drankye], [~tlipcon]. I agree that

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229367#comment-15229367 ] Zhe Zhang commented on HDFS-7661: - Addressing Mingliang's analysis first: bq. what if the writer fails

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227406#comment-15227406 ] Zhe Zhang commented on HDFS-7661: - Thanks for the discussions [~demongaorui], [~jingzhao], [~liuml07].

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227376#comment-15227376 ] Zhe Zhang commented on HDFS-9918: - bq. That's why I don't see the point maintain the order (of the

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222637#comment-15222637 ] Zhe Zhang commented on HDFS-7661: - Thanks for sharing the thoughts [~demongaorui]. Having 2 versions of

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219079#comment-15219079 ] Zhe Zhang commented on HDFS-8498: - I'm OK with closing as won't fix, if Daryn hasn't seen new occurrences

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218965#comment-15218965 ] Zhe Zhang commented on HDFS-9918: - In my original comment when I said preserving index ordering, I meant

[jira] [Commented] (HDFS-7661) [umbrella] support hflush and hsync for erasure coded files

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217030#comment-15217030 ] Zhe Zhang commented on HDFS-7661: - Thanks for the discussions [~demongaorui], [~liuml07], [~szetszwo]. I

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216891#comment-15216891 ] Zhe Zhang commented on HDFS-9869: - Thanks for the work Rakesh. A few minor issues: # Some getter names are

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216846#comment-15216846 ] Zhe Zhang commented on HDFS-9918: - Thanks for the discussion [~walter.k.su] and [~rakeshr]. Below is my

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214940#comment-15214940 ] Zhe Zhang commented on HDFS-9918: - Thanks for the update Rakesh. {code} // FSNamesystem#getBlockLocations

[jira] [Commented] (HDFS-9918) Erasure Coding: Sort located striped blocks based on decommissioned states

[ https://issues.apache.org/jira/browse/HDFS-9918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213861#comment-15213861 ] Zhe Zhang commented on HDFS-9918: - Thanks for the update Rakesh. I'm still working on the review but 2

<    1   2   3   4   5   6   7   8   9   10   >