[jira] [Commented] (HDFS-8690) LeaseRenewer should not abort DFSClient when renew fails

[ https://issues.apache.org/jira/browse/HDFS-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615624#comment-14615624 ] Colin Patrick McCabe commented on HDFS-8690: Daryn (or Ming), if you want to

[jira] [Commented] (HDFS-8690) LeaseRenewer should not abort DFSClient when renew fails

[ https://issues.apache.org/jira/browse/HDFS-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608866#comment-14608866 ] Colin Patrick McCabe commented on HDFS-8690: I do think it's odd to abort on

[jira] [Commented] (HDFS-8635) Migrate HDFS native build to new CMake framework

[ https://issues.apache.org/jira/browse/HDFS-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609222#comment-14609222 ] Colin Patrick McCabe commented on HDFS-8635: +1. Thanks, [~alanburlison].

[jira] [Updated] (HDFS-8635) Migrate HDFS native build to new CMake framework

[ https://issues.apache.org/jira/browse/HDFS-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8635: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Commented] (HDFS-8659) Block scanner INFO message is spamming logs

[ https://issues.apache.org/jira/browse/HDFS-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606127#comment-14606127 ] Colin Patrick McCabe commented on HDFS-8659: +1. Thanks, [~yzhangal]. Block

[jira] [Commented] (HDFS-8681) BlockScanner is incorrectly disabled by default

[ https://issues.apache.org/jira/browse/HDFS-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606274#comment-14606274 ] Colin Patrick McCabe commented on HDFS-8681: +1. Thanks, guys. BlockScanner

[jira] [Updated] (HDFS-8651) Make hadoop-hdfs-project Native code -Wall-clean

[ https://issues.apache.org/jira/browse/HDFS-8651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8651: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8659) Block scanner INFO message is spamming logs

[ https://issues.apache.org/jira/browse/HDFS-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602173#comment-14602173 ] Colin Patrick McCabe commented on HDFS-8659: The if statements should not be

[jira] [Commented] (HDFS-8646) Prune cached replicas from DatanodeDescriptor state on replica invalidation

[ https://issues.apache.org/jira/browse/HDFS-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14599869#comment-14599869 ] Colin Patrick McCabe commented on HDFS-8646: +1. Thanks, [~andrew.wang].

[jira] [Commented] (HDFS-8651) Make hadoop-hdfs-project Native code -Wall-clean

[ https://issues.apache.org/jira/browse/HDFS-8651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14599942#comment-14599942 ] Colin Patrick McCabe commented on HDFS-8651: +1. Thanks, [~alanburlison].

[jira] [Updated] (HDFS-8651) Make hadoop-hdfs-project Native code -Wall-clean

[ https://issues.apache.org/jira/browse/HDFS-8651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8651: --- Target Version/s: 2.8.0 Status: Patch Available (was: Open) Make

[jira] [Commented] (HDFS-8646) Prune cached replicas from DatanodeDescriptor state on replica invalidation

[ https://issues.apache.org/jira/browse/HDFS-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598172#comment-14598172 ] Colin Patrick McCabe commented on HDFS-8646: Thanks, [~andrew.wang]. Looks

[jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8480: --- Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8480: --- Summary: Fix performance and timeout issues in HDFS-7929 by using hard-links to

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596671#comment-14596671 ] Colin Patrick McCabe commented on HDFS-8480: Thanks, [~zhz]. +1. Fix

[jira] [Commented] (HDFS-8617) Throttle DiskChecker#checkDirs() speed.

[ https://issues.apache.org/jira/browse/HDFS-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596369#comment-14596369 ] Colin Patrick McCabe commented on HDFS-8617: Andrew and I actually benchmarked

[jira] [Updated] (HDFS-8582) Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8582: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 (was:

[jira] [Updated] (HDFS-8582) Support getting a list of reconfigurable configuration properties and do not generate spurious reconfig warnings

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8582: --- Summary: Support getting a list of reconfigurable configuration properties and do not

[jira] [Updated] (HDFS-8582) Support getting a list of reconfigurable properties and do not log spurious warnings

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8582: --- Summary: Support getting a list of reconfigurable properties and do not log spurious

[jira] [Updated] (HDFS-8582) Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8582: --- Summary: Support getting a list of reconfigurable config properties and do not

[jira] [Commented] (HDFS-8582) Reduce failure messages when running datanode reconfiguration

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594296#comment-14594296 ] Colin Patrick McCabe commented on HDFS-8582: +1. Thanks, Eddy. Reduce

[jira] [Updated] (HDFS-8582) Support getting a list of reconfigurable configuration properties and do not log spurious warnings

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8582: --- Summary: Support getting a list of reconfigurable configuration properties and do not

[jira] [Commented] (HDFS-8582) Reduce failure messages when running datanode reconfiguration

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592857#comment-14592857 ] Colin Patrick McCabe commented on HDFS-8582: Thanks, Eddy. Looks good. {code}

[jira] [Comment Edited] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590910#comment-14590910 ] Colin Patrick McCabe edited comment on HDFS-8578 at 6/18/15 12:29 AM:

[jira] [Updated] (HDFS-8589) Fix unused imports in BPServiceActor and BlockReportLeaseManager

[ https://issues.apache.org/jira/browse/HDFS-8589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8589: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590910#comment-14590910 ] Colin Patrick McCabe commented on HDFS-8578: bq. Any concerns about overloading

[jira] [Commented] (HDFS-8246) Get HDFS file name based on block pool id and block id

[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590879#comment-14590879 ] Colin Patrick McCabe commented on HDFS-8246: I agree that fsck solves the admin

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590891#comment-14590891 ] Colin Patrick McCabe commented on HDFS-8480: Hi [~zhz], We have to distinguish

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590925#comment-14590925 ] Colin Patrick McCabe commented on HDFS-8578: bq. Just realized that,

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588819#comment-14588819 ] Colin Patrick McCabe commented on HDFS-7923: This change is important for

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588686#comment-14588686 ] Colin Patrick McCabe commented on HDFS-7923: BTW it would be relatively easy to

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588663#comment-14588663 ] Colin Patrick McCabe commented on HDFS-7923: Starvation is not a real concern

[jira] [Comment Edited] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588663#comment-14588663 ] Colin Patrick McCabe edited comment on HDFS-7923 at 6/16/15 8:14 PM:

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589157#comment-14589157 ] Colin Patrick McCabe commented on HDFS-7923: bq. Can a DN's block report be

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586471#comment-14586471 ] Colin Patrick McCabe commented on HDFS-8578: Hi [~vinayrpet],

[jira] [Commented] (HDFS-8591) Remove support for deprecated configuration key dfs.namenode.decommission.nodes.per.interval

[ https://issues.apache.org/jira/browse/HDFS-8591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586418#comment-14586418 ] Colin Patrick McCabe commented on HDFS-8591: +1. Thanks, [~andrew.wang].

[jira] [Commented] (HDFS-8582) Reduce failure messages when running datanode reconfiguration

[ https://issues.apache.org/jira/browse/HDFS-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586440#comment-14586440 ] Colin Patrick McCabe commented on HDFS-8582: I think it's a good idea to have a

[jira] [Created] (HDFS-8589) Fix unused imports in BPServiceActor and BlockReportLeaseManager

Colin Patrick McCabe created HDFS-8589: -- Summary: Fix unused imports in BPServiceActor and BlockReportLeaseManager Key: HDFS-8589 URL: https://issues.apache.org/jira/browse/HDFS-8589 Project:

[jira] [Updated] (HDFS-8589) Fix unused imports in BPServiceActor and BlockReportLeaseManager

[ https://issues.apache.org/jira/browse/HDFS-8589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8589: --- Attachment: HDFS-8589.001.patch Fix unused imports in BPServiceActor and

[jira] [Updated] (HDFS-8589) Fix unused imports in BPServiceActor and BlockReportLeaseManager

[ https://issues.apache.org/jira/browse/HDFS-8589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8589: --- Status: Patch Available (was: Open) Fix unused imports in BPServiceActor and

[jira] [Updated] (HDFS-8589) Fix unused imports in BPServiceActor and BlockReportLeaseManager

[ https://issues.apache.org/jira/browse/HDFS-8589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8589: --- Target Version/s: 2.8.0 Affects Version/s: 2.8.0 Fix unused imports in

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-8566) HDFS documentation about debug commands wrongly identifies them as hdfs dfs commands

[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8566: --- Summary: HDFS documentation about debug commands wrongly identifies them as hdfs dfs

[jira] [Commented] (HDFS-8566) HDFS debug Command usage is wrong.

[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582520#comment-14582520 ] Colin Patrick McCabe commented on HDFS-8566: +1. Thanks, [~surendrasingh].

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582517#comment-14582517 ] Colin Patrick McCabe commented on HDFS-8564: Another possibility would be to

[jira] [Updated] (HDFS-8566) HDFS documentation about debug commands wrongly identifies them as hdfs dfs commands

[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8566: --- Resolution: Fixed Fix Version/s: 2.7.1 Target Version/s: 2.7.1

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: HDFS-7923.007.patch The DataNodes should rate-limit their full block

[jira] [Commented] (HDFS-8549) Abort the balancer if an upgrade is in progress

[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578019#comment-14578019 ] Colin Patrick McCabe commented on HDFS-8549: So I guess the idea here is that

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577986#comment-14577986 ] Colin Patrick McCabe commented on HDFS-7923: New patch fixes unit test

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14577993#comment-14577993 ] Colin Patrick McCabe commented on HDFS-8480: +1, pending adding the unit test

[jira] [Commented] (HDFS-8246) Get HDFS file name based on block pool id and block id

[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14578122#comment-14578122 ] Colin Patrick McCabe commented on HDFS-8246: I think this API should be

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575058#comment-14575058 ] Colin Patrick McCabe commented on HDFS-7923: bq. Should the checkLease logs be

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: HDFS-7923.006.patch I need to make sure to treat the initial block report

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: HDFS-7923.005.patch The DataNodes should rate-limit their full block

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: (was: HDFS-7923.005.patch) The DataNodes should rate-limit their full

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573947#comment-14573947 ] Colin Patrick McCabe commented on HDFS-8480: Maybe I can take a look in a

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8486: --- Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8521: --- Attachment: HDFS-8521.001.patch Add @VisibleForTesting annotation to

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569547#comment-14569547 ] Colin Patrick McCabe commented on HDFS-8486: Since the only change I was

[jira] [Created] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

Colin Patrick McCabe created HDFS-8521: -- Summary: Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}} Key: HDFS-8521 URL: https://issues.apache.org/jira/browse/HDFS-8521

[jira] [Updated] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8521: --- Assignee: Colin Patrick McCabe Target Version/s: 2.8.0 Affects

[jira] [Commented] (HDFS-8513) Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant

[ https://issues.apache.org/jira/browse/HDFS-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569705#comment-14569705 ] Colin Patrick McCabe commented on HDFS-8513: +1. Rename

[jira] [Updated] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8521: --- Resolution: Fixed Fix Version/s: 2.7.1 Target Version/s: 2.7.1 (was:

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570203#comment-14570203 ] Colin Patrick McCabe commented on HDFS-7240: Thanks, Jitendra. I think it

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568046#comment-14568046 ] Colin Patrick McCabe commented on HDFS-8486: Great find, [~daryn]. And nice

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568408#comment-14568408 ] Colin Patrick McCabe commented on HDFS-7240: Hi [~jnp], Thanks for organizing

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565561#comment-14565561 ] Colin Patrick McCabe commented on HDFS-7923: bq. Missing config key

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: HDFS-7923.004.patch The DataNodes should rate-limit their full block

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Target Version/s: 2.8.0 Affects Version/s: 2.8.0 Status: Patch

[jira] [Updated] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8407: --- Summary: hdfsListDirectory must set errno to 0 on success (was: libhdfs

[jira] [Updated] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8429: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Updated] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8407: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563399#comment-14563399 ] Colin Patrick McCabe commented on HDFS-8401: bq. Allow using memory features

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563456#comment-14563456 ] Colin Patrick McCabe commented on HDFS-7923: I posted a new patch with some

[jira] [Updated] (HDFS-8429) Avoid stuck threads if there is a fatal error in DomainSocketWatcher

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8429: --- Summary: Avoid stuck threads if there is a fatal error in DomainSocketWatcher (was:

[jira] [Updated] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8429: --- Summary: Avoid stuck threads if there is an error in DomainSocketWatcher that stops

[jira] [Commented] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560184#comment-14560184 ] Colin Patrick McCabe commented on HDFS-7929: The time needed to copy over the

[jira] [Commented] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559753#comment-14559753 ] Colin Patrick McCabe commented on HDFS-8407: +1 pending jenkins. Thanks,

[jira] [Updated] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8407: --- Target Version/s: 2.8.0 Status: Patch Available (was: Open) libhdfs

[jira] [Commented] (HDFS-8429) Death of watcherThread making other local read blocked

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559778#comment-14559778 ] Colin Patrick McCabe commented on HDFS-8429: One thing that I am concerned

[jira] [Updated] (HDFS-8429) The DomainSocketWatcher thread should not block other threads if it dies

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8429: --- Summary: The DomainSocketWatcher thread should not block other threads if it dies

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559707#comment-14559707 ] Colin Patrick McCabe commented on HDFS-8078: Thanks, [~nkedel]. I understand

[jira] [Commented] (HDFS-6022) Moving deadNodes from being thread local. Improving dead datanode handling in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559892#comment-14559892 ] Colin Patrick McCabe commented on HDFS-6022: Hi [~iwasakims], feel free to take

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: HDFS-7923.003.patch The DataNodes should rate-limit their full block

[jira] [Assigned] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-7923: -- Assignee: Colin Patrick McCabe (was: Charles Lamb) The DataNodes should

[jira] [Created] (HDFS-8469) Lockfiles are not being created for datanode storage directories

Colin Patrick McCabe created HDFS-8469: -- Summary: Lockfiles are not being created for datanode storage directories Key: HDFS-8469 URL: https://issues.apache.org/jira/browse/HDFS-8469 Project:

[jira] [Commented] (HDFS-8469) Lockfiles are not being created for datanode storage directories

[ https://issues.apache.org/jira/browse/HDFS-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556632#comment-14556632 ] Colin Patrick McCabe commented on HDFS-8469: It looks like this behavior was

[jira] [Updated] (HDFS-8469) Lockfiles are not being created for datanode storage directories

[ https://issues.apache.org/jira/browse/HDFS-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8469: --- Affects Version/s: 2.4.0 Lockfiles are not being created for datanode storage

[jira] [Updated] (HDFS-8469) Lockfiles are not being created for datanode storage directories

[ https://issues.apache.org/jira/browse/HDFS-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8469: --- Status: Patch Available (was: Open) Lockfiles are not being created for datanode

[jira] [Updated] (HDFS-8469) Lockfiles are not being created for datanode storage directories

[ https://issues.apache.org/jira/browse/HDFS-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8469: --- Attachment: HDFS-8469.001.patch Lockfiles are not being created for datanode storage

[jira] [Commented] (HDFS-8429) Death of watcherThread making other local read blocked

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14552875#comment-14552875 ] Colin Patrick McCabe commented on HDFS-8429: Thanks. We shouldn't need to

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14551292#comment-14551292 ] Colin Patrick McCabe commented on HDFS-8078: It seems like it would be better

[jira] [Commented] (HDFS-8401) Memfs - a layered file system for in-memory storage in HDFS

[ https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14551193#comment-14551193 ] Colin Patrick McCabe commented on HDFS-8401: Hi [~aagarwal], I'm not sure I

[jira] [Commented] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14551225#comment-14551225 ] Colin Patrick McCabe commented on HDFS-8407: Thanks for looking at this,

[jira] [Commented] (HDFS-8429) Death of watcherThread making other local read blocked

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14551311#comment-14551311 ] Colin Patrick McCabe commented on HDFS-8429: It's very surprising that you

[jira] [Commented] (HDFS-5270) Use thread pools in the datenode daemons

[ https://issues.apache.org/jira/browse/HDFS-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14551023#comment-14551023 ] Colin Patrick McCabe commented on HDFS-5270: Thanks for looking at this,

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544212#comment-14544212 ] Colin Patrick McCabe commented on HDFS-8157: I still don't understand why we

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544725#comment-14544725 ] Colin Patrick McCabe commented on HDFS-7240: Thanks, [~jnp]. June 3rd at 1pm

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544742#comment-14544742 ] Colin Patrick McCabe commented on HDFS-8157: Thanks for the clarification. If

[jira] [Commented] (HDFS-8380) Always call addStoredBlock on blocks which have been shifted from one storage to another

[ https://issues.apache.org/jira/browse/HDFS-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14542763#comment-14542763 ] Colin Patrick McCabe commented on HDFS-8380: HDFS-7980 is also a fix for this,

<    3   4   5   6   7   8   9   10   11   12   >