[jira] [Created] (HDFS-6057) DomainSocketWatcher.watcherThread should be marked as daemon thread

Eric Sirianni created HDFS-6057: --- Summary: DomainSocketWatcher.watcherThread should be marked as daemon thread Key: HDFS-6057 URL: https://issues.apache.org/jira/browse/HDFS-6057 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13905856#comment-13905856 ] Eric Sirianni commented on HDFS-5318: - For

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318-trunk-c.patch Updated patch with fix for {{TestBalancerWithNodeGroup}}.

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13905906#comment-13905906 ] Eric Sirianni commented on HDFS-5318: - Thanks [~andrew.wang]. I suspected the same

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13904492#comment-13904492 ] Eric Sirianni commented on HDFS-5318: - bq. It looks like read-only storages don't get

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318-trunkb.patch Updated patch based on Arpit's feedback. Support read-only and

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318-trunk.patch Regenerated patch file against trunk. Support read-only and

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13893417#comment-13893417 ] Eric Sirianni commented on HDFS-5318: - Arpit - have you had a chance to review the

[jira] [Updated] (HDFS-5868) Make hsync implementation pluggable

[ https://issues.apache.org/jira/browse/HDFS-5868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5868: Issue Type: Sub-task (was: Bug) Parent: HDFS-5194 Make hsync implementation pluggable

[jira] [Commented] (HDFS-5194) Robust support for alternate FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13893479#comment-13893479 ] Eric Sirianni commented on HDFS-5194: - I have converted HDFS-5868 to a subtask of this

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318c-branch-2.patch Support read-only and read-write paths to shared replicas

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879232#comment-13879232 ] Eric Sirianni commented on HDFS-5318: - Arpit - thanks for the quick feedback. Unless

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873518#comment-13873518 ] Eric Sirianni commented on HDFS-5318: - Hi Arpit - would appreciate any feedback you

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318b-branch-2.patch Update patch. Add overload to {{BlocksMap.getStorages()}}

[jira] [Created] (HDFS-5792) DFSOutputStream.close() throws exceptions with unintuitive stacktraces

Eric Sirianni created HDFS-5792: --- Summary: DFSOutputStream.close() throws exceptions with unintuitive stacktraces Key: HDFS-5792 URL: https://issues.apache.org/jira/browse/HDFS-5792 Project: Hadoop

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874026#comment-13874026 ] Eric Sirianni commented on HDFS-5434: - Arpit - after some discussion, Buddy and I

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13870755#comment-13870755 ] Eric Sirianni commented on HDFS-5318: - Arpit - are you ok if I create a sub-JIRA for

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Summary: Support read-only and read-write paths to shared replicas (was: Pluggable interface for

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318a-branch-2.patch Patch file implementing changes as discussed in JIRA. *

[jira] [Created] (HDFS-5769) Bootstrap a write pipeline from read-only replicas

Eric Sirianni created HDFS-5769: --- Summary: Bootstrap a write pipeline from read-only replicas Key: HDFS-5769 URL: https://issues.apache.org/jira/browse/HDFS-5769 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1387#comment-1387 ] Eric Sirianni commented on HDFS-5318: - bq. 1. Block is finalized, r/w replica is lost,

[jira] [Commented] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867939#comment-13867939 ] Eric Sirianni commented on HDFS-5483: - Arpit - I applied the patch in our environment

[jira] [Commented] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867031#comment-13867031 ] Eric Sirianni commented on HDFS-5483: - This {{BLOCK_RECEIVED}} code path appears to

[jira] [Commented] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867078#comment-13867078 ] Eric Sirianni commented on HDFS-5318: - I will work on a patch that addresses your

[jira] [Commented] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867102#comment-13867102 ] Eric Sirianni commented on HDFS-5483: - OK - thanks, missed that guard. {code} boolean

[jira] [Commented] (HDFS-5483) NN should gracefully handle multiple block replicas on same DN

[ https://issues.apache.org/jira/browse/HDFS-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865782#comment-13865782 ] Eric Sirianni commented on HDFS-5483: - Arpit - I noticed that the supplied patch only

[jira] [Commented] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13861572#comment-13861572 ] Eric Sirianni commented on HDFS-5667: - [~arpitagarwal], do you plan to commit this fix

[jira] [Commented] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13854130#comment-13854130 ] Eric Sirianni commented on HDFS-5318: - bq. Eric, your patch is implementing existing NN

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13854393#comment-13854393 ] Eric Sirianni commented on HDFS-5434: - bq. But the propose solution should work in that

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13854521#comment-13854521 ] Eric Sirianni commented on HDFS-5434: - bq. But the propose solution should work in that

[jira] [Commented] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13854540#comment-13854540 ] Eric Sirianni commented on HDFS-5318: - bq. If there is just one read-write logical

[jira] [Updated] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: hdfs-5318.pdf Attaching design document for pluggable replica counting. Pluggable

[jira] [Updated] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: (was: hdfs-5318.pdf) Pluggable interface for replica counting

[jira] [Updated] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318.patch Pluggable interface for replica counting

[jira] [Updated] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: hdfs-5318.pdf Pluggable interface for replica counting

[jira] [Updated] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: (was: HDFS-5318.patch) Pluggable interface for replica counting

[jira] [Updated] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318.patch Pluggable interface for replica counting

[jira] [Updated] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Status: Patch Available (was: Open) Pluggable interface for replica counting

[jira] [Commented] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13853096#comment-13853096 ] Eric Sirianni commented on HDFS-5667: - I applied the patch to my environment and can

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13853579#comment-13853579 ] Eric Sirianni commented on HDFS-5434: - Good question! To be frank, we haven't fully

[jira] [Created] (HDFS-5680) Double-JSON-encoding of JMX attributes yields malformed JSON

Eric Sirianni created HDFS-5680: --- Summary: Double-JSON-encoding of JMX attributes yields malformed JSON Key: HDFS-5680 URL: https://issues.apache.org/jira/browse/HDFS-5680 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5667) Include DatanodeStorage in StorageReport

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852410#comment-13852410 ] Eric Sirianni commented on HDFS-5667: - [~arpitagarwal], I'll apply the patch and try it

[jira] [Commented] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850474#comment-13850474 ] Eric Sirianni commented on HDFS-5442: - bq. Another place which would need more

[jira] [Commented] (HDFS-5667) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850917#comment-13850917 ] Eric Sirianni commented on HDFS-5667: - Haven't had a chance yet - please go ahead and

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13849701#comment-13849701 ] Eric Sirianni commented on HDFS-5434: - Thanks everyone for all the good technical

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13848363#comment-13848363 ] Eric Sirianni commented on HDFS-5434: - bq. I sort of assumed when I read this JIRA that

[jira] [Commented] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13847588#comment-13847588 ] Eric Sirianni commented on HDFS-5484: - This fix was basically nullified by the

[jira] [Created] (HDFS-5667) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

Eric Sirianni created HDFS-5667: --- Summary: StorageType and State in DatanodeStorageInfo in NameNode is not accurate Key: HDFS-5667 URL: https://issues.apache.org/jira/browse/HDFS-5667 Project: Hadoop

[jira] [Updated] (HDFS-5667) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5667: Description: The fix for HDFS-5484 was accidentally regressed by the following change made via

[jira] [Updated] (HDFS-5667) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5667: Description: The fix for HDFS-5484 was accidentally regressed by the following change made via

[jira] [Updated] (HDFS-5318) Pluggable interface for replica counting

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Summary: Pluggable interface for replica counting (was: Account for shared storage in NameNode

[jira] [Commented] (HDFS-5454) DataNode UUID should be assigned prior to FsDataset initialization

[ https://issues.apache.org/jira/browse/HDFS-5454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846763#comment-13846763 ] Eric Sirianni commented on HDFS-5454: - +1 for the patch. I've made a similar change

[jira] [Commented] (HDFS-5318) Account for shared storage in NameNode replica counting algorithm

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13843254#comment-13843254 ] Eric Sirianni commented on HDFS-5318: - bq. Currently core Hadoop probably does not

[jira] [Updated] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5484: Attachment: HDFS-5484-HDFS-2832.patch Updated patch file addressing review comments. I spent some

[jira] [Updated] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5484: Attachment: (was: HDFS-5484-HDFS-2832.patch) StorageType and State in DatanodeStorageInfo in

[jira] [Updated] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5484: Attachment: HDFS-5484-HDFS-2832--2.patch Regenerated patch against latest commit in HDFS-2832

[jira] [Updated] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5484: Attachment: HDFS-5484-HDFS-2832.patch StorageType and State in DatanodeStorageInfo in NameNode is

[jira] [Updated] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5484: Target Version/s: Heterogeneous Storage (HDFS-2832) Status: Patch Available (was:

[jira] [Commented] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827678#comment-13827678 ] Eric Sirianni commented on HDFS-5484: - It appears that Jenkins tried to apply the patch

[jira] [Commented] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

[ https://issues.apache.org/jira/browse/HDFS-5484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827928#comment-13827928 ] Eric Sirianni commented on HDFS-5484: - Sure. I will make those changes and re-upload

[jira] [Created] (HDFS-5505) DataStorage.format() should ignore NamespaceID

Eric Sirianni created HDFS-5505: --- Summary: DataStorage.format() should ignore NamespaceID Key: HDFS-5505 URL: https://issues.apache.org/jira/browse/HDFS-5505 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-5484) StorageType and State in DatanodeStorageInfo in NameNode is not accurate

Eric Sirianni created HDFS-5484: --- Summary: StorageType and State in DatanodeStorageInfo in NameNode is not accurate Key: HDFS-5484 URL: https://issues.apache.org/jira/browse/HDFS-5484 Project: Hadoop

[jira] [Resolved] (HDFS-5462) Fail to compile in Branch HDFS-2832 with COMPILATION ERROR

[ https://issues.apache.org/jira/browse/HDFS-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni resolved HDFS-5462. - Resolution: Fixed Fail to compile in Branch HDFS-2832 with COMPILATION ERROR

[jira] [Commented] (HDFS-5462) Fail to compile in Branch HDFS-2832 with COMPILATION ERROR

[ https://issues.apache.org/jira/browse/HDFS-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813942#comment-13813942 ] Eric Sirianni commented on HDFS-5462: - There seems to be an issue in the

[jira] [Commented] (HDFS-5448) Datanode should generate its ID on first registration

[ https://issues.apache.org/jira/browse/HDFS-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13812838#comment-13812838 ] Eric Sirianni commented on HDFS-5448: - bq. Eric Sirianni, I believe this is not very

[jira] [Commented] (HDFS-5448) Datanode should generate its ID on first registration

[ https://issues.apache.org/jira/browse/HDFS-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13812914#comment-13812914 ] Eric Sirianni commented on HDFS-5448: - Arpit - I think your patch causes a compile

[jira] [Commented] (HDFS-5448) Datanode should generate its ID on first registration

[ https://issues.apache.org/jira/browse/HDFS-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13812933#comment-13812933 ] Eric Sirianni commented on HDFS-5448: - +1 patch looks good. I made the same change in

[jira] [Commented] (HDFS-5448) Datanode should generate its ID on first registration

[ https://issues.apache.org/jira/browse/HDFS-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13812962#comment-13812962 ] Eric Sirianni commented on HDFS-5448: - Arpit - thanks for the change. The current

[jira] [Commented] (HDFS-5448) Datanode should generate its ID on first registration

[ https://issues.apache.org/jira/browse/HDFS-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13812989#comment-13812989 ] Eric Sirianni commented on HDFS-5448: - Actually, rather than having a potentially

[jira] [Created] (HDFS-5454) DataNode UUID should be assigned prior to FsDataset initialization

Eric Sirianni created HDFS-5454: --- Summary: DataNode UUID should be assigned prior to FsDataset initialization Key: HDFS-5454 URL: https://issues.apache.org/jira/browse/HDFS-5454 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13811517#comment-13811517 ] Eric Sirianni commented on HDFS-5434: - We are proposing the default for

[jira] [Commented] (HDFS-5448) Synchronize NN registrations across BPServiceActors

[ https://issues.apache.org/jira/browse/HDFS-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13811610#comment-13811610 ] Eric Sirianni commented on HDFS-5448: - An issue with relying on the NameNode handshake

[jira] [Updated] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5434: Description: If a file has a replica count of one, the HDFS client is exposed to write failures if

[jira] [Updated] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5434: Description: If a file has a replica count of one, the HDFS client is exposed to write failures if

[jira] [Updated] (HDFS-5434) Write resiliency for replica count 1

[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5434: Description: If a file has a replica count of one, the HDFS client is exposed to write failures if

[jira] [Created] (HDFS-5380) NameNode returns stale block locations to clients during excess replica pruning

Eric Sirianni created HDFS-5380: --- Summary: NameNode returns stale block locations to clients during excess replica pruning Key: HDFS-5380 URL: https://issues.apache.org/jira/browse/HDFS-5380 Project:

[jira] [Updated] (HDFS-5380) NameNode returns stale block locations to clients during excess replica pruning

[ https://issues.apache.org/jira/browse/HDFS-5380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5380: Attachment: ExcessReplicaPruningTest.java JUnit test that demonstrates this issue using

[jira] [Updated] (HDFS-5380) NameNode returns stale block locations to clients during excess replica pruning

[ https://issues.apache.org/jira/browse/HDFS-5380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5380: Description: Consider the following contrived example: {code} // Step 1: Create file with

[jira] [Updated] (HDFS-5380) NameNode returns stale block locations to clients during excess replica pruning

[ https://issues.apache.org/jira/browse/HDFS-5380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5380: Description: Consider the following contrived example: {code} // Step 1: Create file with

[jira] [Created] (HDFS-5318) Account for shared storage in NameNode replica counting algorithm

Eric Sirianni created HDFS-5318: --- Summary: Account for shared storage in NameNode replica counting algorithm Key: HDFS-5318 URL: https://issues.apache.org/jira/browse/HDFS-5318 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5318) Account for shared storage in NameNode replica counting algorithm

[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Description: There are several use cases for using shared-storage for datanode block storage in an

[jira] [Commented] (HDFS-5183) Combine ReplicaPlacementPolicy with VolumeChoosingPolicy together to have a global view in choosing DN storage for replica.

[ https://issues.apache.org/jira/browse/HDFS-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764311#comment-13764311 ] Eric Sirianni commented on HDFS-5183: - Copying over my feedback from HDFS-5157: bq. I

[jira] [Commented] (HDFS-5157) Datanode should allow choosing the target storage

[ https://issues.apache.org/jira/browse/HDFS-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763173#comment-13763173 ] Eric Sirianni commented on HDFS-5157: - For full disclosure, my group is working on

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13759132#comment-13759132 ] Eric Sirianni commented on HDFS-2832: - Arpit and team - nice document. A few questions

[jira] [Updated] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-4898: Assignee: Tsz Wo (Nicholas), SZE (was: Eric Sirianni)

[jira] [Updated] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-4898: Attachment: (was: HDFS-4898.patch) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack()

[jira] [Updated] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-4898: Attachment: HDFS-4898.patch Patch to BlockPlacementPolicyWithNodeGroup

[jira] [Commented] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732049#comment-13732049 ] Eric Sirianni commented on HDFS-4898: - Sorry - let me regenerate the patch against

[jira] [Updated] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-4898: Attachment: (was: HDFS-4898.patch) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack()

[jira] [Updated] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-4898: Attachment: HDFS-4898.patch Patch generated against trunk with {{--no-prefix}} option.

[jira] [Commented] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729489#comment-13729489 ] Eric Sirianni commented on HDFS-4898: - Thanks Nicholas - yes, I will update the patch

[jira] [Created] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

Eric Sirianni created HDFS-4898: --- Summary: BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack Key: HDFS-4898 URL: https://issues.apache.org/jira/browse/HDFS-4898

[jira] [Updated] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-4898: Status: Patch Available (was: Open) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack()

[jira] [Updated] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-4898: Status: Open (was: Patch Available) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack()

[jira] [Updated] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-4898: Status: Patch Available (was: Open) {noformat} index 8cb072b..302981f 100644 ---