[jira] [Commented] (HDFS-11828) [READ] Refactor FsDatasetImpl to use the BlockAlias from ClientProtocol for PROVIDED blocks.

2017-08-22 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137942#comment-16137942 ] Virajith Jalaparti commented on HDFS-11828: --- [~ehiggs], Similar to HDFS-11639, we can make this

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137938#comment-16137938 ] Hadoop QA commented on HDFS-12283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11639) [READ] Encode the BlockAlias in the client protocol

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137939#comment-16137939 ] Hadoop QA commented on HDFS-11639: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11639) [READ] Encode the BlockAlias in the client protocol

2017-08-22 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137937#comment-16137937 ] Virajith Jalaparti commented on HDFS-11639: --- Hi [~ehiggs], As this change is required only for

[jira] [Comment Edited] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137912#comment-16137912 ] Weiwei Yang edited comment on HDFS-12282 at 8/23/17 5:25 AM: - Ah [~anu], I

[jira] [Updated] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12327: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Comment Edited] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137912#comment-16137912 ] Weiwei Yang edited comment on HDFS-12282 at 8/23/17 5:24 AM: - Ah [~anu], I

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137912#comment-16137912 ] Weiwei Yang commented on HDFS-12282: Ah [~anu], I think you are right, this worker thread processes HB

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137899#comment-16137899 ] Weiwei Yang commented on HDFS-12327: +1 to v3 patch, I will commit this shortly. > Ozone: support

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137891#comment-16137891 ] Anu Engineer commented on HDFS-12282: - bq. SCMNodeManager#handleHeartbeat is already a worker thread

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.16.patch Thanks a lot Wei-Chiu! Patch 16 to fix checkstyles, and edited a few log

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136469#comment-16136469 ] Xiao Chen edited comment on HDFS-10899 at 8/23/17 4:26 AM: --- bq.

[jira] [Commented] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137866#comment-16137866 ] John Zhuge commented on HDFS-12339: --- Thanks [~saileshpatel] for the great report with so much detail! >

[jira] [Updated] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12283: -- Attachment: HDFS-12283-HDFS-7240.008.patch fix the checkstyle issue. > Ozone: DeleteKey-5: Implement

[jira] [Updated] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-08-22 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12328: -- Description: In HDFS-12283, we set the value of count to -1 if blocks cannot be deleted after max

[jira] [Commented] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-22 Thread Sailesh Patel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137817#comment-16137817 ] Sailesh Patel commented on HDFS-12339: -- 2017-08-22 18:40:02,817 TRACE

[jira] [Created] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-22 Thread Sailesh Patel (JIRA)
Sailesh Patel created HDFS-12339: Summary: NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper Key: HDFS-12339 URL: https://issues.apache.org/jira/browse/HDFS-12339

[jira] [Comment Edited] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137598#comment-16137598 ] Uma Maheswara Rao G edited comment on HDFS-12225 at 8/23/17 1:21 AM: -

[jira] [Commented] (HDFS-12294) Let distcp to bypass external attribute provider when calling getFileStatus etc at source cluster

2017-08-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137676#comment-16137676 ] Chris Douglas commented on HDFS-12294: -- Replied on HDFS-12295, to keep the discussion in one place.

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137675#comment-16137675 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12295) NameNode to support file path prefix /.reserved/bypassExtAttr

2017-08-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137674#comment-16137674 ] Chris Douglas commented on HDFS-12295: -- If the subtree under {{/.reserved/bypassExtAttr}} is

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137598#comment-16137598 ] Uma Maheswara Rao G commented on HDFS-12225: Hi [~surendrasingh] thanks for updating the

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-11888-HDFS-7240.004.patch Patch 003 contains some unexpected YARN changes from

[jira] [Comment Edited] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137583#comment-16137583 ] Xiaoyu Yao edited comment on HDFS-11888 at 8/22/17 11:15 PM: - Patch 003

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137468#comment-16137468 ] Wei-Chiu Chuang edited comment on HDFS-10899 at 8/22/17 11:09 PM: -- Thanks

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-005.patch Fixing unit tests by adding back non-use metric. >

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137535#comment-16137535 ] Hadoop QA commented on HDFS-11888: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137490#comment-16137490 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137484#comment-16137484 ] Hadoop QA commented on HDFS-12334: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137468#comment-16137468 ] Wei-Chiu Chuang edited comment on HDFS-10899 at 8/22/17 9:55 PM: - Thanks

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137468#comment-16137468 ] Wei-Chiu Chuang commented on HDFS-10899: Thanks for the rev015 patch! Looks like all the concerns

[jira] [Created] (HDFS-12338) Ozone: SCM: clean up containers that timeout during creation

2017-08-22 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12338: - Summary: Ozone: SCM: clean up containers that timeout during creation Key: HDFS-12338 URL: https://issues.apache.org/jira/browse/HDFS-12338 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137393#comment-16137393 ] Hadoop QA commented on HDFS-11888: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-004.patch Fixing unit findbugs. > Federation Metrics >

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-22 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137312#comment-16137312 ] Mikhail Erofeev commented on HDFS-12292: Hey [~msingh], thank you. 1) The logic is as follows: if

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-08-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137268#comment-16137268 ] Kihwal Lee commented on HDFS-7967: -- [~djp], the progress is stalled because the replica triplet structure

[jira] [Comment Edited] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137266#comment-16137266 ] Chen Liang edited comment on HDFS-12334 at 8/22/17 7:38 PM: To trigger Jenkins

[jira] [Updated] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12334: -- Attachment: HDFS-12334-branch-2.002.patch To trigger Jenkins. > [branch-2] Add storage type demand to

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137253#comment-16137253 ] Anu Engineer commented on HDFS-11888: - +1, LGTM. I closely reviewed patch v2 and skimmed v3 since

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137233#comment-16137233 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-11888-HDFS-7240.003.patch > Ozone: SCM: use container state machine for open

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137215#comment-16137215 ] Xiaoyu Yao commented on HDFS-11888: --- Thanks [~vagarychen] for the review. I attached a new patch that

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-22 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137209#comment-16137209 ] Manoj Govindassamy commented on HDFS-12191: --- Thanks for working on this [~yzhangal]. My comments

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-11888-HDFS-7240.002.patch > Ozone: SCM: use container state machine for open

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: (was: HDFS-12181-HDFS-7240.002.patch) > Ozone: SCM: use container state machine for

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-12181-HDFS-7240.002.patch > Ozone: SCM: use container state machine for open

[jira] [Comment Edited] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137172#comment-16137172 ] Xiaoyu Yao edited comment on HDFS-11888 at 8/22/17 6:37 PM: Thanks [~anu] for

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137172#comment-16137172 ] Xiaoyu Yao commented on HDFS-11888: --- Thanks [~anu] for the detailed review. bq.

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137173#comment-16137173 ] Chen Liang commented on HDFS-11888: --- Thanks [~xyao] for taking care of this! Looks pretty good to me

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137086#comment-16137086 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-003.patch Fixed findbugs. > Federation Metrics >

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137031#comment-16137031 ] Hadoop QA commented on HDFS-10899: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-002.patch Fixing unit tests. > Federation Metrics >

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136983#comment-16136983 ] Hadoop QA commented on HDFS-12336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12337) Ozone: Concurrent RocksDB open calls fail because of "No locks available"

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136939#comment-16136939 ] Hadoop QA commented on HDFS-12337: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-22 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136897#comment-16136897 ] Wellington Chevreuil commented on HDFS-12182: - I believe the test failures are not related.

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Status: Patch Available (was: Open) > Add functionality to re-encrypt EDEKs >

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-22 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12336: Status: Patch Available (was: Open) > Listing encryption zones still fails when

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-22 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12336: Attachment: HDFS-12336.001.patch Proposing initial patch with changes to also cover

[jira] [Updated] (HDFS-12337) Ozone: Concurrent RocksDB open calls fail because of "No locks available"

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12337: - Attachment: HDFS-12337-HDFS-7240.001.patch > Ozone: Concurrent RocksDB open calls fail

[jira] [Updated] (HDFS-12337) Ozone: Concurrent RocksDB open calls fail because of "No locks available"

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12337: - Status: Patch Available (was: Open) > Ozone: Concurrent RocksDB open calls fail because

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136758#comment-16136758 ] Hadoop QA commented on HDFS-12225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12337) Ozone: Concurrent RocksDB open calls fail because of "No locks available"

2017-08-22 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12337: Summary: Ozone: Concurrent RocksDB open calls fail because of "No locks available" Key: HDFS-12337 URL: https://issues.apache.org/jira/browse/HDFS-12337

[jira] [Created] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-22 Thread Wellington Chevreuil (JIRA)
Wellington Chevreuil created HDFS-12336: --- Summary: Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory Key: HDFS-12336 URL:

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136647#comment-16136647 ] Hadoop QA commented on HDFS-11968: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136641#comment-16136641 ] Surendra Singh Lilhore commented on HDFS-12225: --- Attached updated patch. Please review.. >

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-08.patch > [SPS]: Optimize extended

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136628#comment-16136628 ] Hadoop QA commented on HDFS-12283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136620#comment-16136620 ] Hadoop QA commented on HDFS-12282: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136610#comment-16136610 ] Mukul Kumar Singh commented on HDFS-12216: -- Looked into the recent failures after the patch and

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136595#comment-16136595 ] Hadoop QA commented on HDFS-12280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136579#comment-16136579 ] Yiqun Lin commented on HDFS-12280: -- The error was thrown from the following exception that I debugged the

[jira] [Updated] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11968: - Status: Patch Available (was: Open) > ViewFS: StoragePolicies commands fail with HDFS

[jira] [Updated] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11968: - Attachment: HDFS-11968.001.patch > ViewFS: StoragePolicies commands fail with HDFS

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136551#comment-16136551 ] Hadoop QA commented on HDFS-12327: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12282: --- Attachment: HDFS-12282-HDFS-7240.003.patch > Ozone: DeleteKey-4: Block delete via HB between SCM and

[jira] [Updated] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12283: -- Attachment: HDFS-12283-HDFS-7240.007.patch upload v7 patch > Ozone: DeleteKey-5: Implement SCM

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136510#comment-16136510 ] Hadoop QA commented on HDFS-12327: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136494#comment-16136494 ] Hadoop QA commented on HDFS-12282: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136492#comment-16136492 ] Mukul Kumar Singh commented on HDFS-12280: -- [~anu], TestKeys is still failing occasionally in

[jira] [Updated] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-22 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12280: --- Attachment: HDFS-12280-HDFS-7240.002.patch I have included the changes suggested by [~msingh].

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136455#comment-16136455 ] Xiao Chen edited comment on HDFS-10899 at 8/22/17 8:04 AM: --- Thanks a lot for the

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136484#comment-16136484 ] Mukul Kumar Singh commented on HDFS-12292: -- Thanks for the updated patch [~erofeev], 1)

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.15.patch > Add functionality to re-encrypt EDEKs >

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136480#comment-16136480 ] Xiao Chen commented on HDFS-10899: -- Patch 15 uploaded, still based on PATCH-14705.. Addressed all

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136469#comment-16136469 ] Xiao Chen commented on HDFS-10899: -- bq. ReencryptionUpdater#throttle(): updater would keep contending for

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136462#comment-16136462 ] Xiao Chen commented on HDFS-10899: -- bq. It looks like ReencryptionTask.batch does not need to use file

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136458#comment-16136458 ] Weiwei Yang commented on HDFS-12282: Hi [~anu] {{SCMNodeManager#sendHeartbeat}} is the HB RPC call

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136455#comment-16136455 ] Xiao Chen commented on HDFS-10899: -- Thanks a lot for the reviews [~jojochuang], good comments! Replying

[jira] [Updated] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12327: - Attachment: HDFS-12327-HDFS-7240.003.patch > Ozone: support setting timeout in background service >

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136418#comment-16136418 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12327: - Attachment: (was: HDFS-12327-HDFS-7240.003.patch) > Ozone: support setting timeout in background

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136406#comment-16136406 ] Anu Engineer commented on HDFS-12282: - [~cheersyang] My concern comes from the issues I have seen in

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136402#comment-16136402 ] Weiwei Yang commented on HDFS-12327: Thanks [~linyiqun], I just noticed this is wrapped using

[jira] [Updated] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12327: - Attachment: HDFS-12327-HDFS-7240.003.patch > Ozone: support setting timeout in background service >

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136401#comment-16136401 ] Weiwei Yang commented on HDFS-12282: Hi [~anu] Thanks for your quick comments. I have addressed all

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136399#comment-16136399 ] Yiqun Lin commented on HDFS-12327: -- Thanks for the review, [~cheersynang]. All the comments make sense to

[jira] [Updated] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12282: --- Attachment: HDFS-12282-HDFS-7240.002.patch > Ozone: DeleteKey-4: Block delete via HB between SCM and

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-22 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136375#comment-16136375 ] Huafeng Wang commented on HDFS-1: - I just tweaked the patch according to your suggestions. Is it

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136363#comment-16136363 ] Yuanbo Liu commented on HDFS-12283: --- [~cheersyang] Thanks for your comments. {quote} ozone-default.xml

  1   2   >