[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178198#comment-16178198 ] Surendra Singh Lilhore commented on HDFS-12291: --- Thanks [~xiaochen] and [~umamaheswararao]

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184749#comment-16184749 ] Surendra Singh Lilhore commented on HDFS-12291: ---

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-09.patch Attached v9. Fixed tab warnings..

[jira] [Updated] (HDFS-12556) [SPS] : Block movement analysis should be done on read lock.

2017-10-01 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12556: -- Summary: [SPS] : Block movement analysis should be done on read lock. (was:

[jira] [Updated] (HDFS-12556) [SPS] : Block movement analysis should be done on read lock.

2017-10-01 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12556: -- Attachment: HDFS-12556-HDFS-10285-01.patch > [SPS] : Block movement analysis

[jira] [Updated] (HDFS-12556) [SPS] : Block movement analysis should be done in read lock.

2017-10-01 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12556: -- Summary: [SPS] : Block movement analysis should be done in read lock. (was:

[jira] [Updated] (HDFS-12556) [SPS] : Block movement analysis should be done on read lock.

2017-10-01 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12556: -- Status: Patch Available (was: Open) > [SPS] : Block movement analysis should

[jira] [Commented] (HDFS-12556) [SPS] : Block movement analysis should be done in read lock.

2017-10-01 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187347#comment-16187347 ] Surendra Singh Lilhore commented on HDFS-12556: --- Some time

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-27 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-08.patch > [SPS]: Provide a mechanism to

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-27 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16182368#comment-16182368 ] Surendra Singh Lilhore commented on HDFS-12291: --- Thanks [~umamaheswararao] for review...

[jira] [Created] (HDFS-12556) [SPS] : Fix TestPersistentStoragePolicySatisfier#testWithRestarts

2017-09-27 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-12556: - Summary: [SPS] : Fix TestPersistentStoragePolicySatisfier#testWithRestarts Key: HDFS-12556 URL: https://issues.apache.org/jira/browse/HDFS-12556

[jira] [Assigned] (HDFS-12556) [SPS] : Fix TestPersistentStoragePolicySatisfier#testWithRestarts

2017-09-27 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-12556: - Assignee: Surendra Singh Lilhore > [SPS] : Fix

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-10-03 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189504#comment-16189504 ] Surendra Singh Lilhore commented on HDFS-11968: --- +1 LGTM. > ViewFS: StoragePolicies

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179540#comment-16179540 ] Surendra Singh Lilhore commented on HDFS-12291: --- Thanks [~xiaochen], Attached v7 patch.

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-07.patch > [SPS]: Provide a mechanism to

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178872#comment-16178872 ] Surendra Singh Lilhore commented on HDFS-12291: --- Hi [~xiaochen], I have one doubt. In my

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-06.patch Missed new added file in last patch.

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-27 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183684#comment-16183684 ] Surendra Singh Lilhore commented on HDFS-12291: --- bq. Not sure if we worry about

[jira] [Comment Edited] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136290#comment-16136290 ] Surendra Singh Lilhore edited comment on HDFS-12225 at 8/22/17 5:09 AM:

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136290#comment-16136290 ] Surendra Singh Lilhore commented on HDFS-12225: --- bq. Why is this required? We will remove

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134966#comment-16134966 ] Surendra Singh Lilhore commented on HDFS-12225: --- {noformat}

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-07.patch Thanks [~rakeshr] for review..

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-06.patch v6: Fixed checkstyle warnings and

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136641#comment-16136641 ] Surendra Singh Lilhore commented on HDFS-12225: --- Attached updated patch. Please review.. >

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-08.patch > [SPS]: Optimize extended

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-23 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139543#comment-16139543 ] Surendra Singh Lilhore commented on HDFS-12225: --- Thanks [~umamaheswararao] for review and

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Status: Patch Available (was: Open) > [SPS]: Provide a mechanism to

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-01.patch Attached first initial patch. It

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134332#comment-16134332 ] Surendra Singh Lilhore commented on HDFS-12225: --- bq. Also, need to call SPS#clearQueues() on

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-04.patch Thanks [~rakeshr] for review..

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-17 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131166#comment-16131166 ] Surendra Singh Lilhore commented on HDFS-12225: --- Thanks [~rakeshr] for reviews. bq. How

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144821#comment-16144821 ] Surendra Singh Lilhore commented on HDFS-11968: --- Hi [~msingh], Thanks for the patch. I have

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-09-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152380#comment-16152380 ] Surendra Singh Lilhore commented on HDFS-12310: --- Thanks [~umamaheswararao] Proposal LGTM...

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-02.patch > [SPS]: Provide a mechanism to

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145158#comment-16145158 ] Surendra Singh Lilhore commented on HDFS-12291: --- Attached v2 patch. Please review. Thanks

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-05 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153666#comment-16153666 ] Surendra Singh Lilhore commented on HDFS-12291: --- Thanks [~xiaochen], [~umamaheswararao],

[jira] [Updated] (HDFS-12556) [SPS] : Block movement analysis should be done in read lock.

2017-10-07 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12556: -- Attachment: HDFS-12556-HDFS-10285-02.patch > [SPS] : Block movement analysis

[jira] [Commented] (HDFS-12556) [SPS] : Block movement analysis should be done in read lock.

2017-10-07 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195845#comment-16195845 ] Surendra Singh Lilhore commented on HDFS-12556: --- Attached v2 patch. This patch fixing two

[jira] [Updated] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12310: -- Attachment: HDFS-12310-HDFS-10285-04.patch > [SPS]: Provide an option to track

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216656#comment-16216656 ] Surendra Singh Lilhore commented on HDFS-12310: --- Attached V4 patch.. bq. Please fix the

[jira] [Commented] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16269249#comment-16269249 ] Surendra Singh Lilhore commented on HDFS-12857: --- I've committed this. Thanks for the review

[jira] [Updated] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12857: -- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was:

[jira] [Created] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-25 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-12857: - Summary: StoragePolicyAdmin should support schema based path Key: HDFS-12857 URL: https://issues.apache.org/jira/browse/HDFS-12857 Project: Hadoop

[jira] [Updated] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12857: -- Attachment: HDFS-12857.001.patch Attaches patch. Please review >

[jira] [Updated] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12857: -- Status: Patch Available (was: Open) > StoragePolicyAdmin should support schema

[jira] [Commented] (HDFS-12833) In Distcp, Delete option not having the proper usage message.

2017-11-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265151#comment-16265151 ] Surendra Singh Lilhore commented on HDFS-12833: --- Thanks [~peruguusha] for patch. Minor

[jira] [Commented] (HDFS-12833) In Distcp, Delete option not having the proper usage message.

2017-11-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265647#comment-16265647 ] Surendra Singh Lilhore commented on HDFS-12833: --- +1 LGTM.. will wait for QA report... > In

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-11-30 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273971#comment-16273971 ] Surendra Singh Lilhore commented on HDFS-10285: --- Thanks [~umamaheswararao], [~rakeshr] and

[jira] [Commented] (HDFS-9023) When NN is not able to identify DN for replication, reason behind it can be logged

2017-12-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298205#comment-16298205 ] Surendra Singh Lilhore commented on HDFS-9023: -- Thanks [~xiaochen] for looking in to this

[jira] [Assigned] (HDFS-9023) When NN is not able to identify DN for replication, reason behind it can be logged

2017-12-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-9023: Assignee: Xiao Chen (was: Surendra Singh Lilhore) > When NN is not able to

[jira] [Commented] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder may not be logged

2017-12-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298258#comment-16298258 ] Surendra Singh Lilhore commented on HDFS-12726: --- Thanks [~xiaochen] for patch.. Some review

[jira] [Comment Edited] (HDFS-12833) Distcp : Update the usage of delete option for dependency with update and overwrite option

2017-12-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288728#comment-16288728 ] Surendra Singh Lilhore edited comment on HDFS-12833 at 12/13/17 5:29 AM:

[jira] [Updated] (HDFS-12833) Distcp : Update the usage of delete option for dependency with update and overwrite option

2017-12-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12833: -- Attachment: HDFS-12833-branch-2.committed.patch > Distcp : Update the usage of

[jira] [Updated] (HDFS-12833) Distcp : Update the usage of delete option for dependency with update and overwrite option

2017-12-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12833: -- Resolution: Fixed Fix Version/s: 2.8.4 2.10.0

[jira] [Updated] (HDFS-12833) Distcp : Update the usage of delete option for dependency with update and overwrite option

2017-12-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12833: -- Affects Version/s: (was: 3.0.0-alpha1) 2.8.0

[jira] [Created] (HDFS-12837) Intermittent failure TestReencryptionWithKMS#testReencryptionKMSDown

2017-11-17 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-12837: - Summary: Intermittent failure TestReencryptionWithKMS#testReencryptionKMSDown Key: HDFS-12837 URL: https://issues.apache.org/jira/browse/HDFS-12837

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-11 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Attachment: HDFS-12106-HDFS-10285-04.patch Attached v4 patch. Fixed checkstyle

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Attachment: HDFS-12106-HDFS-10285-03.patch > [SPS]: Improve storage policy

[jira] [Commented] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247990#comment-16247990 ] Surendra Singh Lilhore commented on HDFS-12106: --- Thanks [~rakeshr] for review.. Attached V3

[jira] [Assigned] (HDFS-12824) ViewFileSystem should support EC.

2017-11-16 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-12824: - Assignee: Surendra Singh Lilhore > ViewFileSystem should support EC. >

[jira] [Updated] (HDFS-12825) After Block Corrupted, FSCK Report printing the Direct configuration.

2017-11-16 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12825: -- Labels: newbie (was: ) > After Block Corrupted, FSCK Report printing the

[jira] [Updated] (HDFS-12825) After Block Corrupted, FSCK Report printing the Direct configuration.

2017-11-16 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12825: -- Issue Type: Bug (was: Wish) > After Block Corrupted, FSCK Report printing the

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-15 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-15 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Attachment: HDFS-12106-HDFS-10285-05-Committed.patch > [SPS]: Improve storage

[jira] [Commented] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-14 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251932#comment-16251932 ] Surendra Singh Lilhore commented on HDFS-12106: --- Failed tests are unrelated.. Failed SPS

[jira] [Commented] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-07 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243414#comment-16243414 ] Surendra Singh Lilhore commented on HDFS-12106: --- Thanks [~rakeshr] for review.. I fixed all

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-07 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Attachment: HDFS-12106-HDFS-10285-02.patch > [SPS]: Improve storage policy

[jira] [Commented] (HDFS-12790) [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits

2017-11-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245642#comment-16245642 ] Surendra Singh Lilhore commented on HDFS-12790: --- Thanks [~rakeshr] for patch. Latest patch

[jira] [Updated] (HDFS-12833) Distcp : Update the usage of delete option for dependency with update and overwrite option

2017-12-11 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12833: -- Summary: Distcp : Update the usage of delete option for dependency with update

[jira] [Commented] (HDFS-12833) Distcp : Update the usage of delete option for dependency with update and overwrite option

2017-12-11 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286419#comment-16286419 ] Surendra Singh Lilhore commented on HDFS-12833: --- Committed to trunk. [~usharani] Can you

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-10-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Status: Patch Available (was: Open) > [SPS]: Improve storage policy satisfier

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-10-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Attachment: HDFS-12106-HDFS-10285-01.patch Attached initial patch... Please

[jira] [Updated] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12310: -- Attachment: HDFS-12310-HDFS-10285-05.patch Attached v5 patch. Fixed failed

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-20 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213734#comment-16213734 ] Surendra Singh Lilhore commented on HDFS-12310: --- Thanks [~eddyxu] for review.. I will update

[jira] [Commented] (HDFS-13614) DN failed to connect with NN because of NPE in SocketIOWithTimeout

2018-05-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488493#comment-16488493 ] Surendra Singh Lilhore commented on HDFS-13614: --- {noformat} java.io.IOException: Failed on

[jira] [Commented] (HDFS-13614) DN failed to connect with NN because of NPE in SocketIOWithTimeout

2018-05-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488492#comment-16488492 ] Surendra Singh Lilhore commented on HDFS-13614: --- {noformat} java.lang.NullPointerException

[jira] [Created] (HDFS-13614) DN failed to connect with NN because of NPE in SocketIOWithTimeout

2018-05-24 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-13614: - Summary: DN failed to connect with NN because of NPE in SocketIOWithTimeout Key: HDFS-13614 URL: https://issues.apache.org/jira/browse/HDFS-13614

[jira] [Updated] (HDFS-13614) DN failed to connect with NN because of NPE in SocketIOWithTimeout

2018-05-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13614: -- Description: {{LinkedList$ListItr.next()}} is throwing NPE in

[jira] [Commented] (HDFS-12955) [SPS]: Move SPS classes to a separate package

2017-12-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301041#comment-16301041 ] Surendra Singh Lilhore commented on HDFS-12955: --- Thanks [~rakeshr] for clarification. bq. I

[jira] [Commented] (HDFS-12955) [SPS]: Move SPS classes to a separate package

2017-12-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300984#comment-16300984 ] Surendra Singh Lilhore commented on HDFS-12955: --- Thanks [~rakeshr] for patch. I feel sps

[jira] [Commented] (HDFS-9023) When NN is not able to identify DN for replication, reason behind it can be logged

2017-12-24 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302920#comment-16302920 ] Surendra Singh Lilhore commented on HDFS-9023: -- Thanks [~xiaochen] for the patch. V2 patch

[jira] [Commented] (HDFS-12987) Document - Disabling the Lazy persist file scrubber.

2018-01-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311142#comment-16311142 ] Surendra Singh Lilhore commented on HDFS-12987: --- +1, pending Jenkins.. > Document -

[jira] [Commented] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-01-05 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313177#comment-16313177 ] Surendra Singh Lilhore commented on HDFS-12982: --- Thanks [~rakeshr] for patch. I have some

[jira] [Commented] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-01-08 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316041#comment-16316041 ] Surendra Singh Lilhore commented on HDFS-12982: --- +1 LGTM > [SPS]: Reduce the locking and

[jira] [Updated] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-01-08 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12982: -- Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved

[jira] [Commented] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-01-08 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316042#comment-16316042 ] Surendra Singh Lilhore commented on HDFS-12982: --- I have just pushed it to branch, Thanks

[jira] [Created] (HDFS-13050) [SPS] : Create start/stop script to start external SPS process.

2018-01-23 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-13050: - Summary: [SPS] : Create start/stop script to start external SPS process. Key: HDFS-13050 URL: https://issues.apache.org/jira/browse/HDFS-13050

[jira] [Commented] (HDFS-13050) [SPS] : Create start/stop script to start external SPS process.

2018-01-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338938#comment-16338938 ] Surendra Singh Lilhore commented on HDFS-13050: --- Thanks [~umamaheswararao] for comment.

[jira] [Updated] (HDFS-13077) [SPS]: Fix review comments of external storage policy satisfier

2018-01-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13077: -- Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved

[jira] [Commented] (HDFS-13077) [SPS]: Fix review comments of external storage policy satisfier

2018-01-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343683#comment-16343683 ] Surendra Singh Lilhore commented on HDFS-13077: --- Thanks [~rakeshr] for patch. I verified

[jira] [Updated] (HDFS-13050) [SPS] : Create start/stop script to start external SPS process.

2018-01-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13050: -- Attachment: HDFS-13050-HDFS-10285-03.patch > [SPS] : Create start/stop script

[jira] [Comment Edited] (HDFS-13050) [SPS] : Create start/stop script to start external SPS process.

2018-01-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342710#comment-16342710 ] Surendra Singh Lilhore edited comment on HDFS-13050 at 1/28/18 8:01 PM:

[jira] [Commented] (HDFS-13050) [SPS] : Create start/stop script to start external SPS process.

2018-01-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342710#comment-16342710 ] Surendra Singh Lilhore commented on HDFS-13050: --- Attached v3 patch. > [SPS] : Create

[jira] [Updated] (HDFS-13075) [SPS]: Provide External Context implementation.

2018-01-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13075: -- Attachment: HDFS-13075-HDFS-10285-02.patch > [SPS]: Provide External Context

[jira] [Updated] (HDFS-13050) [SPS] : Create start/stop script to start external SPS process.

2018-01-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13050: -- Attachment: HDFS-13075-HDFS-10285-02.patch > [SPS] : Create start/stop script

[jira] [Updated] (HDFS-13050) [SPS] : Create start/stop script to start external SPS process.

2018-01-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13050: -- Attachment: (was: HDFS-13075-HDFS-10285-02.patch) > [SPS] : Create

[jira] [Commented] (HDFS-13075) [SPS]: Provide External Context implementation.

2018-01-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342537#comment-16342537 ] Surendra Singh Lilhore commented on HDFS-13075: --- Re-based and attached v2 patch > [SPS]:

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347575#comment-16347575 ] Surendra Singh Lilhore commented on HDFS-10285: --- Thanks [~daryn] for reviews. Create Part1

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347573#comment-16347573 ] Surendra Singh Lilhore commented on HDFS-13097: --- Attached v1 patch > [SPS]: Fix the branch

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347565#comment-16347565 ] Surendra Singh Lilhore commented on HDFS-13097: --- Fixing below comments *Comment-1)*

<    5   6   7   8   9   10   11   12   13   14   >