[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

2020-11-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15651: --- Attachment: HDFS-15651.002.patch > Client could not obtain block when DN CommandProcessingThread exit >

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

2020-10-29 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15651: --- Attachment: HDFS-15651.001.patch > Client could not obtain block when DN CommandProcessingThread exit >

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

2020-10-27 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221284#comment-17221284 ] Aiphago commented on HDFS-15651: [^HDFS-15651.patch]  I think let BPServiceActor exit is better when 

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

2020-10-27 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15651: --- Attachment: HDFS-15651.patch > Client could not obtain block when DN CommandProcessingThread exit >

[jira] [Comment Edited] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-16 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196824#comment-17196824 ] Aiphago edited comment on HDFS-15382 at 9/16/20, 9:35 AM: -- This is a sample base

[jira] [Comment Edited] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-16 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196824#comment-17196824 ] Aiphago edited comment on HDFS-15382 at 9/16/20, 9:35 AM: -- This is a sample base

[jira] [Comment Edited] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-16 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196824#comment-17196824 ] Aiphago edited comment on HDFS-15382 at 9/16/20, 9:33 AM: -- This is a sample base

[jira] [Updated] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-16 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: HDFS-15382-sample.patch > Split FsDatasetImpl from blockpool lock to blockpool volume lock >

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-09-16 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196824#comment-17196824 ] Aiphago commented on HDFS-15382: This is a sample base our 2.7 version, mian logic is similar, but apply

[jira] [Comment Edited] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-03 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124767#comment-17124767 ] Aiphago edited comment on HDFS-15382 at 6/3/20, 8:45 AM: -

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-03 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124767#comment-17124767 ] Aiphago commented on HDFS-15382: !image-2020-06-03-1.png|width=628,height=378! The simple lock model

[jira] [Updated] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-03 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: image-2020-06-03-1.png > Split FsDatasetImpl from blockpool lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-03 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: (was: 2020-06-03.png) > Split FsDatasetImpl from blockpool lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-03 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: 2020-06-03.png > Split FsDatasetImpl from blockpool lock to blockpool volume lock >

[jira] [Comment Edited] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-03 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124736#comment-17124736 ] Aiphago edited comment on HDFS-15382 at 6/3/20, 8:12 AM: - {quote}it is confused

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-03 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124736#comment-17124736 ] Aiphago commented on HDFS-15382: {quote}it is confused with {{ReplicaCachingGetSpaceUsed}}, IIUC, 

[jira] [Updated] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-02 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Summary: Split FsDatasetImpl from blockpool lock to blockpool volume lock (was: Split DataNode

[jira] [Commented] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-02 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123379#comment-17123379 ] Aiphago commented on HDFS-15382: After improve our du in cache copy time is very low.And we make improve

[jira] [Commented] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-02 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123372#comment-17123372 ] Aiphago commented on HDFS-15382: Now we deploy in our produce cluster use this patch for some days.Here

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-02 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: image-2020-06-02-1.png > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Affects Version/s: (was: 3.2.1) (was: 2.9.2) > Split DataNode FsDatasetImpl

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Target Version/s: (was: 3.2.0, 2.9.2) > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: (was: image-2020-06-02.png) > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: image-2020-06-02.png > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Affects Version/s: 2.9.2 3.2.1 > Split DataNode FsDatasetImpl lock to blockpool

[jira] [Work started] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15382 started by Aiphago. -- > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Fix Version/s: 2.9.2 3.2.1 > Split DataNode FsDatasetImpl lock to blockpool volume lock

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Fix Version/s: (was: 2.9.2) > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Created] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
Aiphago created HDFS-15382: -- Summary: Split DataNode FsDatasetImpl lock to blockpool volume lock Key: HDFS-15382 URL: https://issues.apache.org/jira/browse/HDFS-15382 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-04-09 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080192#comment-17080192 ] Aiphago commented on HDFS-15180: Hi [~zhuqi] , thanks for your feedback.I think GenerationStamp may be

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-24 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065536#comment-17065536 ] Aiphago commented on HDFS-15180: ping [~sodonnell] ,  [~linyiqun], [~weichiu] Any advice ?Thanks.   >

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-22 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064192#comment-17064192 ] Aiphago commented on HDFS-15180: Fix the problem in UT > DataNode FsDatasetImpl Fine-Grained Locking

[jira] [Updated] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-22 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15180: --- Attachment: HDFS-15180.004.patch > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. >

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063806#comment-17063806 ] Aiphago commented on HDFS-15180: ok,I'll fix later > DataNode FsDatasetImpl Fine-Grained Locking via

[jira] [Updated] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-21 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15180: --- Attachment: HDFS-15180.003.patch > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. >

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063204#comment-17063204 ] Aiphago commented on HDFS-15180: Hi [~zhuqi], thanks for valuable suggestions. Change the lock style use

[jira] [Updated] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15180: --- Attachment: HDFS-15180.002.patch > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. >

[jira] [Updated] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-14 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15180: --- Attachment: HDFS-15180.001.patch > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. >

[jira] [Commented] (HDFS-15180) DataNode FsDatasetImpl Fine-Grained Locking via BlockPool.

2020-03-14 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059199#comment-17059199 ] Aiphago commented on HDFS-15180: Hi [~zhuqi] ,Thanks for your proposal.And we have split dataset lock in

[jira] [Commented] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-23 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002146#comment-17002146 ] Aiphago commented on HDFS-15068: Renew the patch,change log.debug to 

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-23 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15068: --- Attachment: HDFS-15068.005.patch > DataNode could meet deadlock if invoke refreshVolumes when register >

[jira] [Updated] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15000: --- Attachment: HDFS-15000.001.patch > Improve FsDatasetImpl to avoid IO operation in datasetLock >

[jira] [Updated] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15000: --- Attachment: (was: HDFS-15000.001.patch) > Improve FsDatasetImpl to avoid IO operation in datasetLock >

[jira] [Comment Edited] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000742#comment-17000742 ] Aiphago edited comment on HDFS-15000 at 12/20/19 9:21 AM: -- Hi [~sodonnell] 

[jira] [Updated] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15000: --- Attachment: HDFS-15000.001.patch > Improve FsDatasetImpl to avoid IO operation in datasetLock >

[jira] [Updated] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15000: --- Attachment: (was: HDFS-15000.001.patch) > Improve FsDatasetImpl to avoid IO operation in datasetLock >

[jira] [Updated] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15000: --- Attachment: HDFS-15000.001.patch > Improve FsDatasetImpl to avoid IO operation in datasetLock >

[jira] [Commented] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000742#comment-17000742 ] Aiphago commented on HDFS-15000: Hi [~sodonnell] ,Thanks for your comment.I have some question with your

[jira] [Updated] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15000: --- Attachment: (was: HDFS-15000.001.patch) > Improve FsDatasetImpl to avoid IO operation in datasetLock >

[jira] [Commented] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-19 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000679#comment-17000679 ] Aiphago commented on HDFS-15068: Hi [~elgoiri] ,thanks for valuable suggestions.Have test the unit

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-19 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15068: --- Attachment: HDFS-15068.004.patch > DataNode could meet deadlock if invoke refreshVolumes when register >

[jira] [Comment Edited] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-18 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999776#comment-16999776 ] Aiphago edited comment on HDFS-15000 at 12/19/19 6:32 AM: -- submit demo patch.The

[jira] [Commented] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-18 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999776#comment-16999776 ] Aiphago commented on HDFS-15000: submit demo patch.The main idea is to make IO opreate(the opreate may

[jira] [Updated] (HDFS-15000) Improve FsDatasetImpl to avoid IO operation in datasetLock

2019-12-18 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15000: --- Attachment: HDFS-15000.001.patch > Improve FsDatasetImpl to avoid IO operation in datasetLock >

[jira] [Commented] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-18 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999736#comment-16999736 ] Aiphago commented on HDFS-15068: Hi [~hexiaoqiao],thanks for valuable advice,renew the

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-18 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15068: --- Attachment: HDFS-15068.003.patch > DataNode could meet deadlock if invoke refreshVolumes when register >

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-17 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15068: --- Attachment: HDFS-15068.002.patch > DataNode could meet deadlock if invoke refreshVolumes when register >

[jira] [Commented] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-17 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998860#comment-16998860 ] Aiphago commented on HDFS-15068: Thansk [~hexiaoqiao] for the review,I Release the patch with unit test 

[jira] [Updated] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-16 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15068: --- Attachment: HDFS-15068.001.patch > DataNode could meet deadlock if invoke refreshVolumes when register >

[jira] [Commented] (HDFS-15068) DataNode could meet deadlock if invoke refreshVolumes when register

2019-12-16 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997922#comment-16997922 ] Aiphago commented on HDFS-15068: I change the lock order of refreshVolumes()  and here is the

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-27 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984170#comment-16984170 ] Aiphago commented on HDFS-14986: Thanks a lot for the review [~linyiqun]. > ReplicaCachingGetSpaceUsed

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-27 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14986: --- Attachment: HDFS-14986.006.patch > ReplicaCachingGetSpaceUsed throws ConcurrentModificationException >

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-27 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983513#comment-16983513 ] Aiphago commented on HDFS-14986: Good advice,I change the retrytimes to 10 and close the stream in while

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-26 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983213#comment-16983213 ] Aiphago commented on HDFS-14986: Hi [~linyiqun],Thank you for your valuable advice.I improve the patch as

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-26 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14986: --- Attachment: HDFS-14986.005.patch > ReplicaCachingGetSpaceUsed throws ConcurrentModificationException >

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-22 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980042#comment-16980042 ] Aiphago commented on HDFS-14986: Hi 

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-21 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979853#comment-16979853 ] Aiphago commented on HDFS-14986: Hi [~linyiqun],Thank you for your valuable advice.And now

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-21 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14986: --- Attachment: HDFS-14986.004.patch > ReplicaCachingGetSpaceUsed throws ConcurrentModificationException >

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978951#comment-16978951 ] Aiphago commented on HDFS-14986: hi [~jianliang.wu], I just assign this Jira to myself, please feel free

[jira] [Assigned] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago reassigned HDFS-14986: -- Assignee: Aiphago (was: Ryan Wu) > ReplicaCachingGetSpaceUsed throws

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978950#comment-16978950 ] Aiphago commented on HDFS-14986: Hi [~linyiqun],Thank you for your valuable advice.In previous patch I 

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-20 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14986: --- Attachment: HDFS-14986.003.patch > ReplicaCachingGetSpaceUsed throws ConcurrentModificationException >

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-19 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977328#comment-16977328 ] Aiphago commented on HDFS-14986: Hi [~linyiqun],I updata the patch.Can you review this

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-19 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14986: --- Attachment: HDFS-14986.002.patch > ReplicaCachingGetSpaceUsed throws ConcurrentModificationException >

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-17 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976301#comment-16976301 ] Aiphago commented on HDFS-14986: Thanks for your advice, I'll fix later. > ReplicaCachingGetSpaceUsed

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-14 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974888#comment-16974888 ] Aiphago commented on HDFS-14986: Here is the patch for the trunk can [~leosun08] [~hexiaoqiao] 

[jira] [Updated] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-14 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14986: --- Attachment: HDFS-14986.001.patch > ReplicaCachingGetSpaceUsed throws ConcurrentModificationException >

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-13 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973916#comment-16973916 ] Aiphago commented on HDFS-14986: I means I can fix the dead lock problem with add dataset lock,my first

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-13 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973906#comment-16973906 ] Aiphago commented on HDFS-14986: We use the branch before 2.8 with the synchronized,and we fix the

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-13 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973321#comment-16973321 ] Aiphago commented on HDFS-14986: "DataNode: [... #283 daemon prio=5 os_prio=0 tid=0x7fd9826a7800

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-13 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973317#comment-16973317 ] Aiphago commented on HDFS-14986: I would like to submit a patch to try to fix this bug later. >

[jira] [Commented] (HDFS-14986) ReplicaCachingGetSpaceUsed throws ConcurrentModificationException

2019-11-13 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973314#comment-16973314 ] Aiphago commented on HDFS-14986: In -HDFS-14313- we found same concurrent problem before base our hadoop

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-18 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932097#comment-16932097 ] Aiphago commented on HDFS-14836: Hi [~jojochuang],I run TestDFSUpgradeWithHA on local with the patch,and

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-14 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929875#comment-16929875 ] Aiphago commented on HDFS-14836: Hi [~jojochuang] I update the code can you help review this again?

[jira] [Updated] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-14 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14836: --- Attachment: HDFS-14836-trunk-001.patch > FileIoProvider should not increase FileIoErrors metric in datanode

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-11 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928173#comment-16928173 ] Aiphago commented on HDFS-14836: Thanks [~jojochuang] for the comment. {quote}it would be the best if we

[jira] [Updated] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-11 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14836: --- Affects Version/s: (was: 2.9.1) > FileIoProvider should not increase FileIoErrors metric in datanode

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-11 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927338#comment-16927338 ] Aiphago commented on HDFS-14836: Hi [~jojochuang] can you help review this one? Thanks very much. >

[jira] [Updated] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-11 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14836: --- Attachment: HDFS-14836.patch > FileIoProvider should not increase FileIoErrors metric in datanode volume >

[jira] [Commented] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-09 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926300#comment-16926300 ] Aiphago commented on HDFS-14836: Hi [~jojochuang] thxs for your attention. like  HDFS-2054  "Broken

[jira] [Updated] (HDFS-14836) FileIoProvider should not increase FileIoErrors metric in datanode volume metric

2019-09-09 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14836: --- Summary: FileIoProvider should not increase FileIoErrors metric in datanode volume metric (was:

[jira] [Updated] (HDFS-14836) FileIoProvider will increase FileIoErrors metric in datanode volume metric

2019-09-09 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-14836: --- Description: I found that  FileIoErrors metric will increase in BlockSender.sendPacket(),when use 

[jira] [Created] (HDFS-14836) FileIoProvider will increase FileIoErrors metric in datanode volume metric

2019-09-09 Thread Aiphago (Jira)
Aiphago created HDFS-14836: -- Summary: FileIoProvider will increase FileIoErrors metric in datanode volume metric Key: HDFS-14836 URL: https://issues.apache.org/jira/browse/HDFS-14836 Project: Hadoop HDFS