[
https://issues.apache.org/jira/browse/HDFS-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309423#comment-17309423
]
HuangTao commented on HDFS-15924:
-
Which Hadoop version used in your cluster?
> Log4j wi
[
https://issues.apache.org/jira/browse/HDFS-15739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252584#comment-17252584
]
HuangTao commented on HDFS-15739:
-
+1 LGTM about the PR
> Missing Javadoc for a param in
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17244379#comment-17244379
]
HuangTao commented on HDFS-15240:
-
I have check and run the failed unit test
TestReconst
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17244245#comment-17244245
]
HuangTao commented on HDFS-15240:
-
Upload [^HDFS-15240-branch-3.1-001.patch] for branch-3
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240-branch-3.1-001.patch
> Erasure Coding: dirty buffer causes reconstruction block erro
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240-branch-3.3-001.patch
> Erasure Coding: dirty buffer causes reconstruction block erro
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17242388#comment-17242388
]
HuangTao commented on HDFS-15240:
-
Thanks [~tasanuma] for your careful review. I address
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.013.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240439#comment-17240439
]
HuangTao commented on HDFS-15240:
-
Upload [^HDFS-15240.012.patch] to fix flaky test case.
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.012.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.011.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239546#comment-17239546
]
HuangTao commented on HDFS-15240:
-
Upload [^HDFS-15240.010.patch] to add a new function c
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.010.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239090#comment-17239090
]
HuangTao edited comment on HDFS-15240 at 11/26/20, 11:14 AM:
-
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239090#comment-17239090
]
HuangTao edited comment on HDFS-15240 at 11/26/20, 6:50 AM:
U
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239090#comment-17239090
]
HuangTao commented on HDFS-15240:
-
Upload [^HDFS-15240.009.patch] to address
??Either
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.009.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239039#comment-17239039
]
HuangTao commented on HDFS-15240:
-
The NPE fails the reconstruction and close the striped
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17232608#comment-17232608
]
HuangTao commented on HDFS-15240:
-
Upload [^HDFS-15240.008.patch] for fixing checkstyle
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.008.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17232477#comment-17232477
]
HuangTao edited comment on HDFS-15240 at 11/16/20, 3:01 AM:
T
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17232477#comment-17232477
]
HuangTao commented on HDFS-15240:
-
Thanks [~ferhui] [~umamaheswararao] for your comments.
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.007.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17225810#comment-17225810
]
HuangTao commented on HDFS-15240:
-
Thanks for your suggestion, [~ferhui] I will change th
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17224396#comment-17224396
]
HuangTao commented on HDFS-15240:
-
Thanks for your work, [~touchida]. I checked again and
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.006.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Description:
When read some lzo files we found some blocks were broken.
I read back all internal blocks(b0
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Description:
When read some lzo files we found some blocks were broken.
I read back all internal blocks(b0
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17179461#comment-17179461
]
HuangTao commented on HDFS-15240:
-
No problem, [~ferhui] I will work on that later
> Era
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159804#comment-17159804
]
HuangTao commented on HDFS-15240:
-
Could you please help me review that ? [~weichiu]
I t
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Target Version/s: 3.4.0
> Erasure Coding: dirty buffer causes reconstruction block error
>
[
https://issues.apache.org/jira/browse/HDFS-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17083996#comment-17083996
]
HuangTao commented on HDFS-15140:
-
about the patch, I find two points need to change
{cod
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082972#comment-17082972
]
HuangTao commented on HDFS-15274:
-
Thanks, [~hexiaoqiao].
There are still some failed tes
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082766#comment-17082766
]
HuangTao commented on HDFS-15274:
-
cc [~hexiaoqiao] could you help me trigger jenkins aga
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082348#comment-17082348
]
HuangTao commented on HDFS-15274:
-
All failed test cases can pass locally
> NN doesn't r
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082347#comment-17082347
]
HuangTao commented on HDFS-15274:
-
retrigger QA
> NN doesn't remove the blocks from the
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15274:
Attachment: HDFS-15274.002.patch
> NN doesn't remove the blocks from the failed DatanodeStorageInfo
> -
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082132#comment-17082132
]
HuangTao commented on HDFS-15274:
-
[~daryn] please help to take a look.
> NN doesn't rem
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15274:
Attachment: HDFS-15274.001.patch
Status: Patch Available (was: Open)
> NN doesn't remove the block
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15274:
Fix Version/s: (was: 3.4.0)
> NN doesn't remove the blocks from the failed DatanodeStorageInfo
> --
[
https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15274:
Affects Version/s: 3.4.0
> NN doesn't remove the blocks from the failed DatanodeStorageInfo
> -
HuangTao created HDFS-15274:
---
Summary: NN doesn't remove the blocks from the failed
DatanodeStorageInfo
Key: HDFS-15274
URL: https://issues.apache.org/jira/browse/HDFS-15274
Project: Hadoop HDFS
I
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Fix Version/s: 3.4.0
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Affects Version/s: (was: 3.3.1)
> Erasure Coding: dirty buffer causes reconstruction block error
>
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Affects Version/s: (was: 3.3.0)
3.3.1
> Erasure Coding: dirty buffer causes reco
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077745#comment-17077745
]
HuangTao edited comment on HDFS-15240 at 4/8/20, 2:10 AM:
--
Hi wa
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077745#comment-17077745
]
HuangTao commented on HDFS-15240:
-
Hi watchers, anyone would like to help take a review?
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Affects Version/s: 3.3.0
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075854#comment-17075854
]
HuangTao commented on HDFS-15240:
-
the failed test is unrelated with this patch. [~weichi
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.005.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.004.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao resolved HDFS-15260.
-
Resolution: Invalid
It is our custom version
> Change from List to Set to improve the chooseTarget perfo
[
https://issues.apache.org/jira/browse/HDFS-15260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15260:
Attachment: (was: choose_target_flamegraph.png)
> Change from List to Set to improve the chooseTarget p
[
https://issues.apache.org/jira/browse/HDFS-15260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15260:
Attachment: choose_target_flamegraph.png
> Change from List to Set to improve the chooseTarget performance
HuangTao created HDFS-15260:
---
Summary: Change from List to Set to improve the chooseTarget
performance
Key: HDFS-15260
URL: https://issues.apache.org/jira/browse/HDFS-15260
Project: Hadoop HDFS
Is
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.003.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075021#comment-17075021
]
HuangTao commented on HDFS-15240:
-
fix checkstyle and the unit case
> Erasure Coding: di
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.002.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17073396#comment-17073396
]
HuangTao commented on HDFS-15240:
-
[~weichiu] I'm working on that, I will upload another
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067871#comment-17067871
]
HuangTao commented on HDFS-15240:
-
I will try to add an UT
> Erasure Coding: dirty buffe
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Description:
When read some lzo files we found some blocks were broken.
I read back all internal blocks(b0
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Description:
When read some lzo files we found some blocks were broken.
I read back all internal blocks(b0
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067539#comment-17067539
]
HuangTao commented on HDFS-15240:
-
[~weichiu] PTAL, Thanks
> Erasure Coding: dirty buffe
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Attachment: HDFS-15240.001.patch
> Erasure Coding: dirty buffer causes reconstruction block error
> ---
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Description:
When read some lzo files we found some blocks were broken.
I read back all internal blocks(b0
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Description:
When read some lzo files we found some blocks were broken.
I read back all internal blocks of
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Summary: Erasure Coding: dirty buffer causes reconstruction block error
(was: dirty buffer causes EC recon
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao reassigned HDFS-15240:
---
Assignee: HuangTao
> Erasure Coding: dirty buffer causes reconstruction block error
> --
[
https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15240:
Summary: dirty buffer causes EC reconstruction block error (was: dirty)
> dirty buffer causes EC reconstru
HuangTao created HDFS-15240:
---
Summary: dirty
Key: HDFS-15240
URL: https://issues.apache.org/jira/browse/HDFS-15240
Project: Hadoop HDFS
Issue Type: Bug
Components: datanode, erasure-codin
[
https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040767#comment-17040767
]
HuangTao commented on HDFS-15186:
-
In our production, we meet same issue, and I have disc
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984093#comment-16984093
]
HuangTao commented on HDFS-15013:
-
Upload v002 patch. fix non-ha mode
> Reduce NameNode
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984072#comment-16984072
]
HuangTao edited comment on HDFS-15013 at 11/28/19 2:32 AM:
---
[~s
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15013:
Attachment: HDFS-15013.002.patch
> Reduce NameNode overview tab response time
> ---
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15013:
Fix Version/s: 3.3.0
> Reduce NameNode overview tab response time
> ---
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984072#comment-16984072
]
HuangTao edited comment on HDFS-15013 at 11/28/19 1:41 AM:
---
[~s
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984072#comment-16984072
]
HuangTao commented on HDFS-15013:
-
[~surendrasingh] [~ayushtkn] sorry, I didn't think of
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982235#comment-16982235
]
HuangTao commented on HDFS-15013:
-
[~inigoiri] I have checked federationhealth.js, there
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982089#comment-16982089
]
HuangTao commented on HDFS-15013:
-
[~surendrasingh] PTAL
> Reduce NameNode overview tab
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15013:
Attachment: HDFS-15013.001.patch
Status: Patch Available (was: Open)
> Reduce NameNode overview ta
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15013:
Description:
Now, the overview tab load /conf synchronously as follow picture.
!image-2019-11-26-10-05-39
[
https://issues.apache.org/jira/browse/HDFS-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-15013:
Description:
Now, the overview tab load /conf synchronously as follow picture.
!image-2019-11-26-10-05-39
HuangTao created HDFS-15013:
---
Summary: Reduce NameNode overview tab response time
Key: HDFS-15013
URL: https://issues.apache.org/jira/browse/HDFS-15013
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Description:
When the datanode keeping in DECOMMISSION_INPROGRESS status, the EC internal
block in that da
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Summary: Erasure Coding: the internal block is replicated many times when
datanode is decommissioning (was
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933911#comment-16933911
]
HuangTao commented on HDFS-14849:
-
Yes [~ferhui], just more than one, sometimes the numbe
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933455#comment-16933455
]
HuangTao commented on HDFS-14849:
-
[~ferhui] I am trying to find the root cause, will syn
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933376#comment-16933376
]
HuangTao edited comment on HDFS-14849 at 9/19/19 1:35 PM:
--
I fin
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Comment: was deleted
(was: !liveBlockIndices.png! )
> Erasure Coding: replicate block infinitely when dat
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933382#comment-16933382
]
HuangTao commented on HDFS-14849:
-
!liveBlockIndices.png!
> Erasure Coding: replicate
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Attachment: liveBlockIndices.png
> Erasure Coding: replicate block infinitely when datanode being decommiss
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933376#comment-16933376
]
HuangTao edited comment on HDFS-14849 at 9/19/19 1:30 PM:
--
I fin
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933376#comment-16933376
]
HuangTao commented on HDFS-14849:
-
I find a clue:
the `chooseSourceDatanodes` get
{quot
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Description:
When the datanode keeping in DECOMMISSION_INPROGRESS status, the EC block in
that datanode wi
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933266#comment-16933266
]
HuangTao commented on HDFS-14849:
-
[~ferhui] We have the same scenario, but our fix can't
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Attachment: HDFS-14849.002.patch
> Erasure Coding: replicate block infinitely when datanode being decommiss
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Description:
When the datanode keeping in DECOMMISSION_INPROGRESS status, the EC block in
that datanode wi
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Description:
When the datanode keeping in DECOMMISSION_INPROGRESS status, the EC block in
that datanode wi
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Attachment: fsck-file.png
> Erasure Coding: replicate block infinitely when datanode being decommissioning
[
https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
HuangTao updated HDFS-14849:
Attachment: scheduleReconstruction.png
> Erasure Coding: replicate block infinitely when datanode being dec
1 - 100 of 143 matches
Mail list logo
