[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954466#comment-16954466
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954304#comment-16954304
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954296#comment-16954296
]
guojh commented on HDFS-14768:
--
rebase trunk
> In some cases, erasure blocks are corruption when they are
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954292#comment-16954292
]
guojh commented on HDFS-14768:
--
[~hadoopqa] test
> In some cases, erasure blocks are corruption when they
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954278#comment-16954278
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954261#comment-16954261
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954257#comment-16954257
]
guojh commented on HDFS-14768:
--
[~surendrasingh] Sorry about my thoughtless and thanks for you review.
> In
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954239#comment-16954239
]
Surendra Singh Lilhore commented on HDFS-14768:
---
{quote}I don't understand why the code
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954202#comment-16954202
]
guojh commented on HDFS-14768:
--
[~surendrasingh] I put a new path06, please review it.
> In some cases,
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954183#comment-16954183
]
guojh commented on HDFS-14768:
--
[~surendrasingh] Thanks for your review. I don't understand why the code
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953990#comment-16953990
]
Surendra Singh Lilhore commented on HDFS-14768:
---
Thanks [~gjhkael] for path.
Lets handle
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953545#comment-16953545
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953456#comment-16953456
]
guojh commented on HDFS-14768:
--
[~surendrasingh] I put a new patch. Please review it.
> In some cases,
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953447#comment-16953447
]
guojh commented on HDFS-14768:
--
[~ayushtkn] [~surendrasingh] Could you help review the code? I can drop the
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953443#comment-16953443
]
guojh commented on HDFS-14768:
--
[~ayushtkn] Thanks for you reply, This patch try to fix two problem, one is
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953341#comment-16953341
]
Ayush Saxena commented on HDFS-14768:
-
[~gjhkael] is the scenario you are talking is the one in
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953287#comment-16953287
]
guojh commented on HDFS-14768:
--
[~surendrasingh] If I decommission two datanode that have the block index 6
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953129#comment-16953129
]
Surendra Singh Lilhore commented on HDFS-14768:
---
Hi [~gjhkael],
Why this change is
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951255#comment-16951255
]
Surendra Singh Lilhore commented on HDFS-14768:
---
Thanks [~gjhkael] for patch.
I will
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947597#comment-16947597
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947463#comment-16947463
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947422#comment-16947422
]
guojh commented on HDFS-14768:
--
[~surendrasingh] Thanks for you reply, the
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941643#comment-16941643
]
Surendra Singh Lilhore commented on HDFS-14768:
---
Thanks [~gjhkael] for patch.
You need to
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933115#comment-16933115
]
Surendra Singh Lilhore commented on HDFS-14768:
---
Thanks [~gjhkael] for pinging me. I am on
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932966#comment-16932966
]
HuangTao commented on HDFS-14768:
-
I think the reason is that the busy node can't be in busy status
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932196#comment-16932196
]
guojh commented on HDFS-14768:
--
[~zhaoyim] Yes, I encounter the same problem.
> In some cases, erasure
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932184#comment-16932184
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] Do you means you hit the same problem about the run
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931985#comment-16931985
]
guojh commented on HDFS-14768:
--
[~zhaoyim] I am confused too. [~surendrasingh] Could you help us?
> In some
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931967#comment-16931967
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931965#comment-16931965
]
guojh commented on HDFS-14768:
--
[~zhaoyim] I am confused too. If you add break point in the check parity
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931348#comment-16931348
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931269#comment-16931269
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] Thanks for your new patch! Now, only added the UT
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931153#comment-16931153
]
guojh commented on HDFS-14768:
--
[~zhaoyim] Try the new patch.
> In some cases, erasure blocks are
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931139#comment-16931139
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] The checkstyle is not passed, please correct.
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931098#comment-16931098
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931097#comment-16931097
]
Hadoop QA commented on HDFS-14768:
--
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931021#comment-16931021
]
guojh commented on HDFS-14768:
--
[~surendrasingh] I put a new patch based on the latest code.
> In some
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931008#comment-16931008
]
guojh commented on HDFS-14768:
--
[~surendrasingh] [~zhaoyim] Used the latest code in branch trunk still have
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930340#comment-16930340
]
guojh commented on HDFS-14768:
--
[~zhaoyim] Before checkData I sleep 3min still have the checkData error.
>
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930263#comment-16930263
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] Thanks for response! I know the origin problem is
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930259#comment-16930259
]
guojh commented on HDFS-14768:
--
[~zhaoyim] The index 6 in the busy DN is correct, another index 6 block is
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930251#comment-16930251
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] Thanks for your reply! Here I am NOT very clear
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928962#comment-16928962
]
guojh commented on HDFS-14768:
--
[~zhaoyim] Yes, after you sleep 3 min, NN will reconstruct a new correct
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928701#comment-16928701
]
Zhao Yi Ming commented on HDFS-14768:
-
[~janick] Thanks for your information! I will have a look on
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928424#comment-16928424
]
guojh commented on HDFS-14768:
--
[~janick] set more numDNS, for example:
numDNs = dataBlocks + parityBlocks +
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928389#comment-16928389
]
janick.wu commented on HDFS-14768:
--
I can always hit the DN can not decommissioned successfully, the
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928356#comment-16928356
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928349#comment-16928349
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928348#comment-16928348
]
guojh commented on HDFS-14768:
--
@[~surendrasingh] I update the UT in Description to reproducing the issue,
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928344#comment-16928344
]
guojh commented on HDFS-14768:
--
[~zhaoyim] The key point about this issue is make one datanode busy. Then
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928181#comment-16928181
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928172#comment-16928172
]
Zhao Yi Ming commented on HDFS-14768:
-
One more information, hope it can give help. Through
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928167#comment-16928167
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] Thanks for your update! Here is one question, in
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928146#comment-16928146
]
guojh commented on HDFS-14768:
--
[~zhaoyim] My UT is not good, you need to check the block manually, I will
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928145#comment-16928145
]
guojh commented on HDFS-14768:
--
[~surendrasingh] Sorry about my UT. I will update a new UT to check the
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927616#comment-16927616
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927610#comment-16927610
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] I tried the following code(which you said can
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927253#comment-16927253
]
Surendra Singh Lilhore commented on HDFS-14768:
---
Thanks [~gjhkael].
{quote}you need run the
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927183#comment-16927183
]
HuangTao commented on HDFS-14768:
-
[~zhaoyim] you can change the
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926596#comment-16926596
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] Also following steps I am not very clear, could you
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926590#comment-16926590
]
Zhao Yi Ming commented on HDFS-14768:
-
[~gjhkael] I applied your UT in my env and found the compile
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925298#comment-16925298
]
guojh commented on HDFS-14768:
--
[~surendrasingh] Thanks for you replay. you need run the code below, and you
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16925231#comment-16925231
]
Surendra Singh Lilhore commented on HDFS-14768:
---
[~gjhkael], Thanks for patch.
I feel
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922566#comment-16922566
]
Ayush Saxena commented on HDFS-14768:
-
Thanx [~gjhkael] for the patch.
There seems to be some
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917079#comment-16917079
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915527#comment-16915527
]
Hadoop QA commented on HDFS-14768:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
66 matches
Mail list logo