[
https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shen Yinjie updated HDFS-15631:
---
Status: Patch Available (was: Open)
> RBF: dfsadmin -report multiple capacity and used info
>
[
https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shen Yinjie updated HDFS-15631:
---
Status: Open (was: Patch Available)
> RBF: dfsadmin -report multiple capacity and used info
>
[
https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shen Yinjie updated HDFS-15631:
---
Attachment: HDFS-15631_2.patch
> RBF: dfsadmin -report multiple capacity and used info
>
[
https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shen Yinjie updated HDFS-15631:
---
Attachment: (was: HDFS-15631_2.patch)
> RBF: dfsadmin -report multiple capacity and used info
>
[
https://issues.apache.org/jira/browse/HDFS-15639?focusedWorklogId=502037=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-502037
]
ASF GitHub Bot logged work on HDFS-15639:
-
Author: ASF GitHub Bot
[
https://issues.apache.org/jira/browse/HDFS-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216512#comment-17216512
]
Hadoop QA commented on HDFS-14431:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinglun updated HDFS-15640:
---
Attachment: HDFS-15640.001.patch
Status: Patch Available (was: Open)
> RBF: Add fast distcp
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: RefreshNameNode_DeadLock.png
> DataNode could meet deadlock if invoke
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: RefreshNameNode_DeadLock.jstack
> DataNode could meet deadlock if invoke
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoqiao He updated HDFS-15641:
---
Target Version/s: 3.2.2, 3.3.1, 3.4.0, 3.2.3 (was: 3.2.2, 3.2.3)
> DataNode could meet deadlock if
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoqiao He updated HDFS-15641:
---
Target Version/s: 3.2.2, 3.2.3
> DataNode could meet deadlock if invoke refreshNameNode
>
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: (was: RefreshNameNode_DeadLock.jstack)
> DataNode could meet deadlock if invoke
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: jstack.log
> DataNode could meet deadlock if invoke refreshNameNode
>
[
https://issues.apache.org/jira/browse/HDFS-15639?focusedWorklogId=502185=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-502185
]
ASF GitHub Bot logged work on HDFS-15639:
-
Author: ASF GitHub Bot
[
https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinglun reopened HDFS-15294:
> Federation balance tool
> ---
>
> Key: HDFS-15294
> URL:
[
https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinglun reassigned HDFS-15640:
--
Assignee: Jinglun
> RBF: Add fast distcp threshold to FedBalance.
>
Hongbing Wang created HDFS-15641:
Summary: DataNode could meet deadlock if invoke refreshNameNode
Key: HDFS-15641
URL: https://issues.apache.org/jira/browse/HDFS-15641
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Description:
DataNode could meet deadlock when invoke `hdfs dfsadmin -refreshNamenodes
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: deadlock.png
> DataNode could meet deadlock if invoke refreshNameNode
>
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: (was: RefreshNameNode_DeadLock.png)
> DataNode could meet deadlock if invoke
Jinglun created HDFS-15640:
--
Summary: RBF: Add fast distcp threshold to FedBalance.
Key: HDFS-15640
URL: https://issues.apache.org/jira/browse/HDFS-15640
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: HDFS-15641.000.test.patch
> DataNode could meet deadlock if invoke refreshNameNode
>
[
https://issues.apache.org/jira/browse/HDFS-15639?focusedWorklogId=502159=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-502159
]
ASF GitHub Bot logged work on HDFS-15639:
-
Author: ASF GitHub Bot
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Description:
DataNode could meet deadlock when invoke `hdfs dfsadmin -refreshNamenodes
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
gaozhan ding updated HDFS-15642:
Environment:
hadoop 3.1.1
EC RS-3-2-1024k
6 datanodes
was:
hadoop 3.1.1
EC RS-3-2-1024k
gaozhan ding created HDFS-15642:
---
Summary: EC:radmon error when enable ec policy on hbase data
Key: HDFS-15642
URL: https://issues.apache.org/jira/browse/HDFS-15642
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216705#comment-17216705
]
Xiaoqiao He commented on HDFS-15640:
Thanks [~LiJinglun] involve me here. [~linyiqun] would be more
[
https://issues.apache.org/jira/browse/HDFS-15639?focusedWorklogId=502180=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-502180
]
ASF GitHub Bot logged work on HDFS-15639:
-
Author: ASF GitHub Bot
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216553#comment-17216553
]
Hadoop QA commented on HDFS-15630:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jinglun updated HDFS-15640:
---
Parent: HDFS-15294
Issue Type: Sub-task (was: Improvement)
> RBF: Add fast distcp threshold to
[
https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216623#comment-17216623
]
Hadoop QA commented on HDFS-15640:
--
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem
[
https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216571#comment-17216571
]
Hadoop QA commented on HDFS-15631:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216585#comment-17216585
]
Jinglun commented on HDFS-15640:
Hi [~linyiqun], [~hexiaoqiao], do you have time to help reviewing this,
[
https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216585#comment-17216585
]
Jinglun edited comment on HDFS-15640 at 10/19/20, 10:13 AM:
Hi [~linyiqun],
[
https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shen Yinjie updated HDFS-15631:
---
Attachment: (was: HDFS-15631_2.patch)
> RBF: dfsadmin -report multiple capacity and used info
>
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216690#comment-17216690
]
Hongbing Wang commented on HDFS-15641:
--
I add one test [^HDFS-15641.000.test.patch] to reproduce
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216703#comment-17216703
]
Xiaoqiao He commented on HDFS-15641:
Thanks [~wanghongbing] for your report. Great catch here! mark
[
https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ahmed Hussein updated HDFS-15643:
-
Description:
There are many failures in {{TestFileChecksumCompositeCrc}}. The test cases
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216878#comment-17216878
]
Hongbing Wang edited comment on HDFS-15641 at 10/19/20, 4:38 PM:
-
[
https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ahmed Hussein updated HDFS-15618:
-
Comment: was deleted
(was: HDFS-15461TestDFSClientRetries#testGetFileChecksum fails
[
https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216855#comment-17216855
]
Ahmed Hussein commented on HDFS-15618:
--
HDFS-15461TestDFSClientRetries#testGetFileChecksum fails
[
https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216873#comment-17216873
]
Ahmed Hussein commented on HDFS-15618:
--
Those are liras filed for the failing test cases.
[
https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216873#comment-17216873
]
Ahmed Hussein edited comment on HDFS-15618 at 10/19/20, 4:31 PM:
-
Those
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216814#comment-17216814
]
Íñigo Goiri commented on HDFS-15630:
Thanks [~smarthan] for [^HDFS-15630.004.patch].
It looks
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: HDFS-15641.001.patch
> DataNode could meet deadlock if invoke refreshNameNode
>
[
https://issues.apache.org/jira/browse/HDFS-15639?focusedWorklogId=502246=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-502246
]
ASF GitHub Bot logged work on HDFS-15639:
-
Author: ASF GitHub Bot
Ahmed Hussein created HDFS-15643:
Summary: TestFileChecksumCompositeCrc fails on trunk
Key: HDFS-15643
URL: https://issues.apache.org/jira/browse/HDFS-15643
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mukund Thakur resolved HDFS-15626.
--
Resolution: Fixed
> TestWebHDFS.testLargeDirectory failing
>
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216878#comment-17216878
]
Hongbing Wang commented on HDFS-15641:
--
{{{quote} }}
{{just wonder if this issue is also in trunk}}
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216886#comment-17216886
]
Hongbing Wang commented on HDFS-15641:
--
I adjusted the thread start sequence in BPServiceActor to
[
https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216885#comment-17216885
]
Ahmed Hussein commented on HDFS-15308:
--
[~touchida], Thanks for taking a look at that failure.
I
[
https://issues.apache.org/jira/browse/HDFS-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216901#comment-17216901
]
Hector Sandoval Chaverri commented on HDFS-15623:
-
Hi [~jianghuazhu],
Thanks for looking
[
https://issues.apache.org/jira/browse/HDFS-15597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216969#comment-17216969
]
Wei-Chiu Chuang edited comment on HDFS-15597 at 10/19/20, 5:49 PM:
---
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217036#comment-17217036
]
Wei-Chiu Chuang commented on HDFS-15642:
There were a number of EC corruption bugs fixed in more
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216878#comment-17216878
]
Hongbing Wang edited comment on HDFS-15641 at 10/19/20, 4:50 PM:
-
[
https://issues.apache.org/jira/browse/HDFS-15597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216969#comment-17216969
]
Wei-Chiu Chuang commented on HDFS-15597:
{quote}replication 0 or 1? IIRC its 1.
{quote}
My bad. A
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: (was: HDFS-15641.000.test.patch)
> DataNode could meet deadlock if invoke
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: (was: HDFS-15641.001.patch)
> DataNode could meet deadlock if invoke
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbing Wang updated HDFS-15641:
-
Attachment: HDFS-15641.001.patch
> DataNode could meet deadlock if invoke refreshNameNode
>
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217231#comment-17217231
]
gaozhan ding commented on HDFS-15642:
-
[~ferhui] Hi, When study this problem, I have some doubts
[
https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216886#comment-17216886
]
Hongbing Wang edited comment on HDFS-15641 at 10/20/20, 3:14 AM:
-
I
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hui Fei updated HDFS-15630:
---
Attachment: HDFS-15630.test.patch
> RBF: Fix wrong client IP info in CallerContext when requests mount
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217233#comment-17217233
]
Hui Fei commented on HDFS-15630:
There is another way to fix this.
There are more same client ips with
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217233#comment-17217233
]
Hui Fei edited comment on HDFS-15630 at 10/20/20, 3:14 AM:
---
There is another
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217233#comment-17217233
]
Hui Fei edited comment on HDFS-15630 at 10/20/20, 3:15 AM:
---
There is another
[
https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217072#comment-17217072
]
Hadoop QA commented on HDFS-15308:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-14941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140608#comment-17140608
]
Kihwal Lee edited comment on HDFS-14941 at 10/19/20, 9:17 PM:
--
Filed
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217191#comment-17217191
]
Hui Fei commented on HDFS-15642:
Interesting. Have no experience HBase on EC.
Maybe is it a reproduce
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217248#comment-17217248
]
Chengwei Wang commented on HDFS-15630:
--
[~elgoiri], thanks for your comment.
I think that split
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217249#comment-17217249
]
Chengwei Wang commented on HDFS-15630:
--
[~ferhui], thanks for your patch.
Move calling
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217231#comment-17217231
]
gaozhan ding edited comment on HDFS-15642 at 10/20/20, 4:40 AM:
[~ferhui]
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217265#comment-17217265
]
Ayush Saxena commented on HDFS-15642:
-
bq. But code may unable to pass checkMissingBlocks.
Which one
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217268#comment-17217268
]
gaozhan ding commented on HDFS-15642:
-
[~ayushtkn] In function readStripe(), missingChunksNum may
[
https://issues.apache.org/jira/browse/HDFS-15630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217270#comment-17217270
]
Hadoop QA commented on HDFS-15630:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem ||
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217272#comment-17217272
]
Ayush Saxena commented on HDFS-15642:
-
Then the total missing blocks are 3? Which should fail only,
[
https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217287#comment-17217287
]
gaozhan ding commented on HDFS-15642:
-
[~ayushtkn] Thank you for your reply! Your reply perfectly
76 matches
Mail list logo