[
https://issues.apache.org/jira/browse/HDFS-14297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772780#comment-16772780
]
Tao Jie commented on HDFS-14297:
Thank you [~xkrogen], {{getContentSummary}} is invoked f
[
https://issues.apache.org/jira/browse/HDFS-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772535#comment-16772535
]
Tao Jie commented on HDFS-14219:
Thank you [~vagarychen] for your comments. I've run fail
[
https://issues.apache.org/jira/browse/HDFS-14297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-14297:
---
Description:
In a large HDFS cluster, calling {{getContentSummary}} for a directory with
large amount of fil
Tao Jie created HDFS-14297:
--
Summary: Add cache for getContentSummary() result
Key: HDFS-14297
URL: https://issues.apache.org/jira/browse/HDFS-14297
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-14219:
---
Attachment: HDFS-14129-branch-2.8.001.patch
> ConcurrentModificationException occurs in datanode occasionally
[
https://issues.apache.org/jira/browse/HDFS-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-14219:
---
Status: Patch Available (was: Open)
> ConcurrentModificationException occurs in datanode occasionally
>
[
https://issues.apache.org/jira/browse/HDFS-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie reassigned HDFS-14219:
--
Assignee: Tao Jie
> ConcurrentModificationException occurs in datanode occasionally
>
[
https://issues.apache.org/jira/browse/HDFS-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16770796#comment-16770796
]
Tao Jie commented on HDFS-14219:
I checked code in FsDatasetImpl.java, it seems missed on
[
https://issues.apache.org/jira/browse/HDFS-14219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-14219:
---
Attachment: HDFS-14219.001.patch
> ConcurrentModificationException occurs in datanode occasionally
>
Tao Jie created HDFS-14219:
--
Summary: ConcurrentModificationException occurs in datanode
occasionally
Key: HDFS-14219
URL: https://issues.apache.org/jira/browse/HDFS-14219
Project: Hadoop HDFS
Issu
[
https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16563185#comment-16563185
]
Tao Jie commented on HDFS-13769:
Add documents and fixed findbugs in the latest patch
>
[
https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13769:
---
Attachment: HDFS-13769.004.patch
> Namenode gets stuck when deleting large dir in trash
> ---
[
https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13769:
---
Attachment: HDFS-13769.003.patch
> Namenode gets stuck when deleting large dir in trash
> ---
[
https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16559568#comment-16559568
]
Tao Jie commented on HDFS-13769:
Updated the patch with [~linyiqun] 's suggestion. In 2 t
[
https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13769:
---
Attachment: HDFS-13769.002.patch
> Namenode gets stuck when deleting large dir in trash
> ---
[
https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16559125#comment-16559125
]
Tao Jie commented on HDFS-13769:
[~csun], I agree with [~kihwal]. We cannot use this log
[
https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558292#comment-16558292
]
Tao Jie commented on HDFS-13769:
Hi, [~jojochuang] , the version of our cluster is 2.8.2,
[
https://issues.apache.org/jira/browse/HDFS-13769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13769:
---
Attachment: HDFS-13769.001.patch
> Namenode gets stuck when deleting large dir in trash
> ---
Tao Jie created HDFS-13769:
--
Summary: Namenode gets stuck when deleting large dir in trash
Key: HDFS-13769
URL: https://issues.apache.org/jira/browse/HDFS-13769
Project: Hadoop HDFS
Issue Type: Impr
[
https://issues.apache.org/jira/browse/HDFS-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie reassigned HDFS-13032:
--
Assignee: Tao Jie
> Make AvailableSpaceBlockPlacementPolicy more adaptive
> --
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439024#comment-16439024
]
Tao Jie commented on HDFS-13279:
Updated the patch. With the commit in HDFS-13418, we have
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Attachment: HDFS-13279.006.patch
> Datanodes usage is imbalanced if number of nodes per rack is not equal
> --
[
https://issues.apache.org/jira/browse/HDFS-13411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16437059#comment-16437059
]
Tao Jie commented on HDFS-13411:
This patch is quite simple, [~arpitagarwal], [~hanishakon
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13418:
---
Attachment: HDFS-13418-branch2.001.patch
> NetworkTopology should be configurable when enable DFSNetworkTopol
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13418:
---
Attachment: HDFS-13418.004.patch
> NetworkTopology should be configurable when enable DFSNetworkTopology
> --
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13418:
---
Attachment: HDFS-13418.003.patch
> NetworkTopology should be configurable when enable DFSNetworkTopology
> --
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433678#comment-16433678
]
Tao Jie commented on HDFS-13418:
Thank you [~linyiqun] for your comments.
For the UT, I th
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433553#comment-16433553
]
Tao Jie commented on HDFS-13418:
Updated the patch in which added default property in hdfs
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13418:
---
Attachment: HDFS-13418.002.patch
> NetworkTopology should be configurable when enable DFSNetworkTopology
> --
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432482#comment-16432482
]
Tao Jie commented on HDFS-13279:
Thank you [~ajayydv] for reply!
1, I set up another jira
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432029#comment-16432029
]
Tao Jie commented on HDFS-13418:
Thank you [~linyiqun] for your patient explanation.
I att
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13418:
---
Attachment: HDFS-13418.001.patch
> NetworkTopology should be configurable when enable DFSNetworkTopology
> --
[
https://issues.apache.org/jira/browse/HDFS-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431728#comment-16431728
]
Tao Jie commented on HDFS-13418:
[~linyiqun] Thank you for your comment. I feel a little t
Tao Jie created HDFS-13418:
--
Summary: NetworkTopology should be configurable when enable
DFSNetworkTopology
Key: HDFS-13418
URL: https://issues.apache.org/jira/browse/HDFS-13418
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-13411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430193#comment-16430193
]
Tao Jie commented on HDFS-13411:
Fixed failed test and checkstyle.
> Should log more info
[
https://issues.apache.org/jira/browse/HDFS-13411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13411:
---
Attachment: HDFS-13411.002.patch
> Should log more information when FSNameSystem is locked for a long time
> -
[
https://issues.apache.org/jira/browse/HDFS-13411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13411:
---
Attachment: HDFS-13411.001.patch
> Should log more information when FSNameSystem is locked for a long time
> -
[
https://issues.apache.org/jira/browse/HDFS-13411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13411:
---
Status: Patch Available (was: Open)
> Should log more information when FSNameSystem is locked for a long time
Tao Jie created HDFS-13411:
--
Summary: Should log more information when FSNameSystem is locked
for a long time
Key: HDFS-13411
URL: https://issues.apache.org/jira/browse/HDFS-13411
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16427895#comment-16427895
]
Tao Jie commented on HDFS-13279:
[~ajayydv] Thank you for your comments.
{quote}
Don't rem
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Attachment: HDFS-13279.005.patch
> Datanodes usage is imbalanced if number of nodes per rack is not equal
> --
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Attachment: HDFS-13279.004.patch
> Datanodes usage is imbalanced if number of nodes per rack is not equal
> --
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Attachment: (was: HDFS-13279.004.patch)
> Datanodes usage is imbalanced if number of nodes per rack is not
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Attachment: HDFS-13279.004.patch
> Datanodes usage is imbalanced if number of nodes per rack is not equal
> --
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16413612#comment-16413612
]
Tao Jie commented on HDFS-13279:
Thank you [~ajayydv] for your comments.
{quote}
Instead i
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Attachment: HDFS-13279.003.patch
> Datanodes usage is imbalanced if number of nodes per rack is not equal
> --
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Attachment: HDFS-13279.002.patch
> Datanodes usage is imbalanced if number of nodes per rack is not equal
> --
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Status: Patch Available (was: Open)
> Datanodes usage is imbalanced if number of nodes per rack is not equal
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16407728#comment-16407728
]
Tao Jie commented on HDFS-13279:
Updated patch and add a flag in
configuration:{{net.topo
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Attachment: HDFS-13279.001.patch
> Datanodes usage is imbalanced if number of nodes per rack is not equal
> --
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16400065#comment-16400065
]
Tao Jie commented on HDFS-13279:
It seems not easy to make probability absolutely equal fo
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Description:
In a Hadoop cluster, number of nodes on a rack could be different. For example,
we have 50 Datan
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Description:
In a Hadoop cluster, number of nodes on a rack could be different. For example,
we have 50 Datan
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Affects Version/s: 2.8.3
3.0.0
> Datanodes usage is imbalanced if number of nodes per r
[
https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13279:
---
Summary: Datanodes usage is imbalanced if number of nodes per rack is not
equal (was: Datanodes usage is imba
Tao Jie created HDFS-13279:
--
Summary: Datanodes usage is imbalanced if node
Key: HDFS-13279
URL: https://issues.apache.org/jira/browse/HDFS-13279
Project: Hadoop HDFS
Issue Type: Bug
Rep
[
https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389026#comment-16389026
]
Tao Jie edited comment on HDFS-13214 at 3/7/18 4:56 AM:
Sorry for
[
https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389026#comment-16389026
]
Tao Jie commented on HDFS-13214:
Sorry for replying late and thank you [~linyiqun] [~elgoi
[
https://issues.apache.org/jira/browse/HDFS-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13219:
---
Issue Type: Sub-task (was: Bug)
Parent: HDFS-12615
> RBF:Cluster information on Router is not correct
Tao Jie created HDFS-13219:
--
Summary: RBF:Cluster information on Router is not correct when the
Federation shares datanodes.
Key: HDFS-13219
URL: https://issues.apache.org/jira/browse/HDFS-13219
Project: Had
[
https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383236#comment-16383236
]
Tao Jie commented on HDFS-13214:
[~elgoiri] [~ywskycn] [~linyiqun] thank you for your resp
[
https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13214:
---
Description:
In a typical router-based federation cluster, hdfs-site.xml is supposed to be:
{code}
dfs.na
Tao Jie created HDFS-13214:
--
Summary: RBF: Configuration on Router conflicts with client side
configuration
Key: HDFS-13214
URL: https://issues.apache.org/jira/browse/HDFS-13214
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13032:
---
Attachment: HDFS-13032.002.patch
> Make AvailableSpaceBlockPlacementPolicy more adaptive
> ---
[
https://issues.apache.org/jira/browse/HDFS-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-13032:
---
Status: Patch Available (was: Open)
> Make AvailableSpaceBlockPlacementPolicy more adaptive
> ---
[
https://issues.apache.org/jira/browse/HDFS-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15971129#comment-15971129
]
Tao Jie commented on HDFS-11638:
In the attached patch, we add an option in dfsadmin:
{{hd
[
https://issues.apache.org/jira/browse/HDFS-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tao Jie updated HDFS-11638:
---
Attachment: HDFS-11638-001.patch
> Support marking a datanode dead by DFSAdmin
> -
[
https://issues.apache.org/jira/browse/HDFS-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963715#comment-15963715
]
Tao Jie commented on HDFS-11638:
[~shahrs87], yes , in this case, when the datanode began
Tao Jie created HDFS-11638:
--
Summary: Support marking a datanode dead by DFSAdmin
Key: HDFS-11638
URL: https://issues.apache.org/jira/browse/HDFS-11638
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804190#comment-15804190
]
Tao Jie commented on HDFS-9149:
---
Hi, [~hexiaoqiao],
We have the similar situation, and I wond
[
https://issues.apache.org/jira/browse/HDFS-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15270024#comment-15270024
]
Tao Jie commented on HDFS-10359:
[~kihwal], [~cnauroth], [~arpitagarwal], [~linyiqun] Than
Tao Jie created HDFS-10359:
--
Summary: Allow trigger block report from all datanodes
Key: HDFS-10359
URL: https://issues.apache.org/jira/browse/HDFS-10359
Project: Hadoop HDFS
Issue Type: Improvement
72 matches
Mail list logo
