[
https://issues.apache.org/jira/browse/HDFS-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172078#comment-17172078
]
Amithsha commented on HDFS-15468:
-
This could be because of breaching the JN Quorum. Try restarting in
[
https://issues.apache.org/jira/browse/HDFS-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha resolved HDFS-15511.
-
Resolution: Resolved
> Support AvailableSpaceBlockPlacementPolicy in
>
[
https://issues.apache.org/jira/browse/HDFS-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170580#comment-17170580
]
Amithsha commented on HDFS-15511:
-
[~ayushtkn] Yes this solves our use case!
> Support
[
https://issues.apache.org/jira/browse/HDFS-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170545#comment-17170545
]
Amithsha commented on HDFS-15511:
-
[~ayushsaxena]
[~weichiu]
FYI
> Support
Amithsha created HDFS-15511:
---
Summary: Support AvailableSpaceBlockPlacementPolicy in
BlockPlacementPolicyRackFaultTolerant
Key: HDFS-15511
URL: https://issues.apache.org/jira/browse/HDFS-15511
Project:
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141691#comment-17141691
]
Amithsha commented on HDFS-14546:
-
Great!! Thanks, [~ayushtkn] for taking this to commit. Thanks,
[
https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050750#comment-17050750
]
Amithsha commented on HDFS-7702:
[~xiyunyue] we are looking for a tool to move the metadata from one
[
https://issues.apache.org/jira/browse/HDFS-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047582#comment-17047582
]
Amithsha edited comment on HDFS-15195 at 3/2/20 6:51 AM:
-
Yes
[
https://issues.apache.org/jira/browse/HDFS-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047582#comment-17047582
]
Amithsha commented on HDFS-15195:
-
Yes https://issues.apache.org/jira/browse/HDFS-7702 this is my
Amithsha created HDFS-15195:
---
Summary: In place namenode fedaration
Key: HDFS-15195
URL: https://issues.apache.org/jira/browse/HDFS-15195
Project: Hadoop HDFS
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011430#comment-17011430
]
Amithsha commented on HDFS-14546:
-
[~weichiu] my bad AvailableSpaceBlockPlacementPolicy should be added.
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006058#comment-17006058
]
Amithsha edited comment on HDFS-14546 at 12/31/19 11:27 AM:
Ya, we can add
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006058#comment-17006058
]
Amithsha commented on HDFS-14546:
-
Ya, we can add AvailableSpaceBlockPlacementPolicy, but I thought
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17005962#comment-17005962
]
Amithsha commented on HDFS-14546:
-
No update on PR comments so removed from this Jira.
> Document block
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002640#comment-17002640
]
Amithsha commented on HDFS-14546:
-
class name is *org.apache.hadoop.hdfs.server.blockmanagement* and not
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HDFS-14546-08.patch
> Document block placement policies
> -
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991110#comment-16991110
]
Amithsha commented on HDFS-14546:
-
[~weichiu] FYI
Removed the PR from JIRA.
> Document block
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987504#comment-16987504
]
Amithsha commented on HDFS-14546:
-
[~weichiu] Yes will remove the PR from jira. Have updated the git but
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984164#comment-16984164
]
Amithsha commented on HDFS-14546:
-
[~ayushtkn] since the ticket has been marked as the patch available.
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983430#comment-16983430
]
Amithsha commented on HDFS-14546:
-
sure [~ayushtkn]
> Document block placement policies
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983415#comment-16983415
]
Amithsha commented on HDFS-14546:
-
haven't updated the git pr will update and check his comment and also
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983362#comment-16983362
]
Amithsha commented on HDFS-14546:
-
[~ayushtkn] you mean in git PR ?
> Document block placement policies
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HDFS-14546-07.patch
> Document block placement policies
> -
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16981424#comment-16981424
]
Amithsha commented on HDFS-14546:
-
[~ayushtkn] [~elgoiri] Changes done.
> Document block placement
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952653#comment-16952653
]
Amithsha commented on HDFS-14546:
-
changes done
[~elgoiri] [~ayushtkn]
> Document block placement
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HDFS-14546-06.patch
> Document block placement policies
> -
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942101#comment-16942101
]
Amithsha commented on HDFS-14546:
-
this is an image, thats the reason have mentioned the git PR url.
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941882#comment-16941882
]
Amithsha commented on HDFS-14546:
-
[~elgoiri] [~ayushtkn] sorry for the delay added the details in
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HDFS-14546-05.patch
> Document block placement policies
> -
>
[
https://issues.apache.org/jira/browse/HDFS-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899452#comment-16899452
]
Amithsha commented on HDFS-14264:
-
Yes this is due to no of disks and the usage, in our environment of
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880930#comment-16880930
]
Amithsha commented on HDFS-14546:
-
[~elgoiri] Yes we should provide a subpage with details of all
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872488#comment-16872488
]
Amithsha commented on HDFS-14546:
-
Done.
Thanks for the External links.
> Document block placement
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HDFS-14546-04.patch
> Document block placement policies
> -
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872403#comment-16872403
]
Amithsha commented on HDFS-14546:
-
Added the latest patch.
> Document block placement policies
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HDFS-14546-03.patch
> Document block placement policies
> -
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872365#comment-16872365
]
Amithsha commented on HDFS-14546:
-
I have cloned the branch-3.1.1 and made the changes finally generated
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872351#comment-16872351
]
Amithsha commented on HDFS-14546:
-
Missed to remove the hard link. In HDFS-14546-02.patch it got removed
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HDFS-14546-02.patch
> Document block placement policies
> -
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872323#comment-16872323
]
Amithsha commented on HDFS-14546:
-
Changes done.
> Document block placement policies
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HDFS-14546-01.patch
> Document block placement policies
> -
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: HdfsDesign.patch
> Document block placement policies
> -
>
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16872175#comment-16872175
]
Amithsha commented on HDFS-14546:
-
[~ayushtkn]
Added the patch. This will give the overview and
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: (was: blockPoliciesHdfsDesign.md)
> Document block placement policies
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14546:
Attachment: blockPoliciesHdfsDesign.md
> Document block placement policies
>
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870903#comment-16870903
]
Amithsha commented on HDFS-14546:
-
Since attachment is not visible and no option to add patch shared the
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870902#comment-16870902
]
Amithsha commented on HDFS-14220:
-
Thanks [~elgoiri] Added my comments and added the attachement for
[
https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870901#comment-16870901
]
Amithsha commented on HDFS-14546:
-
Added intro about block policies this will give intro and also users
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857219#comment-16857219
]
Amithsha commented on HDFS-14220:
-
[~brahmareddy] & [~goiri] Thanks for pointing to the
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855391#comment-16855391
]
Amithsha commented on HDFS-14220:
-
[~elgoiri] node groups? I am not sure about this can you provide more
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855295#comment-16855295
]
Amithsha commented on HDFS-14220:
-
[~ayushtkn] This patch is sufficient to solve our use case.
>
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853990#comment-16853990
]
Amithsha commented on HDFS-14220:
-
[~ayushtkn] Thanks for the patch.
> Enable Replica Placement Value
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853075#comment-16853075
]
Amithsha commented on HDFS-14220:
-
[~ayushtkn] We faced some issue where the rack with 2 blocks going for
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810493#comment-16810493
]
Amithsha edited comment on HDFS-14220 at 4/5/19 5:06 AM:
-
Yes, we had a scenario
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810493#comment-16810493
]
Amithsha commented on HDFS-14220:
-
Yes, we had a scenario where 2 writes happening on the same rack which
Amithsha created HDFS-14264:
---
Summary: Datanode du -sk command is slow
Key: HDFS-14264
URL: https://issues.apache.org/jira/browse/HDFS-14264
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14264:
Description:
Datanode consuming more time on du -sk command as well as creating heavy IO on
disk. In our
[
https://issues.apache.org/jira/browse/HDFS-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-14220:
Description:
By default, Replica placement per rack will be taken care by
Amithsha created HDFS-14220:
---
Summary: Enable Replica Placement Value Per Rack
Key: HDFS-14220
URL: https://issues.apache.org/jira/browse/HDFS-14220
Project: Hadoop HDFS
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/HDFS-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-10728:
Comment: was deleted
(was: This is because of java network ip cache,
*networkaddress.cache.ttl = -1
[
https://issues.apache.org/jira/browse/HDFS-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680924#comment-16680924
]
Amithsha commented on HDFS-10728:
-
This is because of java network ip cache,
*networkaddress.cache.ttl
[
https://issues.apache.org/jira/browse/HDFS-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha resolved HDFS-13828.
-
Resolution: Not A Problem
> DataNode breaching Xceiver Count
>
>
>
[
https://issues.apache.org/jira/browse/HDFS-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591139#comment-16591139
]
Amithsha commented on HDFS-13828:
-
We found that hive job referring to one particular block.
Which
[
https://issues.apache.org/jira/browse/HDFS-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-13828:
Issue Type: Bug (was: Task)
> DataNode breaching Xceiver Count
>
>
>
[
https://issues.apache.org/jira/browse/HDFS-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-13828:
Comment: was deleted
(was: Moved from bug to task. )
> DataNode breaching Xceiver Count
>
[
https://issues.apache.org/jira/browse/HDFS-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581358#comment-16581358
]
Amithsha commented on HDFS-13828:
-
Moved from bug to task.
> DataNode breaching Xceiver Count
>
[
https://issues.apache.org/jira/browse/HDFS-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581356#comment-16581356
]
Amithsha commented on HDFS-13828:
-
Agree on xceiver count may be not sufficient but why for a particular
[
https://issues.apache.org/jira/browse/HDFS-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amithsha updated HDFS-13828:
Issue Type: Task (was: Bug)
> DataNode breaching Xceiver Count
>
>
>
[
https://issues.apache.org/jira/browse/HDFS-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581356#comment-16581356
]
Amithsha edited comment on HDFS-13828 at 8/15/18 5:06 PM:
--
Agree on xceiver
Amithsha created HDFS-13828:
---
Summary: DataNode breaching Xceiver Count
Key: HDFS-13828
URL: https://issues.apache.org/jira/browse/HDFS-13828
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410396#comment-15410396
]
Amithsha commented on HDFS-1052:
And
By Default i am mentioning the both the namenodes IP's in Conf
so why
[
https://issues.apache.org/jira/browse/HDFS-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410387#comment-15410387
]
Amithsha commented on HDFS-1052:
Hi all,
>From the doc and examples i could see that Namenode Federation
71 matches
Mail list logo
