[
https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Virajith Jalaparti updated HDFS-12777:
--------------------------------------
Description:
As opposed to local blocks, each DN keeps track of all blocks in PROVIDED
storage. This can be millions of blocks for 100s of TBs of PROVIDED data. This
JIRA aims to reduce the memory footprint of these blocks by using a common URI
prefix across all PROVIDED blocks.
Further, with so many blocks the DirectoryScanner can take up a lot of
was:As opposed to local blocks, each DN keeps track of all blocks in PROVIDED
storage. This can be millions of blocks for 100s of TBs of PROVIDED data. This
JIRA aims to reduce the memory footprint of these blocks by using a common URI
prefix across all PROVIDED blocks.
> [READ] Reduce memory and CPU footprint for PROVIDED volumes.
> ------------------------------------------------------------
>
> Key: HDFS-12777
> URL: https://issues.apache.org/jira/browse/HDFS-12777
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Virajith Jalaparti
> Priority: Major
>
> As opposed to local blocks, each DN keeps track of all blocks in PROVIDED
> storage. This can be millions of blocks for 100s of TBs of PROVIDED data.
> This JIRA aims to reduce the memory footprint of these blocks by using a
> common URI prefix across all PROVIDED blocks.
> Further, with so many blocks the DirectoryScanner can take up a lot of
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
