[
https://issues.apache.org/jira/browse/HDFS-8580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su updated HDFS-8580:
----------------------------
Description:
Zhe Zhang, Kai Zheng and I had a offline discussion. Here is what we thought:
Add a cellSize field in BlockInfoStriped as a workaround, and deal with memory
usage in follow-on.(HDFS-8059)
discussion in HDFS-8494:
from Walter Su:
{quote}
I think BlockInfoStriped needs to keep cellSize.
{quote}
from [~vinayrpet]:
{quote}
I too was thinking the same when the FSImageLoader problem has came up.
{quote}
from [~jingzhao]
{quote}
Also, we should consider adding a chunk size field to StripedBlockProto and
removing the cell size field from HdfsFileStatus. In this way we can access the
chunk size information in the storage layer.
{quote}
was:
Zhe Zhang, Kai Zheng and I had a offline discussion. Here is what we thought:
Add a cellSize field in BlockInfoStriped as a workaround, and deal with memory
usage in follow-on.
discussion in HDFS-8494:
from [~jingzhao]
{quote}
Also, we should consider adding a chunk size field to StripedBlockProto and
removing the cell size field from HdfsFileStatus. In this way we can access the
chunk size information in the storage layer.
{quote}
> Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlockProto
> --------------------------------------------------------------------------
>
> Key: HDFS-8580
> URL: https://issues.apache.org/jira/browse/HDFS-8580
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Walter Su
> Assignee: Walter Su
>
> Zhe Zhang, Kai Zheng and I had a offline discussion. Here is what we thought:
> Add a cellSize field in BlockInfoStriped as a workaround, and deal with
> memory usage in follow-on.(HDFS-8059)
> discussion in HDFS-8494:
> from Walter Su:
> {quote}
> I think BlockInfoStriped needs to keep cellSize.
> {quote}
> from [~vinayrpet]:
> {quote}
> I too was thinking the same when the FSImageLoader problem has came up.
> {quote}
> from [~jingzhao]
> {quote}
> Also, we should consider adding a chunk size field to StripedBlockProto and
> removing the cell size field from HdfsFileStatus. In this way we can access
> the chunk size information in the storage layer.
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
