[
https://issues.apache.org/jira/browse/PARQUET-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16753607#comment-16753607
]
BELUGA BEHR commented on PARQUET-1514:
--------------------------------------
This may be a non-issue. This may be on purpose. However, my understand is
correct, and this is indeed supposed to be uncompressed byes. I have provided
a PR.
> ParquetFileWriter Records Compressed Bytes instead of Uncompressed Bytes
> ------------------------------------------------------------------------
>
> Key: PARQUET-1514
> URL: https://issues.apache.org/jira/browse/PARQUET-1514
> Project: Parquet
> Issue Type: Bug
> Reporter: BELUGA BEHR
> Assignee: BELUGA BEHR
> Priority: Minor
> Labels: pull-request-available
>
> As I understand it, the class {{BlockMetaData}} has a {{getTotalByteSize}}
> and a {{getCompressedSize}}. However, in the case of {{ParquetFileWriter}},
> there is one place where the compressed size is being written into
> {{totalByteSize}} instead of the uncompressed size. This looks incorrect.
> {code:java|title=ParquetFileWriter}
> private BlockMetaData currentBlock;
> ...
> public void appendRowGroup(SeekableInputStream from, BlockMetaData rowGroup,
> boolean dropColumns) throws IOException {
> ...
> currentBlock.setTotalByteSize(blockCompressedSize);
> }
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)