[ 
https://issues.apache.org/jira/browse/PARQUET-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16753607#comment-16753607
 ] 

BELUGA BEHR edited comment on PARQUET-1514 at 1/27/19 11:10 PM:
----------------------------------------------------------------

This may be a non-issue.  This may be on purpose.  However, if my understanding 
is correct, and this is indeed supposed to be uncompressed byes, I have 
provided a PR.


was (Author: belugabehr):
This may be a non-issue.  This may be on purpose.  However, if my understand is 
correct, and this is indeed supposed to be uncompressed byes.  I have provided 
a PR.

> ParquetFileWriter Records Compressed Bytes instead of Uncompressed Bytes
> ------------------------------------------------------------------------
>
>                 Key: PARQUET-1514
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1514
>             Project: Parquet
>          Issue Type: Bug
>            Reporter: BELUGA BEHR
>            Assignee: BELUGA BEHR
>            Priority: Minor
>              Labels: pull-request-available
>
> As I understand it, the class {{BlockMetaData}} has a {{getTotalByteSize}} 
> and a {{getCompressedSize}}.  However, in the case of {{ParquetFileWriter}}, 
> there is one place where the compressed size is being written into 
> {{totalByteSize}} instead of the uncompressed size.  This looks incorrect.
> {code:java|title=ParquetFileWriter}
> private BlockMetaData currentBlock;
> ...
> public void appendRowGroup(SeekableInputStream from, BlockMetaData rowGroup,
>     boolean dropColumns) throws IOException {
>     ...
>     currentBlock.setTotalByteSize(blockCompressedSize);
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to