[
https://issues.apache.org/jira/browse/IMPALA-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong resolved IMPALA-3073.
-----------------------------------
Resolution: Cannot Reproduce
I don't think we have an example of this happening so will close for now.
> Verify if compressed data in avro, sequence file format could be multistream
> ----------------------------------------------------------------------------
>
> Key: IMPALA-3073
> URL: https://issues.apache.org/jira/browse/IMPALA-3073
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend
> Affects Versions: Impala 2.0
> Reporter: Juan Yu
> Priority: Minor
>
> When generating compressed text file, certain tools (like pbzip2) could
> parallel compression and create multistream compressed data. We need to
> verify if this applies to other file formats like parquet, avro, sequence
> that use those codec. If yes, Codec::ProcessBlock() should support
> multistream compressd block data. decompression should not stop when reach
> the end of compressed stream, e.g. Z_STREAM_END, BZ_STREAM_END.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
