[ https://issues.apache.org/jira/browse/IMPALA-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Abhishek Rawat resolved IMPALA-8617. ------------------------------------ Resolution: Fixed Fix Version/s: Impala 3.3.0 > Add support for lz4 in parquet > ------------------------------ > > Key: IMPALA-8617 > URL: https://issues.apache.org/jira/browse/IMPALA-8617 > Project: IMPALA > Issue Type: Improvement > Components: Backend > Reporter: Abhishek Rawat > Assignee: Abhishek Rawat > Priority: Major > Labels: parquet > Fix For: Impala 3.3.0 > > > Hadoop uses a native block format for LZ4 (same as parquet-mr api) which is > incompatible with LZ4 block format. > As a result Parquet/LZ4 could have different block formats. > The parquet-cpp api (now Apache Arrow) uses LZ4 frame format, which is also > incompatible with LZ4 block format. > The current decision is to use a format compatible with Hive, Spark and > parquet-mr. > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org