[jira] [Commented] (PARQUET-594) Support CRC checksums in pages
[ https://issues.apache.org/jira/browse/PARQUET-594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283433#comment-15283433 ] Julien Le Dem commented on PARQUET-594: --- This has been defined in the spec but is not implemented. Sometimes you may want to turn off hdfs crc check to speed up things (crc on pages are finer granularity and require less checking depending on what you are doing) I agree that it's low on parquet-cpp priority list > Support CRC checksums in pages > -- > > Key: PARQUET-594 > URL: https://issues.apache.org/jira/browse/PARQUET-594 > Project: Parquet > Issue Type: Improvement > Components: parquet-cpp >Reporter: Uwe L. Korn > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PARQUET-594) Support CRC checksums in pages
[ https://issues.apache.org/jira/browse/PARQUET-594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255395#comment-15255395 ] Wes McKinney commented on PARQUET-594: -- [~drankye] this is referring to https://github.com/apache/parquet-format/blob/master/src/main/thrift/parquet.thrift#L414, which has not been implemented IIRC > Support CRC checksums in pages > -- > > Key: PARQUET-594 > URL: https://issues.apache.org/jira/browse/PARQUET-594 > Project: Parquet > Issue Type: Improvement > Components: parquet-cpp >Reporter: Uwe L. Korn > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PARQUET-594) Support CRC checksums in pages
[ https://issues.apache.org/jira/browse/PARQUET-594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255386#comment-15255386 ] Wes McKinney commented on PARQUET-594: -- I do not believe these have been implemented in any Parquet implementation. [~julienledem] can confirm > Support CRC checksums in pages > -- > > Key: PARQUET-594 > URL: https://issues.apache.org/jira/browse/PARQUET-594 > Project: Parquet > Issue Type: Improvement > Components: parquet-cpp >Reporter: Uwe L. Korn > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
