etseidl commented on code in PR #231: URL: https://github.com/apache/parquet-format/pull/231#discussion_r1502881486
########## Encodings.md: ########## @@ -179,6 +179,12 @@ This encoding is adapted from the Binary packing described in ["Decoding billions of integers per second through vectorization"](http://arxiv.org/pdf/1209.2137v5.pdf) by D. Lemire and L. Boytsov. +Delta encoding is best when used on sorted data, or data with runs of repeated Review Comment: I wasn't sure about including this section, but did so as a result of the discussion of apache/arrow#37940. Rather than guidance, how about a sentence added to `Characteristics` to the effect that encoding random integer data will result in no space savings over `PLAIN` encoding and will incur increased metadata overhead. Just the facts, no opinion 😉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
