parquet-mr git commit: PARQUET-1133 Add int96 support by returning bytearray, Skip originalType comparison for map types when originalType is null

2017-10-10 Thread julien
Repository: parquet-mr Updated Branches: refs/heads/master ddbeb4dd1 -> d55a572e5 PARQUET-1133 Add int96 support by returning bytearray, Skip originalType comparison for map types when originalType is null - PigSchemaConverter: Added a null check before comparing a mapKeyValueType's original

parquet-format git commit: PARQUET-1124: Add LZ4 and Zstd compression codecs.

2017-10-10 Thread blue
Repository: parquet-format Updated Branches: refs/heads/master ddc18a7af -> 84460c5a1 PARQUET-1124: Add LZ4 and Zstd compression codecs. This adds LZ4 and Zstd compression codecs to the format spec. From recent tests, Zstd appears to out-perform other codecs (including brotli on reads). LZ4

parquet-format git commit: PARQUET-1125: Add UUID logical type.

2017-10-10 Thread blue
Repository: parquet-format Updated Branches: refs/heads/master 863875e0b -> ddc18a7af PARQUET-1125: Add UUID logical type. UUIDs are commonly used as unique identifiers. A binary representation will reduce memory when writing or building bloom filters and will reduce cycles needed to compare

parquet-format git commit: PARQUET-906: Add LogicalType annotation.

2017-10-10 Thread blue
Repository: parquet-format Updated Branches: refs/heads/master f59258a05 -> 863875e0b PARQUET-906: Add LogicalType annotation. This commit adds a `LogicalType` union and a field for this logical type to `SchemaElement`. Adding a new structure for logical types is needed for a few reasons: 1