arthurpassos commented on PR #35825: URL: https://github.com/apache/arrow/pull/35825#issuecomment-1602750265
> > It feels a bit unfortunate to add a fictitious `LargeByteArrayType` in the Parquet headers for an Arrow-specific option. Also, it seems this would only work for PLAIN encoding, not other encodings such as DELTA_BYTE_ARRAY, right? > > Sorry, yes. I have made no modifications to `DELTA_BYTE_ARRAY` decoders, so it seems like it wouldn't work for it indeed. Maybe I can look into this to make this more complete. Are there other encodings I should pay attention to? Looking through the sources, I see three byte array decoders: dict, delta & plain. I believe dict and plain have been addressed, but not delta -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
