Parquet doesn't use LZOP. The supported formats are the ones you see in CompressionCodecName, which is used to identify the compression codec.
You can see the file metadata, including compression, using the parquet-cli module's meta command. rb On Mon, Jan 29, 2018 at 6:50 PM, Hao Luo <[email protected]> wrote: > Hi, > I have a question about LZO compression in Parquet file. Does Parquet > use LZOP compression? If it uses LZOP, how does it differentiate between > LZO and LZOP? In the CompressionCodecName I only see LZO there. How do I > find information about which codec to use when decompress a dictionary > page? > > Thanks. > Hao > -- Ryan Blue Software Engineer Netflix
