Akhilesh Singh created BEAM-14452:
-------------------------------------
Summary: Support Hadoop 4mc file format
Key: BEAM-14452
URL: https://issues.apache.org/jira/browse/BEAM-14452
Project: Beam
Issue Type: New Feature
Components: sdk-java-core
Reporter: Akhilesh Singh
The 4MC (4 More Compression) is a library for hadoop providing a new splittable
compressed file format (4mc) which lets you leverage the power of LZ4 and ZSTD
algorithms.
It differs from other compressed file formats in a way that the output files
can be read using HIVE partitioning - thus queries can be fast and reads from
client applications can be very pointed to small compressed files stored on
GCS.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
