[ https://issues.apache.org/jira/browse/BEAM-14452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17550049#comment-17550049 ]
Danny McCormick commented on BEAM-14452: ---------------------------------------- This issue has been migrated to https://github.com/apache/beam/issues/21619 > Support Hadoop 4mc file format > ------------------------------ > > Key: BEAM-14452 > URL: https://issues.apache.org/jira/browse/BEAM-14452 > Project: Beam > Issue Type: New Feature > Components: sdk-java-core > Reporter: Akhilesh Singh > Assignee: Akhilesh Singh > Priority: P2 > Time Spent: 1h > Remaining Estimate: 0h > > The 4MC (4 More Compression) is a library for hadoop providing a new > splittable compressed file format (4mc) which lets you leverage the power of > LZ4 and ZSTD algorithms. > It differs from other compressed file formats in a way that the output files > can be read using HIVE partitioning - thus queries can be fast and reads from > client applications can be very pointed to small compressed files stored on > GCS. -- This message was sent by Atlassian Jira (v8.20.7#820007)