Hi Suyash, Could you post a bit more of your stack trace and information about which Hadoop version you're running on?
Also, have you tried running a simple MapReduce job (e.g. word count) that operates on this file to ensure that 4mc-compression is working correctly on your cluster? - Gabriel On Wed, May 16, 2018 at 1:55 PM, Suyash Agarwal <[email protected]> wrote: > Hi, > > `new TextFileSource<>(<4mc compressed input>, strings())` fails with the > error: > java.lang.NullPointerException: null > at > com.hadoop.compression.fourmc.Lz4Decompressor.reset(Lz4Decompressor.java:234). > > And trying `(Class<? extends FileInputFormat<?, ?>>) > FourMcTextInputFormat.class` in From.formattedFile() as the format class > doesn't work with class cast exception. > > So, how can I read the 4mc compressed input file in Crunch? > > Thanks. >
