Hi all, I am trying to process several gigs of zipped text files from a directory. If I unzip them the size increase atleast 4 times and potentially I can run out of disk space.
Has anyone tried to read zipped text files directly from the input directory? or anyone tried implementing a zip version of SequenceFileRecordReader.java and Filesplit? Any help would be appreciated. Thanks, VJ
