The folder contains files with text and other folders with text files. The text is not key/value, it's just text. Something like this: Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's standard dumm...
I'm thinking about creating a new Hdfs command to zip in hadoop, but i'm not sure whether hadoop distributes the execution, because otherwise it may takes a long time and very cpu consuming. Any ideas? Thanks
