Hello, TextInputFormat is a perfect match for my problem. The only drawback is that fact that keys are unique only within a file. Is there an easy way to have keys unique across files. That is, each line in any file should get a unique key. Is there an unique id for each file? If yes, maybe I can concatenate them if I can access the file id from the map function.
Thanks, Rares