Hello.
In my application I am using HDFS without map/reduce. Yesterday in this
list I get known about har archives. This is great solution for me to
handle archived data, so I've decided to create such an archive and test
it. The creation worked in Local MapReduce mode, but each file took ~3
seconds, so in overall it was too slow (yet archive was successfully
created and seems to suit my needs). As time is more or less exact (no 2
or 4 second interval, sometimes it's 6 seconds), I suspect this is some
kind of polling timeout.
Can anyone tell me if I must go to setting up map/reduce over my cluster
simply for har creation task or I can change this timeout (which one)?
Best regards, Vitalii Tymchyshyn