Hello.

In my application I am using HDFS without map/reduce. Yesterday in this list I get known about har archives. This is great solution for me to handle archived data, so I've decided to create such an archive and test it. The creation worked in Local MapReduce mode, but each file took ~3 seconds, so in overall it was too slow (yet archive was successfully created and seems to suit my needs). As time is more or less exact (no 2 or 4 second interval, sometimes it's 6 seconds), I suspect this is some kind of polling timeout. Can anyone tell me if I must go to setting up map/reduce over my cluster simply for har creation task or I can change this timeout (which one)?

Best regards, Vitalii Tymchyshyn

Reply via email to