RE: HDFS balance

2014-09-04 Thread Jamal B
Yes. We do it all the time. The node which you move this cron job to only needs to have the hadoop environment set up, and proper connectivity to the cluster in which it is writing to. On Sep 3, 2014 10:51 AM, "John Lilley" wrote: > Can you run the load from an "edge node" that is not a DataNod

RE: HDFS balance

2014-09-03 Thread John Lilley
Can you run the load from an "edge node" that is not a DataNode? john John Lilley Chief Architect, RedPoint Global Inc. 1515 Walnut Street | Suite 300 | Boulder, CO 80302 T: +1 303 541 1516  | M: +1 720 938 5761 | F: +1 781-705-2077 Skype: jlilley.redpoint | john.lil...@redpoint.net | www.redpoint

Re: HDFS balance

2014-09-03 Thread AnilKumar B
Better to create one client/gateway node(where no DN is running) and schedule your cron from that machine. Thanks & Regards, B Anil Kumar. On Wed, Sep 3, 2014 at 1:25 PM, Georgi Ivanov wrote: > Hi, > We have 11 nodes cluster. > Every hour a cron job is started to upload one file( ~1GB) to Hado