Yes. We do it all the time.
The node which you move this cron job to only needs to have the hadoop
environment set up, and proper connectivity to the cluster in which it is
writing to.
On Sep 3, 2014 10:51 AM, "John Lilley" wrote:
> Can you run the load from an "edge node" that is not a DataNod
Can you run the load from an "edge node" that is not a DataNode?
john
John Lilley
Chief Architect, RedPoint Global Inc.
1515 Walnut Street | Suite 300 | Boulder, CO 80302
T: +1 303 541 1516 | M: +1 720 938 5761 | F: +1 781-705-2077
Skype: jlilley.redpoint | john.lil...@redpoint.net | www.redpoint
Better to create one client/gateway node(where no DN is running) and
schedule your cron from that machine.
Thanks & Regards,
B Anil Kumar.
On Wed, Sep 3, 2014 at 1:25 PM, Georgi Ivanov
wrote:
> Hi,
> We have 11 nodes cluster.
> Every hour a cron job is started to upload one file( ~1GB) to Hado