RE: Mapreduce outputs to a different cluster?

2013-10-26 Thread java8964 java8964
Just use "hdfs://machine.domain:8080/tmp/myfolder" Yong Date: Thu, 24 Oct 2013 20:25:35 -0700 From: myx...@yahoo.com Subject: Re: Mapreduce outputs to a different cluster? To: user@hadoop.apache.org Thanks Shahab & Yong. If cluster B (in which I want to dump output)

Re: Mapreduce outputs to a different cluster?

2013-10-25 Thread Shahab Yunus
, October 24, 2013 5:31 PM, java8964 java8964 < > java8...@hotmail.com> wrote: > Just specify the output location using the URI to another cluster. As > long as the network is accessible, you should be fine. > > Yong > > -- > Date: Thu, 24 Oct 201

Re: Mapreduce outputs to a different cluster?

2013-10-24 Thread S. Zhou
Just specify the output location using the URI to another cluster. As long as the network is accessible, you should be fine. Yong Date: Thu, 24 Oct 2013 15:28:27 -0700 From: myx...@yahoo.com Subject: Mapreduce outputs to a different cluster? To: user@hadoop.apac

RE: Mapreduce outputs to a different cluster?

2013-10-24 Thread java8964 java8964
Just specify the output location using the URI to another cluster. As long as the network is accessible, you should be fine. Yong Date: Thu, 24 Oct 2013 15:28:27 -0700 From: myx...@yahoo.com Subject: Mapreduce outputs to a different cluster? To: user@hadoop.apache.org The scenario is: I run

Re: Mapreduce outputs to a different cluster?

2013-10-24 Thread Shahab Yunus
As far as I know, you can use distcp to transfer the results of the job form one cluster to another, once the job is done. You can write a simple script to do that. Simple and tested. Some poiners below: http://doc.mapr.com/display/MapR/hadoop+distcp https://www.inkling.com/read/hadoop-definitive-g

Mapreduce outputs to a different cluster?

2013-10-24 Thread S. Zhou
The scenario is: I run mapreduce job on cluster A (all source data is in cluster A) but I want the output of the job to cluster B. Is it possible? If yes, please let me know how to do it. Here are some notes of my mapreduce job: 1. the data source is an HBase table 2. It only has mapper no reduc