I am indeed a happy man...our data acq. systems can see and interact with the
compute grid proper so configuring nodes outside the grid to speak with HDFS
should be reasonably straightforward.
C G
Ted Dunning <[EMAIL PROTECTED]> wrote:
On 12/20/07 5:52 PM, "C G"
wrote:
> Ted, when you say "copy in the distro" do you need to include the
> configuration files from the running grid? You don't need to actually start
> HDFS on this node do you?
You are correct. You only need the config files (and the hadoop script
helps make things easier).
> If I'm following this approach correctly, I would want to have an "xfer
> server" whose job it is to essentially run dfs -copyFromLocal on all
> inbound-to-HDFS data. Once I'm certain that my data has copied correctly, I
> can delete the local files on the xfer server.
Yes.
> This is great news, as my current system wastes a lot of time copying data
> from data acquisition servers to the master node. If I can copy to HDFS
> directly from ny acquisition servers then I am a happy guy....
You are a happy guy.
If your acquisition systems can see all of your datanodes.
---------------------------------
Never miss a thing. Make Yahoo your homepage.
