for *-site.xml? I will take a closer look at
> the install scripts.
>
> -original message-
> Subject: RE: Running Mapred jobs after launching cluster
> From:
> Date: 03/02/2011 23:32
>
> Hi Andrei,
> I checked the /usr/local/hadoop-0.20.2/conf directory on master node and
Did you try do to a file search for *-site.xml? I will take a closer look at
the install scripts.
-original message-
Subject: RE: Running Mapred jobs after launching cluster
From:
Date: 03/02/2011 23:32
Hi Andrei,
I checked the /usr/local/hadoop-0.20.2/conf directory on master node and all
Subject: Re: Running Mapred jobs after launching cluster
Yes I modified the post_configure script. I modified 3 different properties and
I saw the other two are overwritten but not the mapred.child.java.opts property.
Praveen
On Feb 3, 2011, at 12:33 PM, ext Andrei Savu
mailto:savu.and...@gmail.com
t;mailto:praveen.pe...@nokia.com>]
Sent: Wednesday, February 02, 2011 5:23 PM
To: <mailto:whirr-user@incubator.apache.org>
whirr-user@incubator.apache.org<mailto:whirr-user@incubator.apache.org>
Subject: RE: Running Mapred jobs after launching cluster
Can anyone think of a reason wh
ge chunks of data.
>
> Thanks
> Praveen
> -Original Message-
> From: ext praveen.pe...@nokia.com [mailto:praveen.pe...@nokia.com]
> Sent: Wednesday, February 02, 2011 5:23 PM
> To: whirr-user@incubator.apache.org
> Subject: RE: Running Mapred jobs after launching clu
[mailto:praveen.pe...@nokia.com]
Sent: Wednesday, February 02, 2011 5:23 PM
To: whirr-user@incubator.apache.org
Subject: RE: Running Mapred jobs after launching cluster
Can anyone think of a reason why the below property is not honoured when I
overwrote this along with other properties in the post_configure
From: Peddi Praveen (Nokia-MS/Boston)
Sent: Tuesday, February 01, 2011 11:21 AM
To: whirr-user@incubator.apache.org
Subject: RE: Running Mapred jobs after launching cluster
Thanks Tom. Silly me I should have thought of the property name. It works now
except one issue: I ran the
t;>
>> How do I debug this issue?
>
> You can log into the instances (see the FAQ for how to do this) and
> look at the scripts that actually ran (and their output) in the /tmp
> directory.
>
>
> Tom
>
>>
>> Praveen
>>
>>
>> Launched the clus
I debug this issue?
>
> You can log into the instances (see the FAQ for how to do this) and
> look at the scripts that actually ran (and their output) in the /tmp
> directory.
>
>
> Tom
>
>>
>> Praveen
>>
>>
>> Launched the cluster and I didn&#x
_
From: ext Tom White [tom.e.wh...@gmail.com]
Sent: Monday, January 31, 2011 6:23 PM
To: whirr-user@incubator.apache.org
Subject: Re: Running Mapred jobs after launching cluster
On Mon, Jan 31, 2011 at 3:03 PM, wrote:
> If I anyway have to upload the files to webservers, do I still need the
er and I didn't see child jvm have 2G alloc
> -Original Message-
> From: ext Tom White [mailto:tom.e.wh...@gmail.com]
> Sent: Monday, January 31, 2011 3:02 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
> Hi Prav
didn't see child jvm have 2G alloc
>> -Original Message-
>> From: ext Tom White [mailto:tom.e.wh...@gmail.com]
>> Sent: Monday, January 31, 2011 3:02 PM
>> To: whirr-user@incubator.apache.org
>> Subject: Re: Running Mapred jobs after launching cluster
>>
d the cluster and I didn't see child jvm have 2G alloc
> -Original Message-
> From: ext Tom White [mailto:tom.e.wh...@gmail.com]
> Sent: Monday, January 31, 2011 3:02 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
>
Launched the cluster and I didn't see child jvm have 2G alloc
-Original Message-
From: ext Tom White [mailto:tom.e.wh...@gmail.com]
Sent: Monday, January 31, 2011 3:02 PM
To: whirr-user@incubator.apache.org
Subject: Re: Running Mapred jobs after launching cluster
Hi Praveen,
I think rem
>
> Thanks in advance.
> Praveen
>
> -Original Message-
> From: ext Tom White [mailto:tom.e.wh...@gmail.com]
> Sent: Friday, January 28, 2011 4:02 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
> It is
tasks=24
mapred.map.tasks=64
mapred.child.java.opts=-Xmx2048m
Thanks in advance.
Praveen
-Original Message-
From: ext Tom White [mailto:tom.e.wh...@gmail.com]
Sent: Friday, January 28, 2011 4:02 PM
To: whirr-user@incubator.apache.org
Subject: Re: Running Mapred jobs after launching cluste
d.
>
> Thanks
> Praveen
>
> -Original Message-
> From: ext Tom White [mailto:tom.e.wh...@gmail.com]
> Sent: Friday, January 28, 2011 3:35 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
> On Fri, Jan 28, 20
wh...@gmail.com]
> Sent: Friday, January 28, 2011 2:12 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
> On Fri, Jan 28, 2011 at 6:28 AM, wrote:
>> Thanks Tom. Could you eloborate little more on the second option.
>>
>
@gmail.com]
> Sent: Friday, January 28, 2011 2:12 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
> On Fri, Jan 28, 2011 at 6:28 AM, wrote:
>> Thanks Tom. Could you eloborate little more on the second option.
>>
>> What is the
#x27;s way too large since it has ervrything
in it.
Thanks
Praveen
-Original Message-
From: ext Tom White [mailto:tom.e.wh...@gmail.com]
Sent: Friday, January 28, 2011 2:12 PM
To: whirr-user@incubator.apache.org
Subject: Re: Running Mapred jobs after launching cluster
On Fri, Jan 28, 20
January 27, 2011 4:01 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
> If they implement the Tool interface then you can set configuration on them.
> Failing that you could set HADOOP_CONF_DIR and run them in a new process.
>
&
:tom.e.wh...@gmail.com]
> Sent: Thursday, January 27, 2011 3:42 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
> You don't need to add anything to the classpath, but you need to use the
> configuration in the org
.com]
> Sent: Thursday, January 27, 2011 3:42 PM
> To: whirr-user@incubator.apache.org
> Subject: Re: Running Mapred jobs after launching cluster
>
> You don't need to add anything to the classpath, but you need to use the
> configuration in the org.apache.whirr.service.Cl
From: ext Tom White [mailto:tom.e.wh...@gmail.com]
Sent: Thursday, January 27, 2011 3:42 PM
To: whirr-user@incubator.apache.org
Subject: Re: Running Mapred jobs after launching cluster
You don't need to add anything to the classpath, but you need to use the
confi
You don't need to add anything to the classpath, but you need to use
the configuration in the org.apache.whirr.service.Cluster object to
populate your Hadoop Configuration object so that your code knows
which cluster to connect to. See the getConfiguration() method in
HadoopServiceController for ho
Hello all,
I wrote a java class HadoopLanucher that is very similar to
HadoopServiceController. I was succesfully able to launch a cluster
programtically from my application using Whirr. Now I want to copy files to
hdfs and also run a job progrmatically.
When I copy a file to hdfs its copying t
26 matches
Mail list logo
