Re: submitting map-reduce jobs without creating jar file ?
Just added it to Hadoop 2781. See here [ https://issues.apache.org/jira/browse/HADOOP-2781?page=com.atlassian.jira.pl ugin.system.issuetabpanels:all-tabpanel ] On 4/23/08 9:35 AM, "Torsten Curdt" <[EMAIL PROTECTED]> wrote: > Ah, OK > > Well, bring it on :-) > > cheers > -- > Torsten > > On Apr 23, 2008, at 18:06, Ted Dunning wrote: > >> >> I haven't distributed it formally yet. >> >> If you would like a tarball, I would be happy to send it. >> >> >> On 4/23/08 1:43 AM, "Torsten Curdt" <[EMAIL PROTECTED]> wrote: >> >>> >>> On Apr 23, 2008, at 00:31, Ted Dunning wrote: >>> Grool might help you. >>> >>> Got a link? Google is not very helpful on the "Grool + Groovy" >>> search. >>> >>> cheers >>> -- >>> Torsten >>> >> >
Re: submitting map-reduce jobs without creating jar file ?
I need some advice/help on how it should be structured as a contrib module. On 4/23/08 9:31 AM, "Doug Cutting" <[EMAIL PROTECTED]> wrote: > Ted Dunning wrote: >> I haven't distributed it formally yet. >> >> If you would like a tarball, I would be happy to send it. > > Can you attach it to a Jira issue? Then we can target it for a contrib > module or somesuch. > > Doug
Re: submitting map-reduce jobs without creating jar file ?
Ah, OK Well, bring it on :-) cheers -- Torsten On Apr 23, 2008, at 18:06, Ted Dunning wrote: I haven't distributed it formally yet. If you would like a tarball, I would be happy to send it. On 4/23/08 1:43 AM, "Torsten Curdt" <[EMAIL PROTECTED]> wrote: On Apr 23, 2008, at 00:31, Ted Dunning wrote: Grool might help you. Got a link? Google is not very helpful on the "Grool + Groovy" search. cheers -- Torsten
Re: submitting map-reduce jobs without creating jar file ?
Good idea. Done. On 4/23/08 9:31 AM, "Doug Cutting" <[EMAIL PROTECTED]> wrote: > Ted Dunning wrote: >> I haven't distributed it formally yet. >> >> If you would like a tarball, I would be happy to send it. > > Can you attach it to a Jira issue? Then we can target it for a contrib > module or somesuch. > > Doug
Re: submitting map-reduce jobs without creating jar file ?
Ted Dunning wrote: I haven't distributed it formally yet. If you would like a tarball, I would be happy to send it. Can you attach it to a Jira issue? Then we can target it for a contrib module or somesuch. Doug
Re: submitting map-reduce jobs without creating jar file ?
I haven't distributed it formally yet. If you would like a tarball, I would be happy to send it. On 4/23/08 1:43 AM, "Torsten Curdt" <[EMAIL PROTECTED]> wrote: > > On Apr 23, 2008, at 00:31, Ted Dunning wrote: > >> Grool might help you. > > Got a link? Google is not very helpful on the "Grool + Groovy" search. > > cheers > -- > Torsten >
Re: submitting map-reduce jobs without creating jar file ?
On Wed, Apr 23, 2008 at 4:43 AM, Torsten Curdt <[EMAIL PROTECTED]> wrote: > On Apr 23, 2008, at 00:31, Ted Dunning wrote: > > Grool might help you. > > Got a link? Google is not very helpful on the "Grool + Groovy" search. Try Grool + Hadoop: http://www.google.com/search?q=grool+hadoop -Stuart
Re: submitting map-reduce jobs without creating jar file ?
On Apr 23, 2008, at 00:31, Ted Dunning wrote: Grool might help you. Got a link? Google is not very helpful on the "Grool + Groovy" search. cheers -- Torsten
Re: submitting map-reduce jobs without creating jar file ?
Grool might help you. It allows you to write full on java-based map-reduce programs using a very simple scripting interface. It has a jar with all of the code needed, but your scripts wouldn't have to be packaged into anything. As a scripting language, it is very easy to integrate and the map-reduce jobs are easy to manipulate. If you already have code to perform the manipulations, then you can still use grool to launch customized jobs since grool is based on groovy and can call java ad libitem. On 4/22/08 3:19 PM, "Tarandeep Singh" <[EMAIL PROTECTED]> wrote: > hi, > > Can I submit a map-reduce job without creating the jar file (and using > $HADOOP_HOME/bin/hadoop script). I looked into the hadoop script and > it is invoking org.apache.hadoop.util.RunJar class. Should I (or > rather do I) have to do the same thing as this class is doing if I > don't want to use the conventional job scheduling method. > > I have this requirement that my application receive information from > external source that would govern the behavior of map-reduce classes > (so I have to create them on the fly or at least customize them) > > Any pointers will be useful... > > thanks, > Taran
submitting map-reduce jobs without creating jar file ?
hi, Can I submit a map-reduce job without creating the jar file (and using $HADOOP_HOME/bin/hadoop script). I looked into the hadoop script and it is invoking org.apache.hadoop.util.RunJar class. Should I (or rather do I) have to do the same thing as this class is doing if I don't want to use the conventional job scheduling method. I have this requirement that my application receive information from external source that would govern the behavior of map-reduce classes (so I have to create them on the fly or at least customize them) Any pointers will be useful... thanks, Taran
