(Replying to all) I've seen Oozie - way too much XML for me :) We love us some Azkaban, and it does the job very well for us. We've got things to the point where getting data from Voldemort/RDBS to HDFS, to Pig for processing, back out to Voldemort for serving, is very painless and requires minimal configuration. We're now focused on the 'last mile' to wrap all of this in one-liner commands that will enable casual users to 'close the loop' in the data cycle - take the pain out of being data driven.
Russ On Thu, Jun 24, 2010 at 2:06 PM, Mridul Muralidharan <mrid...@yahoo-inc.com>wrote: > > As an aside, if you are using Azkaban for purpose of cron, etc - you might > want to take a look at oozie : I think it has been released - and iirc going > to be opensourced too. > > > Regards, > Mridul > > > On Friday 25 June 2010 12:21 AM, Russell Jurney wrote: > >> Wrote a... thing about Pig at LinkedIn that might be useful to some: >> >> http://sna-projects.com/blog/2010/06/when-pigs-fly-apache-pig-open-source-and-understanding-systems/ >> >> Russ >> > >
