It is not recommended using Pig standalone mode to process big files if you concern the performance. I believe perl's performance will be better than pig in local mode.
On Thu, Aug 26, 2010 at 5:42 PM, Somdip <s...@apple.com> wrote: > Hi All, > > Just wanted to know has anyone used Pig on a standalone basis in production > environment i.e. without integrating with Haddoop? Is that even a good idea? > > How is the performance if we try parsing big files using Pig. Typically we > use perl for this but often we run into memory management issues and Pig > seems > to be much simpler than perl. > > Please share if you have any inputs. > > Thanks, > Somdip. -- Best Regards Jeff Zhang
