Dear Wiki user, You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.
The following page has been changed by CorinneC: http://wiki.apache.org/pig/FrontPage ------------------------------------------------------------------------------ Pig compiles these dataflow programs into (sequences of) map-reduce jobs and executes them using Hadoop. It is also possible to execute Pig Latin programs in a "local" mode (without Hadoop cluster), in which case all processing takes place in a single local JVM. - == News! == + == News == '''Do you Pig?''' Most of Yahoo does! * 100s of uses! @@ -28, +28 @@ 1. Creating new operator representations at the various layers (logical, physical, map-reduce) to facilitate optimization. 2. Streamlining the execution pipeline. - See PigOptimizationWishList and PigExecutionModel for the design details. Implementation is already underway ... + See the PigOptimizationWishList and PigExecutionModel for the design details. Implementation is already underway ... == General Information == * [http://incubator.apache.org/pig/ Official Apache Pig Website] + * IsPigRightForYou? * PigOverview - An overview of Pig's capabilities + * PigTalksPapers - Pig talks, papers, interviews + - * PigTalksPapers - * Pig talks: - * Pig Latin talk at SIGMOD 2008: [http://i.stanford.edu/~usriv/talks/sigmod08-pig-latin.ppt slides] - * 30-minute talk given at 2008 Hadoop Summit: [http://research.yahoo.com/files/pig_hadoopsummit.pdf slides] - * 60-minute talk given at universities in early 2008: [http://coursecast.panopto.com/CourseCast/Viewer/Default.aspx?id=238 video]; [http://www.cs.cmu.edu/~olston/pig.ppt slides] - * Pig papers: - * Pig Latin paper at SIGMOD 2008: [http://www.cs.cmu.edu/~olston/publications/sigmod08.pdf pdf] - * Pig optimization paper at USENIX 2008: [http://www.cs.cmu.edu/~olston/publications/usenix08.pdf pdf] - * Pig poster at USENIX 2008: [http://www.cs.cmu.edu/~olston/usenix08-poster.ppt ppt] - * An interview with one of Yahoo's most prominent Pig users, including his take on Pig Latin vs. SQL: [http://developer.yahoo.net/blogs/theater/archives/2008/04/_size75.html video] - == User Documentation == - * [http://incubator.apache.org/pig/javadoc/doc/ Javadoc] - * IsPigRightForYou? * PigTutorial - Begin here ... everything is set up for you * GettingStarted - Continue here ... set up everything yourself * PigLatin - The language manual * PigFunctions - A guide for writing your own Pig functions * [http://wiki.apache.org/pig/Grunt Grunt] - The shell manual * ExampleGenerator - A guide for using the ILLUSTRATE command to help debug scripts + * [http://incubator.apache.org/pig/javadoc/doc/ Javadoc] == Developer Documentation == * How tos