Dear Wiki user, You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.
The following page has been changed by OlgaN: http://wiki.apache.org/pig/PigUserCookbook ------------------------------------------------------------------------------ == Performance Enhancers == The following are a list of tips that people have discovered for making their pig queries run faster. Please feel free to add any tips you have. + + ''' Use Code from Types Branch''' + + The new and improved code available from http://svn.apache.org/viewvc/hadoop/pig/branches/types/ is significantly faster than the code currently on the trunk. We are planning to merge the code back to trunk in a couple of weeks but meanwhile, please, give it a try. Here is the performance comparisons: + + ||'''Query Type''' || '''Pig 1.4 (s)''' || '''Pig 2.0 (s)''' || '''Improvement (times)''' || + || GENERATE with Arithmetic operations || 837 || 345 || '''2.4x''' || + || DISTINCT with 1 key || 186 || 129 || 1.4x || + || DISTINCT with 2 key s || 436 || 184 || '''2.4x''' || + || GROUP || 534 || 404 || 1.3x || + || GROUP ALL || 3594 || 394 || '''9x''' || + || JOIN || 15376 || 12783 || 1.2 || + || ORDER BY 1 key || 640 || 316 || '''2x''' || + || ORDER BY 2 keys || 767 || 472 || 1.6 x || ''' Use Types '''