[Pig Wiki] Update of PigMix by AlanGates
Dear Wiki user, You have subscribed to a wiki page or wiki category on Pig Wiki for change notification. The PigMix page has been changed by AlanGates. http://wiki.apache.org/pig/PigMix?action=diffrev1=13rev2=14 -- || PigMix_12 || 55.33|| 95.33 || 0.58 || || Total || 1352.33 || 1357 || 1.00 || || Weighted avg || || || 1.04 || + + Run date: January 4, 2010, run against 0.6 branch as of that day + || Test || Pig run time || Java run time || Multiplier || + || PigMix_1 || 138.33 || 112.67|| 1.23 || + || PigMix_2 || 66.33|| 39.33 || 1.69 || + || PigMix_3 || 199 || 83.33 || 2.39 || + || PigMix_4 || 59 || 60.67 || 0.97 || + || PigMix_5 || 80.33|| 113.67|| 0.71 || + || PigMix_6 || 65 || 77.67 || 0.84 || + || PigMix_7 || 63.33|| 61|| 1.04 || + || PigMix_8 || 40 || 47.67 || 0.84 || + || PigMix_9 || 214 || 215.67|| 0.99 || + || PigMix_10 || 284.67 || 284.33|| 1.00 || + || PigMix_11 || 141.33 || 151.33|| 0.93 || + || PigMix_12 || 55.67|| 115 || 0.48 || + || Total || 1407 || 1362.33 || 1.03 || + || Weighted Avg || || || 1.09 || + == Features Tested ==
[Pig Wiki] Update of PigMix by AlanGates
Dear Wiki user, You have subscribed to a wiki page or wiki category on Pig Wiki for change notification. The following page has been changed by AlanGates: http://wiki.apache.org/pig/PigMix -- || PigMix_11 || 206.33 || 136.67 || 1.51 || || PigMix_12 || 173 || 161.67 || 1.07 || || Total || 2729.67 || 1948.33 || 1.40 || + + Run date: August 27, 2009, run against top of trunk as of that day. + + || Test || Pig run time || Java run time || Multiplier || + || PigMix_1 || 218 || 133.33 || 1.635 || + || PigMix_2 || 99.333 || 48 || 2.07 || + || PigMix_3 || 272 || 127.67 || 2.13 || + || PigMix_4 || 142.33 || 76.333 || 1.87 || + || PigMix_5 || 127.33 || 107.33 || 1.19 || + || PigMix_6 || 135.67 || 73 || 1.86 || + || PigMix_7 || 124.67 || 78.333 || 1.59 || + || PigMix_8 || 117.33 || 68 || 1.73 || + || PigMix_9 || 356.33 || 323.67 || 1.10 || + || PigMix_10 || 511.67 || 684.33 || 0.75 || + || PigMix_11 || 180 || 121 || 1.49 || + || PigMix_12 || 156 || 160.67 || 0.97 || + || Total || 2440.67 || 2001.67 || 1.22 || + == Features Tested ==
[Pig Wiki] Update of PigMix by AlanGates
Dear Wiki user, You have subscribed to a wiki page or wiki category on Pig Wiki for change notification. The following page has been changed by AlanGates: http://wiki.apache.org/pig/PigMix -- || L12 multi-store || 139 || 159 || || Total time || 1826 || 2764|| || Compared to hadoop || N/A || 1.5 || + + + Run date: June 28, 2009, run against top of trunk as of that day. + Note that the columns got reversed in this one (Pig then MR) + + || Test || Pig run time || Java run time || Multiplier || + || PigMix_1 || 204 || 117.33 || 1.74 || + || PigMix_2 || 110.33 || 50.67 || 2.18 || + || PigMix_3 || 292.33 || 125 || 2.34 || + || PigMix_4 || 149.67 || 85.33 || 1.75 || + || PigMix_5 || 131.33 || 105 || 1.25 || + || PigMix_6 || 146.33 || 65.33 || 2.24 || + || PigMix_7 || 128.33 || 82 || 1.57 || + || PigMix_8 || 126.33 || 63.67 || 1.98 || + || PigMix_9 || 506.67 || 312.67 || 1.62 || + || PigMix_10 || 555 || 643 || 0.86 || + || PigMix_11 || 206.33 || 136.67 || 1.51 || + || PigMix_12 || 173 || 161.67 || 1.07 || + || Total || 2729.67 || 1948.33 || 1.40 || + == Features Tested == Based on a sample of user queries, PigMix includes tests for the following features.
[Pig Wiki] Update of PigMix by AlanGates
Dear Wiki user, You have subscribed to a wiki page or wiki category on Pig Wiki for change notification. The following page has been changed by AlanGates: http://wiki.apache.org/pig/PigMix -- == Runs == - == November 19, 2008 == - PigMix was run on a 25 machine hadoop cluster. The cluster was running hadoop version 0.18.1. The tests were run against two + The following table includes runs done of the pig mix. All of these runs have been done on a cluster with 26 slaves plus one machine acting as the name node and job tracker. The cluster was running + hadoop version 0.18.1. (TODO: Need to get specific hardware info on those machines). + + The tests were run against two versions of pig: top of trunk, and top of types branch both as of Nov 21 2008. - So far only the latency tests have been run, not the scalability tests. Equivalent map reduce programs have not yet been run. - The tests were run three times for each version and the results averaged. - || Query || Top of Trunk || Top of Types Branch || - || L1 explode || 261 || 283 || - || L2 fr join || 1665 || 253 || - || L3 join || 1912 || 320 || - || L4 distinct agg || 254 || 193 || - || L5 anti-join || 1535 || 281 || - || L6 large group by key || 294 || 226 || - || L7 nested split || 243 || 204 || - || L8 group all || 462 || 194 || - || L9 order by 1 field || 5294 || 867 || - || L10 order by multiple fields || 1403 || 565 || - || L11 distinct + union || 316 || 255 || - || L12 multi-store || fails || 781 || + tot = top of trunk + totb = top of types branch + + || Version || Map Reduce Java Code || tot 11/21/08 || totb 11/21/08 || totb 1/20/09 || + || Date Run || 11/22/08 || 11/21/08 || 11/21/08 || 1/20/09 || + || L1 explode || 116 || 261 || 283 || 218 || + || L2 fr join || 41 || 1665 || 253 || 168 || + || L3 join || 97 || 1912 || 320 || 258 || + || L4 distinct agg || 68 || 254 || 193 || 110 || + || L5 anti-join || 90 || 1535 || 281 || 209 || + || L6 large group by key|| 61 || 294 || 226 || 126 || + || L7 nested split || 72 || 243 || 204 || 107 || + || L8 group all || 56 || 462 || 194 || 104 || + || L9 order by 1 field || 286 || 5294 || 867 || 851 || + || L10 order by multiple fields || 634 || 1403 || 565 || 469 || + || L11 distinct + union || 120 || 316 || 255 || 164 || + || L12 multi-store || 150 || fails|| 781 || 499 || + || Total time || 1791 || 13638|| 4420 || 3284 || + || Compared to hadoop || 1.0 || 7.6 || 2.5 || 1.8 || + + The totb run of 1/20/09 includes the change to make BufferedPositionedInputStream use a buffer instead of relying on hadoop to buffer. == Features Tested == Based on a sample of user queries, PigMix includes tests for the following features.
