Author: olga Date: Wed Dec 9 16:25:14 2009 New Revision: 888858 URL: http://svn.apache.org/viewvc?rev=888858&view=rev Log: PIG-1134: Skewed Join sampling job overwhelms the name node (sriranjan via olgan)
Modified: hadoop/pig/branches/branch-0.6/CHANGES.txt hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java Modified: hadoop/pig/branches/branch-0.6/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/pig/branches/branch-0.6/CHANGES.txt?rev=888858&r1=888857&r2=888858&view=diff ============================================================================== --- hadoop/pig/branches/branch-0.6/CHANGES.txt (original) +++ hadoop/pig/branches/branch-0.6/CHANGES.txt Wed Dec 9 16:25:14 2009 @@ -135,6 +135,9 @@ BUG FIXES +PIG-1134: Skewed Join sampling job overwhelms the name node (sriranjan via +olgan) + PIG-1105: COUNT_STAR accumulate interface implementation cases failure(sriranjan via olgan) PIG-1118: expression with aggregate functions returning null, with accumulate Modified: hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java URL: http://svn.apache.org/viewvc/hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java?rev=888858&r1=888857&r2=888858&view=diff ============================================================================== --- hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (original) +++ hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java Wed Dec 9 16:25:14 2009 @@ -1844,7 +1844,7 @@ String inputFile = lFile.getFileName(); return getSamplingJob(sort, prevJob, transformPlans, lFile, sampleFile, rp, null, - PartitionSkewedKeys.class.getName(), new String[]{per, mc, inputFile}, PoissonSampleLoader.class.getName()); + PartitionSkewedKeys.class.getName(), new String[]{per, mc, inputFile}, RandomSampleLoader.class.getName()); }catch(Exception e) { throw new PlanException(e); }