Author: olga
Date: Wed Dec  9 16:25:14 2009
New Revision: 888858

URL: http://svn.apache.org/viewvc?rev=888858&view=rev
Log:
PIG-1134: Skewed Join sampling job overwhelms the name node (sriranjan via
olgan)

Modified:
    hadoop/pig/branches/branch-0.6/CHANGES.txt
    
hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java

Modified: hadoop/pig/branches/branch-0.6/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/pig/branches/branch-0.6/CHANGES.txt?rev=888858&r1=888857&r2=888858&view=diff
==============================================================================
--- hadoop/pig/branches/branch-0.6/CHANGES.txt (original)
+++ hadoop/pig/branches/branch-0.6/CHANGES.txt Wed Dec  9 16:25:14 2009
@@ -135,6 +135,9 @@
 
 BUG FIXES
 
+PIG-1134: Skewed Join sampling job overwhelms the name node (sriranjan via
+olgan)
+
 PIG-1105: COUNT_STAR accumulate interface implementation cases 
failure(sriranjan via olgan)
 
 PIG-1118: expression with aggregate functions returning null, with accumulate

Modified: 
hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java
URL: 
http://svn.apache.org/viewvc/hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java?rev=888858&r1=888857&r2=888858&view=diff
==============================================================================
--- 
hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java
 (original)
+++ 
hadoop/pig/branches/branch-0.6/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java
 Wed Dec  9 16:25:14 2009
@@ -1844,7 +1844,7 @@
                String inputFile = lFile.getFileName();
 
                return getSamplingJob(sort, prevJob, transformPlans, lFile, 
sampleFile, rp, null, 
-                                                       
PartitionSkewedKeys.class.getName(), new String[]{per, mc, inputFile}, 
PoissonSampleLoader.class.getName());
+                                                       
PartitionSkewedKeys.class.getName(), new String[]{per, mc, inputFile}, 
RandomSampleLoader.class.getName());
        }catch(Exception e) {
                throw new PlanException(e);
        }


Reply via email to