Author: gates
Date: Mon Jul 20 17:41:01 2009
New Revision: 795931

URL: http://svn.apache.org/viewvc?rev=795931&view=rev
Log:
PIG-878: Pig is returning too many blocks in the input split. 


Modified:
    hadoop/pig/trunk/CHANGES.txt
    
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java

Modified: hadoop/pig/trunk/CHANGES.txt
URL: 
http://svn.apache.org/viewvc/hadoop/pig/trunk/CHANGES.txt?rev=795931&r1=795930&r2=795931&view=diff
==============================================================================
--- hadoop/pig/trunk/CHANGES.txt (original)
+++ hadoop/pig/trunk/CHANGES.txt Mon Jul 20 17:41:01 2009
@@ -40,6 +40,8 @@
 
 BUG FIXES
 
+       PIG-878: Pig is returning too many blocks in the input split. (arunc 
via gates).
+
     PIG-888: Pig do not pass udf to the backend in some situation (daijy)
 
     PIG-728: All backend error messages must be logged to preserve the

Modified: 
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
URL: 
http://svn.apache.org/viewvc/hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java?rev=795931&r1=795930&r2=795931&view=diff
==============================================================================
--- 
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
 (original)
+++ 
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
 Mon Jul 20 17:41:01 2009
@@ -92,7 +92,7 @@
             for (String loc : wrapped.getLocations()) {
                 Path path = new Path(loc);
                 FileStatus status = fs.getFileStatus(path); 
-                BlockLocation[] b = fs.getFileBlockLocations(status, 0, 
status.getLen());
+                               BlockLocation[] b = 
fs.getFileBlockLocations(status, wrapped.getStart(), wrapped.getLength());
                 int total = 0;
                 for (int i = 0; i < b.length; i++) {
                     total += b[i].getHosts().length;


Reply via email to