Author: gates Date: Mon Jul 20 17:41:01 2009 New Revision: 795931 URL: http://svn.apache.org/viewvc?rev=795931&view=rev Log: PIG-878: Pig is returning too many blocks in the input split.
Modified: hadoop/pig/trunk/CHANGES.txt hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java Modified: hadoop/pig/trunk/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/pig/trunk/CHANGES.txt?rev=795931&r1=795930&r2=795931&view=diff ============================================================================== --- hadoop/pig/trunk/CHANGES.txt (original) +++ hadoop/pig/trunk/CHANGES.txt Mon Jul 20 17:41:01 2009 @@ -40,6 +40,8 @@ BUG FIXES + PIG-878: Pig is returning too many blocks in the input split. (arunc via gates). + PIG-888: Pig do not pass udf to the backend in some situation (daijy) PIG-728: All backend error messages must be logged to preserve the Modified: hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java URL: http://svn.apache.org/viewvc/hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java?rev=795931&r1=795930&r2=795931&view=diff ============================================================================== --- hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java (original) +++ hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java Mon Jul 20 17:41:01 2009 @@ -92,7 +92,7 @@ for (String loc : wrapped.getLocations()) { Path path = new Path(loc); FileStatus status = fs.getFileStatus(path); - BlockLocation[] b = fs.getFileBlockLocations(status, 0, status.getLen()); + BlockLocation[] b = fs.getFileBlockLocations(status, wrapped.getStart(), wrapped.getLength()); int total = 0; for (int i = 0; i < b.length; i++) { total += b[i].getHosts().length;