Author: gates
Date: Mon Jul 20 17:41:01 2009
New Revision: 795931
URL: http://svn.apache.org/viewvc?rev=795931&view=rev
Log:
PIG-878: Pig is returning too many blocks in the input split.
Modified:
hadoop/pig/trunk/CHANGES.txt
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
Modified: hadoop/pig/trunk/CHANGES.txt
URL:
http://svn.apache.org/viewvc/hadoop/pig/trunk/CHANGES.txt?rev=795931&r1=795930&r2=795931&view=diff
==============================================================================
--- hadoop/pig/trunk/CHANGES.txt (original)
+++ hadoop/pig/trunk/CHANGES.txt Mon Jul 20 17:41:01 2009
@@ -40,6 +40,8 @@
BUG FIXES
+ PIG-878: Pig is returning too many blocks in the input split. (arunc
via gates).
+
PIG-888: Pig do not pass udf to the backend in some situation (daijy)
PIG-728: All backend error messages must be logged to preserve the
Modified:
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
URL:
http://svn.apache.org/viewvc/hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java?rev=795931&r1=795930&r2=795931&view=diff
==============================================================================
---
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
(original)
+++
hadoop/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SliceWrapper.java
Mon Jul 20 17:41:01 2009
@@ -92,7 +92,7 @@
for (String loc : wrapped.getLocations()) {
Path path = new Path(loc);
FileStatus status = fs.getFileStatus(path);
- BlockLocation[] b = fs.getFileBlockLocations(status, 0,
status.getLen());
+ BlockLocation[] b =
fs.getFileBlockLocations(status, wrapped.getStart(), wrapped.getLength());
int total = 0;
for (int i = 0; i < b.length; i++) {
total += b[i].getHosts().length;