Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for change 

The "Pig070IncompatibleChanges" page has been changed by OlgaN.


  == Local Mode ==
  == Streaming ==
- == Other Changes ==
+ == Split by File ==
- - Split by file
+ In the earlier versions of Pig, a user could specify "split by file" on the 
loader statement which would make sure that each map got the entire file rather 
than the files were further divided into blocks. This feature was primarily 
design for streaming optimization but could also be used with loaders that 
can't deal with incomplete records. We don't believe that this functionality 
has been widely used.
+ Because the slicing of the data is no longer in Pig's control, we can't 
support this feature generically for every loader. If a particular loader needs 
this functionality, it will need to make sure that the underlying InputFormat 
supports it. 
+ We will have a different approach for streaming optimization if that 
functionality is necessary.
  == Open Questions ==

Reply via email to