Dear Wiki user, You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.
The "LoadStoreRedesignProposal" page has been changed by AlanGates: http://wiki.apache.org/pig/LoadStoreRedesignProposal?action=diff&rev1=5&rev2=6 void prepareToWrite(RecordWriter writer); /** - * Called when all writing is finished. + * Called when all writing is finished. This will be called on the backend, + * once for each writing task. */ void doneWriting(); @@ -330, +331 @@ * @throws IOException */ void putNext(Tuple t) throws IOException; + + /** + * Called when writing all of the data is finished. This can be used + * to commit information to a metadata system, clean up tmp files, + * close connections, etc. This call will be made on the front end + * after all back end processing is finished. + */ + void allFinished(); + + } @@ -461, +472 @@ == Changes == Sept 23 2009, Gates * Changed setURI to setLocation in !LoadFunc and !StoreFunc. Also changed it to throw IOException in the cases where the passed in location is not valid for this load or store mechanism. - * Changed LoadSchema to ResourceSchema and LoadStatistics to ResourceStatistics + * Changed !LoadSchema to !ResourceSchema and !LoadStatistics to !ResourceStatistics - * Added getPartitionKeys and setPartitionFilter to LoadMetadata + * Added getPartitionKeys and setPartitionFilter to !LoadMetadata + Sept 25 2009, Gates + * Added allFinished call to !StoreFunc +