I'm not 100% sure I understand the question. Are you asking if it re-
uses instances of a given load or store function? It should not.
Alan.
On Aug 31, 2010, at 7:28 PM, Russell Jurney wrote:
Pardon the cross-post: Does Pig ever re-use FileInputLoadFunc
objects? We
suspect state is being retained between different stores, but we don't
actually know this. Figured I'd ask to verify the hunch.
Our load func for our in-house format works fine with Pig scripts
normally... but I have a pig script that looks like this:
LOAD thing1
SPLIT thing1 INTO thing2, thing3
STORE thing2 INTO thing2
STORE thing3 INTO thing3
LOAD thing4
SPLIT thing4 INTO thing5, thing6
STORE thing5 INTO thing5
STORE thing6 INTO thing6
And it works via PigStorage, but not via our FileInputLoadFunc.
Russ
