Hi Rodrigo,
Thanks for your suggestion. Though I don't see how the multistore UDF
helps.
Register UDFs etc
A = LOAD
B = LOAD
C = LOAD
-- do lots of transformations with A and B and C get intermediate result
INTER_RES
result1 = FOREACH (GROUP INTER_RES BY (...
STORE result1
Hi there,
I've a big pig script which first generates some expensive intermediate
result on which I run multiple group by statements and multiple stores.
Something like this.
Register UDFs etc
A = LOAD
B = LOAD
C = LOAD
-- do lots of transformations with A and B and C get
Marco,
check out this UDF:
http://pig.apache.org/docs/r0.8.1/api/org/apache/pig/piggybank/storage/MultiStorage.html
I think it can get the job done without having to group everything.
Cheers,
Rodrigo
2015-01-08 7:27 GMT-02:00 Marco Cadetg ma...@zattoo.com:
Hi there,
I've a big pig script