Christopher, You might consider breaking it into one or more reusable macros. What version of pig are you using?
For complicated scripts, especially if you didn't write them, you might want to take a look at lipstick, https://github.com/Netflix/Lipstick It allows you to visualize the dag and clearly shows what logical operators map to map-reduce jobs. It could be a starting point for managing complexity at least. --jacob @thedatachef On Mar 5, 2014, at 7:33 AM, Christopher Petrino <[email protected]> wrote: > Hi all, what is everyone's approach for managing a Pig scripts that has > become very long? What is your best way to break it up into smaller pieces?
