I realize that my earlier mail was to users@ which was probably not
appropriate for this part:

When you do something like this:

pig -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig

Pig tries to load all jars (including those in PIG_CLASSPATH) from HDFS.
That isn't necessarily desirable when you want to centralize your scripts
to avoid a single point of failure but avoid some kind of multi-person jar
hell or some kind of deployment fun for platform upgrades.

Would anyone object if I add something like this?:

pig -Dforcelocaljars=true -useHCatalog
hdfs://myserver:8020/load/scripts/mydir/myscript.pig

or should it be more like this

pig -forceLocalJars -useHCatalog
hdfs://myserver:8020/load/scripts/mydir/myscript.pig

With your guidance I'll provide a patch.

Thanks,

Andy

Reply via email to