I love working on a problem for an hour, sending an email for help, then solving it. Problem was the space after the comma in the -files option:
$ hadoop pipes -D hadoop.pipes.java.recordreader=true -D hadoop.pipes.java.recordwriter=true -files \ ...[SEVERAL .so FILES TO DISTRIBUTED CACHE] hdfs://[HDFS SITE]/uwphysics/kwiley/mosaic/c++_bin/libboost_system-gcc41-mt-1_37.so.1.37.0, \ ...[SEVERAL .so FILES TO DISTRIBUTED CACHE] -input /uwphysics/kwiley/mosaic/input -output /uwphysics/kwiley/mosaic/output -program /uwphysics/kwiley/mosaic/c++_bin/MyPipesApp should have been: $ hadoop pipes -D hadoop.pipes.java.recordreader=true -D hadoop.pipes.java.recordwriter=true -files \ ...[SEVERAL .so FILES TO DISTRIBUTED CACHE] hdfs://[HDFS SITE]/uwphysics/kwiley/mosaic/c++_bin/libboost_system-gcc41-mt-1_37.so.1.37.0,\ <==== NO SPACE AFTER THE COMMA ...[SEVERAL .so FILES TO DISTRIBUTED CACHE] -input /uwphysics/kwiley/mosaic/input -output /uwphysics/kwiley/mosaic/output -program /uwphysics/kwiley/mosaic/c++_bin/MyPipesApp Makes perfect sense in hindsight. Perhaps others will benefit from the wisdom this thread imparts. Cheers! ________________________________________________________________________________ Keith Wiley [email protected] www.keithwiley.com "It's a fine line between meticulous and obsessive-compulsive and a slippery rope between obsessive compulsive and debilitatingly slow." -- Keith Wiley ________________________________________________________________________________
