I need to put a small shared file on distributed cache so I can load it my
udf in pig0.7. We are using Hadoop 0.20.2+228. I tried to run it using
PIG_OPTS="-Dmapred.cache.archives=hdfs://namenode.host:5001/user/gen/categories/exclude/2012-03-15/exclude-categories#excludeCategory
-Dmapred.create.symlink=yes", runpig ~felix/testingr.pig
and
PIG_OPTS="-Dmapred.cache.files=hdfs://namenode.host:5001/user/gen/categories/exclude/2012-03-15/exclude-categories#excludeCategory
-Dmapred.create.symlink=yes", runpig ~felix/testingr.pig
when I do
hadoop fs -ls
hdfs://namenode.host:5001/user/gen/categories/exclude/2012-03-15/exclude-categories
I do see the file there.
However, on the UDF side I see
java.io.FileNotFoundException: excludeCategory (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:106)
at java.io.FileInputStream.<init>(FileInputStream.java:66)
at java.io.FileReader.<init>(FileReader.java:41)
What did I do wrong?
