Also 'REGISTER' the jars that'll be used in the MR tasks in the script. Else add them 'pig.additional.jars' in pig.properties.
Regards, Rama. On Sat, Feb 9, 2013 at 7:16 AM, kiran chitturi <[email protected]>wrote: > Thanks for the reply! > > Yes. I did add hbase dependencies to the PIG_CLASSPATH. I am using the > below lines in my pig script. > > field = LOAD 'hbase://documents' USING > org.apache.pig.backend.hadoop.hbase.HBaseStorage('info:collection', > '-loadKey false') as (fieldOL); > store field into 'results/extract' using PigStorage(';'); > > Thanks, > Kiran. > > > > On Fri, Feb 8, 2013 at 8:44 PM, Harsha <[email protected]> wrote: > > > kiran, > > if you are trying to access protobuf from inside pig script put the > > jar in PIG_CLASSPATH. > > > > -- > > Harsha > > > > > > On Friday, February 8, 2013 at 4:56 PM, kiran chitturi wrote: > > > > > Hi! > > > > > > I am trying to use pig and hbase but i keep running in to > > > classNotFoundException error. I have tried few things but they have > never > > > worked. > > > > > > I am using pig 0.10.1 and hbase 0.94.1, hadoop 1.0.4. I have updated my > > > HADOOP_CLASSPATH in hadoop-env.sh (http://hadoop-env.sh) as per this > > post [0] > > > > > > After updating my classpath, when i do the command > > '/opt/hadoop/bin/hadoop > > > classpath' i could see the protobuf jar file in it. > > > > > > Yet, when i run the pig script that loads from hadoop class, i keep > > getting > > > this error in the map tasks (Error: java.lang.ClassNotFoundException: > > > com.google.protobuf.Message). > > > > > > Every data node has the protobuf jar file in its hadoop classpath. I > have > > > also tried adding the jar file like this (/opt/pig-0.10.1/bin/pig > > > /opt/pig_programs/testHbase.pig > > > -Dpig.additional.jars=/opt/hbase-0.94.1/lib/protobuf-java-2.4.0a.jar ). > > > > > > I keep running in to this error. > > > > > > Can anyone please let me know how to solve this issue ? > > > > > > > > > Many Thanks, > > > Kiran. > > > > > > [0] - > > > > > > http://mail-archives.apache.org/mod_mbox/pig-user/201211.mbox/%3ccanbtpchb5+kfyew+rg8evyextoutx2p4gxkyfv1luc94qdt...@mail.gmail.com%3E > > > > > > -- > > > Kiran Chitturi > > > > > > > > > > > > > > > -- > Kiran Chitturi >
