What version of pig are you running? Elephant Bird works with Pig 0.6, not 0.7
There is another version on the Jira that works with 0.7 but has a few drawbacks (the big one being that it expects everything to be strings) -D On Tue, Jun 29, 2010 at 8:10 AM, Pavel Gutin <[email protected]> wrote: > Thank you for trying to help me out. Here's the error that's in my log file > > ERROR 2998: Unhandled internal error. org/apache/pig/Slicer > > java.lang.NoClassDefFoundError: org/apache/pig/Slicer > at java.lang.ClassLoader.defineClass1(Native Method) > at java.lang.ClassLoader.defineClassCond(ClassLoader.java:632) > at java.lang.ClassLoader.defineClass(ClassLoader.java:616) > at > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) > at java.net.URLClassLoader.access$000(URLClassLoader.java:58) > at java.net.URLClassLoader$1.run(URLClassLoader.java:197) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > at java.lang.ClassLoader.loadClass(ClassLoader.java:307) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > at java.lang.ClassLoader.loadClass(ClassLoader.java:296) > at java.lang.ClassLoader.loadClass(ClassLoader.java:248) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:247) > at > org.apache.pig.impl.PigContext.resolveClassName(PigContext.java:422) > at > org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:452) > at > > org.apache.pig.impl.logicalLayer.parser.QueryParser.NonEvalFuncSpec(QueryParser.java:5087) > at > > org.apache.pig.impl.logicalLayer.parser.QueryParser.LoadClause(QueryParser.java:1434) > at > > org.apache.pig.impl.logicalLayer.parser.QueryParser.BaseExpr(QueryParser.java:1245) > at > > org.apache.pig.impl.logicalLayer.parser.QueryParser.Expr(QueryParser.java:911) > at > > org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:700) > at > > org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:63) > at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1164) > at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1114) > at org.apache.pig.PigServer.registerQuery(PigServer.java:425) > at > org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:737) > at > > org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:324) > at > > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:162) > at > > org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:138) > at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:75) > at org.apache.pig.Main.main(Main.java:357) > Caused by: java.lang.ClassNotFoundException: org.apache.pig.Slicer > at java.net.URLClassLoader$1.run(URLClassLoader.java:202) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > at java.lang.ClassLoader.loadClass(ClassLoader.java:307) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > at java.lang.ClassLoader.loadClass(ClassLoader.java:248) > ... 32 more > > > On Mon, Jun 28, 2010 at 7:56 PM, Dmitriy Ryaboy <[email protected]> > wrote: > > > Pavel, > > What does the log say? > > > > I am guessing you need to a) make sure that all the hbase config stuff is > > on > > the classpath and b) load 'hbase://silk1' (no host:port) > > > > -D > > > > On Mon, Jun 28, 2010 at 10:37 AM, Pavel Gutin <[email protected]> > > wrote: > > > > > My apologies, i pasted the wrong line. I was testing to see if pig was > > able > > > to locate the JAR by misspelling the name on purpose > > > > > > Here's the correct error. > > > > > > grunt> a = load 'hbase://localhost:60000/silk1' USING > > > com.twitter.elephantbird.pig.load.HBaseLoader('f1:destination_port') AS > > > (destination_port); > > > 2010-06-28 13:19:01,288 [main] ERROR org.apache.pig.tools.grunt.Grunt - > > > ERROR 2998: Unhandled internal error. org/apache/pig/Slicer > > > Details at logfile: > > > /usr/local/hadoop/pigtmp/pig-0.7.0/pig_1277744862785.log > > > grunt> > > > > > > > > > On Mon, Jun 28, 2010 at 1:34 PM, Pavel Gutin <[email protected]> > > wrote: > > > > > > > This seems like it might work for me. I downloaded it, compiled it, > and > > > > added the JAR to PIG_CLASSPATH > > > > > > > > However, when i try to run the following command, i get an error > > > > > > > > grunt> a = load 'hbase://myTable' USING > > > > co.twitter.elephantbird.pig.load.HBaseLoader('f1:col1') AS (col1); > > > > 2010-06-28 13:13:59,607 [main] ERROR org.apache.pig.tools.grunt.Grunt > - > > > > ERROR 1070: Could not resolve > > > co.twitter.elephantbird.pig.load.HBaseLoader > > > > using imports: [, org.apache.pig.builtin., > > org.apache.pig.impl.builtin.] > > > > Details at logfile: > > > > /usr/local/hadoop/pigtmp/pig-0.7.0/pig_1277744862785.log > > > > grunt> > > > > > > > > I have a feeling I am not referencing the table the right way. > > > > > > > > On Mon, Jun 28, 2010 at 11:43 AM, Dmitriy Ryaboy <[email protected] > > > >wrote: > > > > > > > >> There's an HBase LoadFunc that works with 0.6 in Elephant-Bird. > > > >> http://github.com/kevinweil/elephant-bird > > > >> > > > >> There are slides here that show usage: > > > >> > > > >> > > > > > > http://squarecog.wordpress.com/2010/05/20/pig-hbase-hadoop-and-twitter-hug-talk-slides/ > > > >> > > > >> -D > > > >> > > > >> On Mon, Jun 28, 2010 at 7:59 AM, Pavel Gutin <[email protected]> > > > >> wrote: > > > >> > > > >> > I am trying to get Pig to query my HBase table, but I cannot find > > any > > > >> > examples on the web. Can anyone provide me with a simple example? > > > >> > > > > >> > The best I could find so far, was a little blurb on the following > > page > > > >> > > http://wiki.apache.org/pig/PigMultiQueryPerformanceSpecificationbut > > > >> that > > > >> > didn't help much. > > > >> > > > > >> > Thanks in advance. > > > >> > > > > >> > - Pavel > > > >> > > > > >> > > > > > > > > > > > > > >
