sujsin77 created ZEPPELIN-5271: ---------------------------------- Summary: Running Pig Query in Apache Zeppelin Key: ZEPPELIN-5271 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5271 Project: Zeppelin Issue Type: Bug Components: Interpreters Affects Versions: 0.9.0 Reporter: sujsin77
I am running following Pig query in Apache Zeppelin {{%pig.query A = load '/Pig_data' using PigStorage(',') as(ExamName,ExamId,BITSID, StudentName,Issue_Type,Time); B = group A by Issue_Type; C = FOREACH B GENERATE group as Issue_Type, COUNT($1);}} But is gives me following error {{org.apache.zeppelin.interpreter.InterpreterException: java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/conf/YarnConfiguration at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:836) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:744) at org.apache.zeppelin.scheduler.Job.run(Job.java:172) at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:132) at org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/conf/YarnConfiguration at org.apache.pig.PigServer.<init>(PigServer.java:249) at org.apache.pig.PigServer.<init>(PigServer.java:220) at org.apache.pig.PigServer.<init>(PigServer.java:193) at org.apache.pig.PigServer.<init>(PigServer.java:185) at org.apache.zeppelin.pig.PigInterpreter.open(PigInterpreter.java:64) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70) ... 8 more Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.conf.YarnConfiguration at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 14 more}} I had checked that hadoop classpath and yarn classpath is set already {{[hadoop@localhost ~]$ hadoop classpath /home/hadoop/hadoop/etc/hadoop:/home/hadoop/hadoop/share/hadoop/common/lib/*:/home/hadoop/hadoop/share/hadoop/common/*:/home/hadoop/hadoop/share/hadoop/hdfs:/home/hadoop/hadoop/share/hadoop/hdfs/lib/*:/home/hadoop/hadoop/share/hadoop/hdfs/*:/home/hadoop/hadoop/share/hadoop/mapreduce/lib/*:/home/hadoop/hadoop/share/hadoop/mapreduce/*:/home/hadoop/hadoop/share/hadoop/yarn:/home/hadoop/hadoop/share/hadoop/yarn/lib/*:/home/hadoop/hadoop/share/hadoop/yarn/* [hadoop@localhost ~]$ yarn classpath /home/hadoop/hadoop/etc/hadoop:/home/hadoop/hadoop/share/hadoop/common/lib/*:/home/hadoop/hadoop/share/hadoop/common/*:/home/hadoop/hadoop/share/hadoop/hdfs:/home/hadoop/hadoop/share/hadoop/hdfs/lib/*:/home/hadoop/hadoop/share/hadoop/hdfs/*:/home/hadoop/hadoop/share/hadoop/mapreduce/lib/*:/home/hadoop/hadoop/share/hadoop/mapreduce/*:/home/hadoop/hadoop/share/hadoop/yarn:/home/hadoop/hadoop/share/hadoop/yarn/lib/*:/home/hadoop/hadoop/share/hadoop/yarn/*}} also set in *zeppelin-env.sh* {{export USE_HADOOP=True export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop}} please help me where is the problem. -- This message was sent by Atlassian Jira (v8.3.4#803005)