Daniel, I have filed a bug https://issues.apache.org/jira/browse/PIG-2401
-Prashant On Mon, Dec 5, 2011 at 7:06 PM, Prashant Kommireddi <[email protected]>wrote: > That's correct. I will file a bug with the details soon. Basically the > MR job never begins, it fails client-side without an exception > message. > > > -Prashant > > On Dec 5, 2011, at 7:00 PM, Daniel Dai <[email protected]> wrote: > > > What the log does is capture the exception, and dump to a file. In java > > mode, you should capture exception in your code. You said you didn't see > an > > exception, you mean the mapreduce job started but fail without exception? > > That's certainly unexpected. > > > > Daniel > > > > On Mon, Dec 5, 2011 at 6:47 PM, Prashant Kommireddi <[email protected] > >wrote: > > > >> Thanks Daniel. I did not see an exception either. Is log generation > >> with PigServer something that we could add in Pig 0.9.1? Debugging > >> would be a lot easier while converting existing if scripts to java and > >> otherwise. > >> > >> Sent from my iPhone > >> > >> On Dec 5, 2011, at 6:43 PM, Daniel Dai <[email protected]> wrote: > >> > >>> There is no log if you embed PigServer in code, however, you will see > >>> exception. > >>> > >>> Daniel > >>> > >>> On Mon, Dec 5, 2011 at 2:58 PM, Prashant Kommireddi < > [email protected] > >>> wrote: > >>> > >>>> FYI, I am aware the error is that I am using registerQuery and not > >>>> registerJar. Would just like to know where the error logs can be > found. > >>>> > >>>> Thanks, > >>>> Prashant Kommireddi > >>>> > >>>> On Mon, Dec 5, 2011 at 2:21 PM, Prashant Kommireddi < > >> [email protected] > >>>>> wrote: > >>>> > >>>>> I am embedding Pig Latin in Java, and want to check the error logs. > >> Where > >>>>> can I find them? > >>>>> The program below runs fine if I don't use the line > >>>> *pigServer.registerQuery("REGISTER > >>>>> '" +lib+ "';"); > >>>>> > >>>>> But fails when I use this line and I can't find the logs in the > >> directory > >>>>> I ran this from. > >>>>> > >>>>> * > >>>>> import java.io.IOException; > >>>>> > >>>>> import org.apache.hadoop.conf.Configuration; > >>>>> import org.apache.hadoop.fs.FileSystem; > >>>>> import org.apache.hadoop.fs.Path; > >>>>> import org.apache.pig.PigServer; > >>>>> > >>>>> public class idmapreduce { > >>>>> public static void main(String[] args) { > >>>>> try { > >>>>> PigServer pigServer = new PigServer("mapreduce"); > >>>>> runIdQuery(pigServer, "passwd", > >>>>> > >>>> > >> > "/home/pkommireddi/dev/apps/gridforce/main/pigassist/dist/pigassist.jar"); > >>>>> } catch (Exception e) {} > >>>>> } > >>>>> > >>>>> public static void runIdQuery(PigServer pigServer, String inputFile, > >>>>> String lib) throws IOException { > >>>>> Configuration conf = new Configuration(); > >>>>> FileSystem fs = FileSystem.get(conf); > >>>>> > >>>>> Path output = new Path("idout"); > >>>>> fs.delete(output, true); > >>>>> > >>>>> *pigServer.registerQuery("REGISTER '" +lib+ "';");* > >>>>> pigServer.registerQuery("A = load '" + inputFile + "' using > >>>>> PigStorage(':');"); > >>>>> pigServer.registerQuery("B = foreach A generate $0 as id;"); > >>>>> pigServer.store("B", "idout"); > >>>>> > >>>>> } > >>>>> } > >>>>> > >>>>> > >>>>> Thanks, > >>>>> Prashant Kommireddi > >>>>> > >>>> > >> >
