[ https://issues.apache.org/jira/browse/PIG-1591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai resolved PIG-1591. ----------------------------- Hadoop Flags: [Reviewed] Fix Version/s: 0.8.0 Resolution: Fixed Patch committed to both trunk and 0.8 branch. > pig does not create a log file, if tje MR job succeeds but front end fails. > --------------------------------------------------------------------------- > > Key: PIG-1591 > URL: https://issues.apache.org/jira/browse/PIG-1591 > Project: Pig > Issue Type: Bug > Reporter: niraj rai > Assignee: niraj rai > Fix For: 0.8.0 > > Attachments: pig_1591.patch > > > When I run this script: > A = load 'limit_empty.input_a' as (a1:int); > B = load 'limit_empty.input_b' as (b1:int); > C =COGROUP A by a1, B by b1; > C1 = foreach C { Alim = limit A 1; Blim = limit B 1; generate Alim, Blim; } > D1 = FOREACH C1 generate Alim,Blim, (IsEmpty(Alim)? 0:1), (IsEmpty(Blim)? > 0:1), COUNT(Alim), COUNT(Blim); > dump D1; > The MR job succeeds but the pig job fails with the fillowing error: > 2010-08-31 13:33:09,960 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics > - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - > already initialized > 2010-08-31 13:33:09,962 [main] INFO org.apache.pig.impl.io.InterStorage - > Pig Internal storage in use > 2010-08-31 13:33:09,963 [main] INFO org.apache.pig.impl.io.InterStorage - > Pig Internal storage in use > 2010-08-31 13:33:09,963 [main] INFO > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - Success! > 2010-08-31 13:33:09,964 [main] INFO org.apache.pig.impl.io.InterStorage - > Pig Internal storage in use > 2010-08-31 13:33:09,965 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics > - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - > already initialized > 2010-08-31 13:33:09,969 [main] INFO > org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to > process : 1 > 2010-08-31 13:33:09,969 [main] INFO > org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input > paths to process : 1 > 2010-08-31 13:33:09,973 [main] ERROR > org.apache.pig.backend.hadoop.executionengine.HJob - > java.lang.ClassCastException: java.lang.Integer cannot be cast to > org.apache.pig.data.Tuple > since MR job is succeeded, so the pig does not create any log file, but it > should still create a log file, giving the cause of failure in the pig. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.