OK. First one.
Pig gets confused when USING 'merge' and invoked via 'run'. When refactor the script to NOT call run it works fine…. I'll try to get a reduction for this so you can duplicate it. I'm also getting the same error when I'm trying to do my second merge join. ERROR 1103: Merge join/Cogroup only supports Filter, Foreach, filter and Load as its predecessor. Found : org.apache.pig.backend.hadoop.executionengine.physicalLayer.LogicalToPhysicalTranslatorException: ERROR 1103: Merge join/Cogroup only supports Filter, Foreach, filter and Load as its predecessor. Found : at org.apache.pig.newplan.logical.relational.LogToPhyTranslationVisitor.validateMapSideMerge(LogToPhyTranslationVisitor.java:850) at org.apache.pig.newplan.logical.relational.LogToPhyTranslationVisitor.visit(LogToPhyTranslationVisitor.java:1012) at org.apache.pig.newplan.logical.relational.LOJoin.accept(LOJoin.java:170) at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75) at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:50) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:292) at org.apache.pig.PigServer.compilePp(PigServer.java:1373) at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1310) at org.apache.pig.PigServer.execute(PigServer.java:1299) at org.apache.pig.PigServer.executeBatch(PigServer.java:359) at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192) at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164) at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81) at org.apache.pig.Main.run(Main.java:553) at org.apache.pig.Main.main(Main.java:108) ….. I'm fairly certain this is a bug because the first merge join is created identically to the second one and it works fine. It's the second one that fails. My work should GREATLY benefit from doing repeated merge joins so I'll probably spend more time on this and get these isolated since I'd like to have them fixed. Heck maybe I'll just fix them :-P -- Founder/CEO Spinn3r.com Location: *San Francisco, CA* Skype: *burtonator* Skype-in: *(415) 871-0687*
