Sent for Renato, since Apache's mail system has decided it doesn't like him.

Alan.

I am getting an error while trying to execute a simple fragment replicated join on two files (one of 77MB and the other one of 32MB). I am using the 32MB file as the small one to be replicated, but I keep getting this error. Does any body know how this count is done? I mean how Pig determines that
the small file is not small enough, or how I could modify this?
I am executing these on four PC's with 3GB of RAM running DebianLenny.
Thanks in advance.


Renato M.

Pig Stack Trace
---------------
ERROR 2017: Internal error creating job configuration.

org.apache.pig.backend.executionengine.ExecException: ERROR 2043: Unexpected
error during execution.
      at
org .apache .pig .backend .hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java: 332)
      at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:835)
      at org.apache.pig.PigServer.execute(PigServer.java:828)
      at org.apache.pig.PigServer.access$100(PigServer.java:105)
      at org.apache.pig.PigServer$Graph.execute(PigServer.java:1080)
      at org.apache.pig.PigServer.executeBatch(PigServer.java:288)
      at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java: 109)
      at
org .apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java: 166)
      at
org .apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java: 138)
      at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
      at org.apache.pig.Main.main(Main.java:391)
Caused by:
org .apache .pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
ERROR 2017: Internal error creating job configuration.
      at
org .apache .pig .backend .hadoop .executionengine .mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:624)
      at
org .apache .pig .backend .hadoop .executionengine .mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:246)
      at
org .apache .pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.



Reply via email to