Antonio Magnaghi a écrit :
If I understand correctly the problem, one possible way to configure the
job conf before launching the job to a given cluster could be:
PigContext pigContext = new PigContext(PigServer.ExecType.MAPREDUCE);
PigServer pigServer = new PigServer(pigContext);
Properties props = new Properties();
//
// set specific values in props...
// ...
// set these properties in the job conf. They will be present in the job
conf used when MR is executed
pigContext.getExecutionEngine().getConfiguration().putAll(props);
// register queries with the Pig Server that will trigger MR jobs(s)
Yes you understood correctly :)
There is a slight difference between your example above and the ones I
putted in PIG-93.
You are creating the pigServer object using pigContext object before
setting the properties in pigContext with putAll() method.
But it doesn't seem to solve the problem:
java.lang.RuntimeException: Bad mapred.job.tracker: local
at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:711)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:149)
at org.apache.pig.impl.PigContext.connect(PigContext.java:180)
at org.apache.pig.PigServer.<init>(PigServer.java:123)
-----Original Message-----
From: Benjamin Francisoud (JIRA) [mailto:[EMAIL PROTECTED]
Sent: Tuesday, February 05, 2008 8:20 AM
To: [email protected]
Subject: [jira] Created: (PIG-93) Impossible to set jobconf parameters
Impossible to set jobconf parameters
------------------------------------
Key: PIG-93
URL: https://issues.apache.org/jira/browse/PIG-93
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.1.0
Reporter: Benjamin Francisoud
Priority: Critical
