I am using pig -x tez_local to test tez local mode and met following
problems (use tutorial.jar)
2014-06-03 11:06:35,964 [pool-1-thread-1] INFO
org.apache.hadoop.mapred.YarnTezDagChild - Running task,
taskAttemptId=attempt_1401811588093_0000_1_05_000000_0
2014-06-03 11:06:35,965 [pool-1-thread-1] ERROR
org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor -
Encountered exception while processing:
java.lang.NullPointerException
at
org.apache.pig.backend.hadoop.executionengine.tez.ObjectCache.retrieve(ObjectCache.java:47)
at
org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.collectSample(PigProcessor.java:307)
at
org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.initializeInputs(PigProcessor.java:218)
at
org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.run(PigProcessor.java:162)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:317)
at
org.apache.hadoop.mapred.YarnTezDagChild$3.run(YarnTezDagChild.java:602)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at
org.apache.hadoop.mapred.YarnTezDagChild.pollTask(YarnTezDagChild.java:591)
at
org.apache.hadoop.mapred.YarnTezDagChild.runTask(YarnTezDagChild.java:332)
at
org.apache.tez.dag.app.launcher.LocalContainerLauncher$1.run(LocalContainerLauncher.java:250)
at java.lang.Thread.run(Thread.java:744)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
code checking implies that the ObjectCache is trying to get something from
a Map but it is not there.
But what is the purpose of using ObjectCache in PIG on TEZ?
Why pig needs sampleVertex in the PigProcessor?
Any reply will be appreciated.
Regards!
Chen
