I have the exact same problem, and yes, I run my queries from Java
concurrently. The issue is easier to reproduce in local mode than in
MR mode (I never saw it in MR mode actually).
I've tried to add calls to pigServer.shutdown() to see if this can
help, but the issue remains.
Ashutosh Chauhan a écrit :
Hi Bennie,
Are you using Pig Java API to run your queries? If so, are you trying to run
queries concurrently in multiple threads ?
Ashutosh
On Tue, Nov 3, 2009 at 11:00, Bennie Schut <[email protected]> wrote:
From time to time I receive this error:
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable
to store alias uqusers11
at org.apache.pig.PigServer.store(PigServer.java:536)
at org.apache.pig.PigServer.store(PigServer.java:493)
at
com.ebuddy.dwhmapreduce.pig.chatsessions.UniqueUsers.run(UniqueUsers.java:76)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.RuntimeException: Unable to find clone for op Const
16-169( 1 )
at
org.apache.pig.impl.logicalLayer.LogicalPlan.clone(LogicalPlan.java:139)
at
org.apache.pig.impl.logicalLayer.LogicalPlanCloneHelper.<init>(LogicalPlanCloneHelper.java:63)
at
org.apache.pig.impl.logicalLayer.LogicalPlanCloner.getClonedPlan(LogicalPlanCloner.java:45)
at
org.apache.pig.impl.logicalLayer.parser.QueryParser.ForEachClause(QueryParser.java:3044)
at
org.apache.pig.impl.logicalLayer.parser.QueryParser.BaseExpr(QueryParser.java:1328)
at
org.apache.pig.impl.logicalLayer.parser.QueryParser.Expr(QueryParser.java:907)
at
org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:696)
at
org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:63)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1034)
at org.apache.pig.PigServer$Graph.clone(PigServer.java:1077)
at org.apache.pig.PigServer.clonePlan(PigServer.java:389)
at org.apache.pig.PigServer.compileLp(PigServer.java:804)
at org.apache.pig.PigServer.compileLp(PigServer.java:791)
at org.apache.pig.PigServer.store(PigServer.java:509)
... 5 more
However running it a 2nd time it runs just fine. It's a little hard to
reproduce. I received this on a line like this:
uqusers11 = FOREACH uqusers10 GENERATE user_id, protocol, logincldr_id,
logintime_id;
but also sometimes on this:
uqusers6 = FOREACH uqusers5 GENERATE flatten($0), MIN(uqusers4.login) as
mindate;
so for now it mostly seems to happen on foreach statements (I'm
currently using pig trunk and hadoop 20.1)
Can anyone point me in the right direction on what to look at when
looking at errors like this.
Thanks,
Bennie.