[ 
https://issues.apache.org/jira/browse/PIG-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350484#comment-16350484
 ] 

TamilArasu Perumal edited comment on PIG-5330 at 2/2/18 3:10 PM:
-----------------------------------------------------------------

Pig doesn't like the implicit conversion. it has to be explicit 

Ex.: memberId AS MemberId:long (memberId was an integer but doesn't convert 
that to long) 

i had to modify the line to (long) memberId AS MemberId. 

 

It is working now, I can close this issue with the above note for developers. 
but I am not sure whether any fix need to be done or it suppose to work like 
this. Please review and take action as needed. 


was (Author: tamilarasu):
Pig doesn't like the implicit conversion. it has to be explicit 

Ex.: memberId AS MemberId:long (memberId was an integer but doesn't convert 
that to long) 

i had to modify the line to (long) memberId AS MemberId. 

 

It is working now, I am closing with the above so it can be helpful for the 
other developers if they see this generic error. 

> DUMP throws IOException but it DESCRIBE's the schema
> ----------------------------------------------------
>
>                 Key: PIG-5330
>                 URL: https://issues.apache.org/jira/browse/PIG-5330
>             Project: Pig
>          Issue Type: Bug
>         Environment: Hortonworks - hadoop platform. But code is running local 
> using Junit test method
>            Reporter: TamilArasu Perumal
>            Priority: Major
>
> This started happening recently for some JOINs and ORDER BY clause. Not sure 
> anything to do with the java update. Currently running Java 8 (161). Here is 
> the pig code and log 
> memberIds: \{newMemberId: long,memberId: long}
> memberTier: \{Name: chararray,MemberId: long,TierId: long,StartDateId: 
> long,EndDateId: long}
> DUMP memberTier; – works fine
>  DESCRIBE memberTier; – works fine 
>  DUMP memberIds; – works fine
>  DESCRIBE memberIds; – works fine
>  memberTierOne = JOIN memberTier BY (MemberId) LEFT OUTER, memberIds BY 
> (memberId);
>  DUMP memberTierOne; – errors out (if commented, the next line works)
>  DESCRIBE memberTierOne; – (works fine, when DUMP is commented)
> Stack Trace 
> 4097 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 
> map reduce job(s) failed!
>  Disconnected from the target VM, address: '127.0.0.1:55872', transport: 
> 'socket'
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to 
> open iterator for alias memberTierOne
> at org.apache.pig.PigServer.openIterator(PigServer.java:1019)
>  at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:747)
>  at 
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:376)
>  at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:231)
>  at org.apache.pig.pigunit.pig.PigServer.registerScript(PigServer.java:55)
>  at org.apache.pig.pigunit.PigTest.registerScript(PigTest.java:193)
>  at org.apache.pig.pigunit.PigTest.runScript(PigTest.java:203)
>  at 
> com.olson.tally.client.hilton.migration.pigunit.test.MemberTierTest.MemberTierFileLoadMemberTierTestRun(MemberTierTest.java:157)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
>  at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
>  at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
>  at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
>  at 
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
>  at 
> org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
>  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
>  at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
>  at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
>  at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
>  at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
>  at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
>  at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
>  at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
>  at org.junit.runner.JUnitCore.run(JUnitCore.java:157)
>  at 
> com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
>  at 
> com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:47)
>  at 
> com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:242)
>  at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
>  Caused by: java.io.IOException: Job terminated with anomalous status FAILED
>  at org.apache.pig.PigServer.openIterator(PigServer.java:1011)
>  ... 30 more
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to