Thanks again Alan. -Xavier
On 3/29/11 3:39 PM, Alan Gates wrote: > If you turn your ArrayList into a bag it should be happy. > > Alan. > > On Mar 29, 2011, at 3:34 PM, Xavier Stevens wrote: > >> It probably wasn't the null values actually. It didn't like having >> ArrayList values in a map. >> >> >> -Xavier >> >> On 3/29/11 2:08 PM, Xavier Stevens wrote: >>> So it looks like the problem might be that one of the keys in the map >>> has a null value. Is that just not supported in Pig or is that a bug? >>> >>> -Xavier >>> >>> On 3/29/11 2:02 PM, Xavier Stevens wrote: >>>> The value is a mixture of types. I'll go through and spit out what >>>> types >>>> it has and get back to you. >>>> >>>> Thanks Alan. >>>> >>>> >>>> On 3/29/11 1:56 PM, Alan Gates wrote: >>>>> What are you putting in as the value of the map? From the error it >>>>> looks like your passing in a datatype Pig doesn't understand, and >>>>> when >>>>> it tries to write it out to the screen it doesn't know how to. >>>>> >>>>> Alan. >>>>> >>>>> On Mar 29, 2011, at 1:34 PM, Xavier Stevens wrote: >>>>> >>>>>> I'm currently getting a really weird error coming from one of my >>>>>> eval >>>>>> functions. It expects a tuple where the first element is a string >>>>>> and >>>>>> then outputs a Map<String,Object> as a result. I put in some >>>>>> debug code >>>>>> and I can see the value I get is what I expect and that the >>>>>> resulting >>>>>> map size is 35 elements. Anyone seen a problem like this before? >>>>>> >>>>>> Thanks, >>>>>> >>>>>> -Xavier >>>>>> >>>>>> Pig script line: >>>>>> >>>>>> genmap = FOREACH raw GENERATE >>>>>> com.mozilla.pig.eval.json.JsonMap(processed_json) AS >>>>>> processed_json_map:map[]; >>>>>> >>>>>> Log file: >>>>>> >>>>>> ERROR 2997: Unable to recreate exception from backed error: >>>>>> java.io.IOException: java.lang.RuntimeException: Unexpected data >>>>>> type -1 >>>>>> found in stream. >>>>>> >>>>>> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: >>>>>> Unable >>>>>> to open iterator for alias genmap. Backend error : Unable to >>>>>> recreate >>>>>> exception from backed error: java.io.IOException: >>>>>> java.lang.RuntimeException: Unexpected data type -1 found in stream. >>>>>> at org.apache.pig.PigServer.openIterator(PigServer.java:742) >>>>>> at >>>>>> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:612) >>>>>> >>>>>> at >>>>>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303) >>>>>> >>>>>> >>>>>> at >>>>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165) >>>>>> >>>>>> >>>>>> at >>>>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141) >>>>>> >>>>>> >>>>>> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:76) >>>>>> at org.apache.pig.Main.run(Main.java:465) >>>>>> at org.apache.pig.Main.main(Main.java:107) >>>>>> Caused by: org.apache.pig.backend.executionengine.ExecException: >>>>>> ERROR >>>>>> 2997: Unable to recreate exception from backed error: >>>>>> java.io.IOException: java.lang.RuntimeException: Unexpected data >>>>>> type -1 >>>>>> found in stream. >>>>>> at >>>>>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getErrorMessages(Launcher.java:221) >>>>>> >>>>>> >>>>>> at >>>>>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:154) >>>>>> >>>>>> >>>>>> at >>>>>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:337) >>>>>> >>>>>> >>>>>> at >>>>>> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:378) >>>>>> >>>>>> >>>>>> at >>>>>> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1198) >>>>>> >>>>>> at org.apache.pig.PigServer.storeEx(PigServer.java:874) >>>>>> at org.apache.pig.PigServer.store(PigServer.java:816) >>>>>> at org.apache.pig.PigServer.openIterator(PigServer.java:728) >>>>>> ... 7 more >>>>>> >
