Hey Sean.
you would be best asking this question on the 'pig-user' mailing list,
and specifying which version of pig (and hadoop) you are running
against. FWIW I run my stuff with the 'types' branch, but I don't use
BinStorage (I use mainly custom loaders/writers)
Regards
Ian
Sean Timm wrote:
Using a small set of my data, I can process it, write it to BinStorage
and load it again. When I use a larger set, I get an error
"java.io.IOException: One schema is null [One schema is null]" when
loading the data. I don't see any errors in the logs processing the
data. The stack trace is below.
Thanks,
Sean
grunt> A = load '/tmp/1113clusterOut-d0' USING BinStorage();
funcSpec: BinStorage
java.io.IOException: One schema is null [One schema is null]
at
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1245)
at
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305)
at
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305)
at
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305)
at
org.apache.pig.impl.logicalLayer.schema.Schema.mergeSchema(Schema.java:1305)
at
org.apache.pig.data.DataType.determineFieldSchema(DataType.java:793)
at
org.apache.pig.builtin.BinStorage.determineSchema(BinStorage.java:229)
at
org.apache.pig.impl.logicalLayer.LOLoad.getSchema(LOLoad.java:136)
at
org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:584)
at
org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:60)
at org.apache.pig.PigServer.parseQuery(PigServer.java:295)
at org.apache.pig.PigServer.registerQuery(PigServer.java:263)
at
org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:439)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:249)
at
org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:94)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
at org.apache.pig.Main.main(Main.java:282)
Caused by:
org.apache.pig.impl.logicalLayer.schema.SchemaMergeException: One
schema is null
... 17 more
2009-01-02 17:10:12,265 [main] ERROR
org.apache.pig.tools.grunt.GruntParser -
java.lang.IllegalStateException: Can't overwrite cause
at java.lang.Throwable.initCause(Throwable.java:320)
at
org.apache.pig.impl.logicalLayer.LOLoad.getSchema(LOLoad.java:143)
at
org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:584)
at
org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:60)
at org.apache.pig.PigServer.parseQuery(PigServer.java:295)
at org.apache.pig.PigServer.registerQuery(PigServer.java:263)
at
org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:439)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:249)
at
org.apache.pig.tools.grunt.GruntParser.parseContOnError(GruntParser.java:94)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:58)
at org.apache.pig.Main.main(Main.java:282)
2009-01-02 17:10:12,265 [main] ERROR
org.apache.pig.tools.grunt.GruntParser - Can't overwrite cause
2009-01-02 17:10:12,265 [main] ERROR
org.apache.pig.tools.grunt.GruntParser -
java.lang.IllegalStateException: Can't overwrite cause
