[
https://issues.apache.org/jira/browse/HIVE-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cyrus Katrak updated HIVE-828:
------------------------------
Description:
When I try to create a thrift based table Hive goes into an infinite loop, and
eventually overflows the stack:
hive> create table dxmsg
> ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.ThriftDeserializer'
> WITH SERDEPROPERTIES (
> "serialization.class" = "*******REMOVED********",
> "serialization.format" = "com.facebook.thrift.protocol.TBinaryProtocol"
> ) STORED AS SEQUENCEFILE;
Exception in thread "main" java.lang.StackOverflowError
at
sun.reflect.generics.tree.TypeVariableSignature.make(TypeVariableSignature.java:19)
at
sun.reflect.generics.parser.SignatureParser.parseTypeVariableSignature(SignatureParser.java:329)
at
sun.reflect.generics.parser.SignatureParser.parseFieldTypeSignature(SignatureParser.java:230)
at
sun.reflect.generics.parser.SignatureParser.parseTypeArgument(SignatureParser.java:319)
at
sun.reflect.generics.parser.SignatureParser.parseTypeArguments(SignatureParser.java:284)
at
sun.reflect.generics.parser.SignatureParser.parseSimpleClassTypeSignature(SignatureParser.java:260)
at
sun.reflect.generics.parser.SignatureParser.parseClassTypeSignatureSuffix(SignatureParser.java:270)
at
sun.reflect.generics.parser.SignatureParser.parseClassTypeSignature(SignatureParser.java:244)
at
sun.reflect.generics.parser.SignatureParser.parseFieldTypeSignature(SignatureParser.java:228)
at
sun.reflect.generics.parser.SignatureParser.parseTypeSignature(SignatureParser.java:359)
at
sun.reflect.generics.parser.SignatureParser.parseTypeSig(SignatureParser.java:157)
at
sun.reflect.generics.repository.FieldRepository.parse(FieldRepository.java:34)
at
sun.reflect.generics.repository.FieldRepository.parse(FieldRepository.java:24)
at
sun.reflect.generics.repository.AbstractRepository.<init>(AbstractRepository.java:56)
at
sun.reflect.generics.repository.FieldRepository.<init>(FieldRepository.java:30)
at
sun.reflect.generics.repository.FieldRepository.make(FieldRepository.java:48)
at java.lang.reflect.Field.getGenericInfo(Field.java:85)
at java.lang.reflect.Field.getGenericType(Field.java:223)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
.................
I have left out my thrift struct definition. I can say that it is quite simple
and flat (No nested messages, no recursive definitions, not even any
containers).
was:
When I try to create a thrift based table Hive goes into an infinite loop, and
eventually overflows the stack:
hive> create table dxmsg
> ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.ThriftDeserializer'
> WITH SERDEPROPERTIES (
> "serialization.class" = "*******REMOVED********",
> "serialization.format" = "com.facebook.thrift.protocol.TBinaryProtocol"
> ) STORED AS SEQUENCEFILE;
Exception in thread "main" java.lang.StackOverflowError
at
sun.reflect.generics.tree.TypeVariableSignature.make(TypeVariableSignature.java:19)
at
sun.reflect.generics.parser.SignatureParser.parseTypeVariableSignature(SignatureParser.java:329)
at
sun.reflect.generics.parser.SignatureParser.parseFieldTypeSignature(SignatureParser.java:230)
at
sun.reflect.generics.parser.SignatureParser.parseTypeArgument(SignatureParser.java:319)
at
sun.reflect.generics.parser.SignatureParser.parseTypeArguments(SignatureParser.java:284)
at
sun.reflect.generics.parser.SignatureParser.parseSimpleClassTypeSignature(SignatureParser.java:260)
at
sun.reflect.generics.parser.SignatureParser.parseClassTypeSignatureSuffix(SignatureParser.java:270)
at
sun.reflect.generics.parser.SignatureParser.parseClassTypeSignature(SignatureParser.java:244)
at
sun.reflect.generics.parser.SignatureParser.parseFieldTypeSignature(SignatureParser.java:228)
at
sun.reflect.generics.parser.SignatureParser.parseTypeSignature(SignatureParser.java:359)
at
sun.reflect.generics.parser.SignatureParser.parseTypeSig(SignatureParser.java:157)
at
sun.reflect.generics.repository.FieldRepository.parse(FieldRepository.java:34)
at
sun.reflect.generics.repository.FieldRepository.parse(FieldRepository.java:24)
at
sun.reflect.generics.repository.AbstractRepository.<init>(AbstractRepository.java:56)
at
sun.reflect.generics.repository.FieldRepository.<init>(FieldRepository.java:30)
at
sun.reflect.generics.repository.FieldRepository.make(FieldRepository.java:48)
at java.lang.reflect.Field.getGenericInfo(Field.java:85)
at java.lang.reflect.Field.getGenericType(Field.java:223)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
at
org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
.................
> StackOverflowError When Creating Thirft Table
> ---------------------------------------------
>
> Key: HIVE-828
> URL: https://issues.apache.org/jira/browse/HIVE-828
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
> Affects Versions: 0.3.0
> Environment: Error occurs against 0.3 hadoop .19 and against svn
> trunk r814614
> Reporter: Cyrus Katrak
>
> When I try to create a thrift based table Hive goes into an infinite loop,
> and eventually overflows the stack:
> hive> create table dxmsg
> > ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.ThriftDeserializer'
> > WITH SERDEPROPERTIES (
> > "serialization.class" = "*******REMOVED********",
> > "serialization.format" = "com.facebook.thrift.protocol.TBinaryProtocol"
> > ) STORED AS SEQUENCEFILE;
> Exception in thread "main" java.lang.StackOverflowError
> at
> sun.reflect.generics.tree.TypeVariableSignature.make(TypeVariableSignature.java:19)
> at
> sun.reflect.generics.parser.SignatureParser.parseTypeVariableSignature(SignatureParser.java:329)
> at
> sun.reflect.generics.parser.SignatureParser.parseFieldTypeSignature(SignatureParser.java:230)
> at
> sun.reflect.generics.parser.SignatureParser.parseTypeArgument(SignatureParser.java:319)
> at
> sun.reflect.generics.parser.SignatureParser.parseTypeArguments(SignatureParser.java:284)
> at
> sun.reflect.generics.parser.SignatureParser.parseSimpleClassTypeSignature(SignatureParser.java:260)
> at
> sun.reflect.generics.parser.SignatureParser.parseClassTypeSignatureSuffix(SignatureParser.java:270)
> at
> sun.reflect.generics.parser.SignatureParser.parseClassTypeSignature(SignatureParser.java:244)
> at
> sun.reflect.generics.parser.SignatureParser.parseFieldTypeSignature(SignatureParser.java:228)
> at
> sun.reflect.generics.parser.SignatureParser.parseTypeSignature(SignatureParser.java:359)
> at
> sun.reflect.generics.parser.SignatureParser.parseTypeSig(SignatureParser.java:157)
> at
> sun.reflect.generics.repository.FieldRepository.parse(FieldRepository.java:34)
> at
> sun.reflect.generics.repository.FieldRepository.parse(FieldRepository.java:24)
> at
> sun.reflect.generics.repository.AbstractRepository.<init>(AbstractRepository.java:56)
> at
> sun.reflect.generics.repository.FieldRepository.<init>(FieldRepository.java:30)
> at
> sun.reflect.generics.repository.FieldRepository.make(FieldRepository.java:48)
> at java.lang.reflect.Field.getGenericInfo(Field.java:85)
> at java.lang.reflect.Field.getGenericType(Field.java:223)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:149)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> .................
> I have left out my thrift struct definition. I can say that it is quite
> simple and flat (No nested messages, no recursive definitions, not even any
> containers).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
