Has some one successfully used the SerDe for Avro provided by Jakob
(https://github.com/jghoman/haivvreo)?
I am using the exact versions of avro and hive recommended by the authors
but running into all kinds of problems just in running their examples...
Can someone please help me out?
create table test row format serde 'com.linkedin.haivvreo.AvroSerDe' with
serdeproperties ('schema.literal'='{"namespace": "com.linkedin.haivvreo",
"name": "test_schema", "type":"record", "fields":[{"name":"string1",
"type":"string"} ] }') stored as inputformat
'com.linkedin.haivvreo.AvroContainerInputFormat' outputformat
'com.linkedin.haivvreo.AvroContainerOutputFormat';
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.avro.Schema
at
com.linkedin.haivvreo.HaivvreoUtils.determineSchemaOrThrowException(HaivvreoUtils.java:50)
at
com.linkedin.haivvreo.HaivvreoUtils.determineSchemaOrReturnErrorSchema(HaivvreoUtils.java:76)
at com.linkedin.haivvreo.AvroSerDe.initialize(AvroSerDe.java:51)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:199)
at
org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253)
at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:484)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:450)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:3146)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:213)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
FAILED: Execution Error, return code -101 from
org.apache.hadoop.hive.ql.exec.DDLTask
My setup:
hive: 0.7.1
avro: 1.4.1
hadoop: 1.0.0
added the jackson jars as recommended using add jar on hive cli.
Thanks,
--
View this message in context:
http://apache-avro.679487.n3.nabble.com/Avro-and-Hive-contd-tp3773468p3773468.html
Sent from the Avro - Users mailing list archive at Nabble.com.
