Sagar Sumit created HUDI-7554:
---------------------------------
Summary: HiveAvroSerializer breaks compatibility between Hive2 an
Hive3
Key: HUDI-7554
URL: https://issues.apache.org/jira/browse/HUDI-7554
Project: Apache Hudi
Issue Type: Sub-task
Reporter: Sagar Sumit
Fix For: 0.15.0
{code:java}
java.lang.NoSuchMethodError: 'java.sql.Timestamp
org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableTimestampObjectInspector.getPrimitiveJavaObject(java.lang.Object)'
at
org.apache.hudi.hadoop.utils.HiveAvroSerializer.serializePrimitive(HiveAvroSerializer.java:305)
at
org.apache.hudi.hadoop.utils.HiveAvroSerializer.serialize(HiveAvroSerializer.java:212)
at
org.apache.hudi.hadoop.utils.HiveAvroSerializer.setUpRecordFieldFromWritable(HiveAvroSerializer.java:121)
at
org.apache.hudi.hadoop.utils.HiveAvroSerializer.serialize(HiveAvroSerializer.java:108)
at
org.apache.hudi.hadoop.realtime.RealtimeCompactedRecordReader.convertArrayWritableToHoodieRecord(RealtimeCompactedRecordReader.java:198)
at
org.apache.hudi.hadoop.realtime.RealtimeCompactedRecordReader.mergeRecord(RealtimeCompactedRecordReader.java:183)
at
org.apache.hudi.hadoop.realtime.RealtimeCompactedRecordReader.next(RealtimeCompactedRecordReader.java:123)
at
org.apache.hudi.hadoop.realtime.RealtimeCompactedRecordReader.next(RealtimeCompactedRecordReader.java:53)
at
org.apache.hudi.hadoop.realtime.HoodieRealtimeRecordReader.next(HoodieRealtimeRecordReader.java:86)
at
org.apache.hudi.hadoop.realtime.HoodieRealtimeRecordReader.next(HoodieRealtimeRecordReader.java:36)
at
io.trino.plugin.hive.GenericHiveRecordCursor.advanceNextPosition(GenericHiveRecordCursor.java:221)
at
io.trino.plugin.hive.util.ForwardingRecordCursor.advanceNextPosition(ForwardingRecordCursor.java:46)
at
io.trino.spi.connector.RecordPageSource.getNextPage(RecordPageSource.java:88)
{code}
Inspected the Hive code for `WritableTimestampObjectInspector` class and the
return type for one of the methods changed from `java.sql.Timestamp` to
`org.apache.hadoop.hive.common.type.Timestamp` in Hive 3.1. While Hudi code is
still running with Hive 2.3.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
