novakov-alexey edited a comment on issue #3558:
URL: https://github.com/apache/hudi/issues/3558#issuecomment-957620142


   @kenny291 sorry, I made a mistake. I have just edited my last 2 messages. I 
am trying to insert 
   int -> double
   long -> double.
   
   that should be supported by Avro:
   
   ```
   the writer's schema may be promoted to the reader's as follows:
   
       int is promotable to long, float, or double
       long is promotable to float or double
   
   ```
   http://avro.apache.org/docs/current/spec#Schema+Resolution
   
   Besides sync to Hive issue, I also have such exception:
   
   ```scala
           at 
org.apache.parquet.hadoop.InternalParquetRecordReader.nextKeyValue(InternalParquetRecordReader.java:251)
           at 
org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:132)
           at 
org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:136)
           at 
org.apache.hudi.common.util.ParquetReaderIterator.hasNext(ParquetReaderIterator.java:49)
           at 
org.apache.hudi.common.util.queue.IteratorBasedQueueProducer.produce(IteratorBasedQueueProducer.java:45)
           at 
org.apache.hudi.common.util.queue.BoundedInMemoryExecutor.lambda$null$0(BoundedInMemoryExecutor.java:92)
           at java.util.concurrent.FutureTask.run(FutureTask.java:266)
           at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
           ... 4 more
   Caused by: java.lang.UnsupportedOperationException: 
org.apache.parquet.avro.AvroConverters$FieldLongConverter
           at 
org.apache.parquet.io.api.PrimitiveConverter.addDouble(PrimitiveConverter.java:84)
           at 
org.apache.parquet.column.impl.ColumnReaderImpl$2$2.writeValue(ColumnReaderImpl.java:228)
           at 
org.apache.parquet.column.impl.ColumnReaderImpl.writeCurrentValueToConverter(ColumnReaderImpl.java:367)
           at 
org.apache.parquet.io.RecordReaderImplementation.read(RecordReaderImplementation.java:406)
           at 
org.apache.parquet.hadoop.InternalParquetRecordReader.nextKeyValue(InternalParquetRecordReader.java:226)
           ... 11 more
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to