njalan opened a new issue, #10160:
URL: https://github.com/apache/hudi/issues/10160
Got below error message when try to load data from postgresql into hudi, But
it is working fine on hudi 0.9.
Caused by: org.apache.hudi.exception.HoodieException:
org.apache.avro.AvroTypeException: Cannot encode decimal with precision 15 as
max precision 14
at
org.apache.hudi.common.util.queue.SimpleExecutor.execute(SimpleExecutor.java:73)
at
org.apache.hudi.table.action.commit.HoodieMergeHelper.runMerge(HoodieMergeHelper.java:154)
... 31 more
Caused by: org.apache.avro.AvroTypeException: Cannot encode decimal with
precision 15 as max precision 14
at
org.apache.avro.Conversions$DecimalConversion.validate(Conversions.java:140)
at
org.apache.avro.Conversions$DecimalConversion.toFixed(Conversions.java:104)
at
org.apache.hudi.avro.HoodieAvroUtils.rewritePrimaryTypeWithDiffSchemaType(HoodieAvroUtils.java:994)
at
org.apache.hudi.avro.HoodieAvroUtils.rewritePrimaryType(HoodieAvroUtils.java:921)
at
org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchema(HoodieAvroUtils.java:866)
at
org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchema(HoodieAvroUtils.java:864)
at
org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchema(HoodieAvroUtils.java:822)
at
org.apache.hudi.avro.HoodieAvroUtils.rewriteRecordWithNewSchema(HoodieAvroUtils.java:786)
at
org.apache.hudi.common.model.HoodieAvroIndexedRecord.rewriteRecordWithNewSchema(HoodieAvroIndexedRecord.java:123)
at
org.apache.hudi.common.model.HoodieRecord.rewriteRecordWithNewSchema(HoodieRecord.java:369)
at
org.apache.hudi.table.action.commit.HoodieMergeHelper.lambda$runMerge$1(HoodieMergeHelper.java:143)
at
org.apache.hudi.common.util.queue.SimpleExecutor.execute(SimpleExecutor.java:66)
I think the source table with column **xxxx numeric(14, 4)** call the
issue.
Environment Description
Hudi version : 0.13.1
Spark version : 3.0.1
Hive version : 3.1
Hadoop version : 3.2.2
Storage (HDFS/S3/GCS..) :
Running on Docker? no :
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
