xiarixiaoyao commented on issue #7444:
URL: https://github.com/apache/hudi/issues/7444#issuecomment-1352766393
@voonhous
Implicit schema changes that do not write to the .schema folder will cause
read issues on Spark's end.
but we can enable Implicit full schema evolution by enable following two
parameters。
"hoodie.schema.on.read.enable" -> "true",
"hoodie.datasource.write.reconcile.schema" -> "true",
test by master branch
```
// INT -> [Long, Float, Double] pass
doTest("int", 0, 3)
// Long -> [Float, Double]
doTest("long", 1, 3) pass
// Float -> [Double]
doTest("float", 2, 3) pass
// String -> [Bytes] faild, full schema evolution not support
string -> byte.
// doTest("string", 3, 4)
// Bytes -> [String] faild full schema evolution not support byte
-> string.
// doTest("binary", 4, 5)
full schema evolution
* now only support:
* int => long/float/double/string
* long => float/double/string
* float => double/String
* double => String/Decimal
* Decimal => Decimal/String
* String => date/decimal
* date => String
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
