xiarixiaoyao commented on issue #7283:
URL: https://github.com/apache/hudi/issues/7283#issuecomment-1330450819
@lufzhangzitao
now reconcile cannot support type change, could you pls raise a jira for
this problem, i will fixed it as soon as possible.
```
/**
* Support reconcile from a new avroSchema.
* 1) incoming data has missing columns that were already defined in the
table –> null values will be injected into missing columns
* 2) incoming data contains new columns not defined yet in the table ->
columns will be added to the table schema (incoming dataframe?)
* 3) incoming data has missing columns that are already defined in the
table and new columns not yet defined in the table ->
* new columns will be added to the table schema, missing columns will
be injected with null values
* 4) support nested schema change.
* Notice:
* the incoming schema should not have delete/rename semantics.
* for example: incoming schema: int a, int b, int d; oldTableSchema
int a, int b, int c, int d
* we must guarantee the column c is missing semantic, instead of
delete semantic.
* @param incomingSchema implicitly evolution of avro when hoodie write
operation
* @param oldTableSchema old internalSchema
* @return reconcile Schema
*/
```
you can also use sql not achieve your goals
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
