nsivabalan commented on issue #5685: URL: https://github.com/apache/hudi/issues/5685#issuecomment-1152644499
@MikeTipico : Can you try enabling this config https://hudi.apache.org/docs/configurations/#hoodiedatasourcewritereconcileschema . This was initially added for the purpose you are talking about. But the schema evolution have some limitations. for eg, schema1: col1, col2. schema2: col1, col2, col3(default null) above one is ok. ie. once the table is upgraded to schema2, you can ingest records w/ schema1 and enable above config and things should be ok But below one may not work schema1: col1, col3 schema2: col1, col2(default null), col3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
