kazdy commented on issue #5873: URL: https://github.com/apache/hudi/issues/5873#issuecomment-1158134991
@xiarixiaoyao that would be great :) Do you want me to open jira ticket for this? I did some more research and it seems like for schema reconciliation hudi takes the latest schema and applies it to the incoming batch. To be more precise as for what I'm looking for is to have this: 1. incoming data doesn’t contain every column in the table –> those columns will simply be assigned null/default values 2. incoming data contains new column in the table -> those columns will be added to the table schema Do you think this is something that schema reconciliation feature should support, or something new? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
