danny0405 commented on PR #19376: URL: https://github.com/apache/hudi/pull/19376#issuecomment-5089258705
Have some high-level questions: 1. why recover from a checkpoint for batch source? the batch source prefers to be stateless usually; 2. we can do some basic validation like read.start-commit / read.end-commit to cover the boundary of the input splits, but why bother the others: table path, table type, query type and partition, shouldn't the user ensure the consistency of these basic options? It looks like we snapshot business logic in Hudi storage. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
