bvaradar commented on issue #1985: URL: https://github.com/apache/hudi/issues/1985#issuecomment-676387943
For switching from (unmanaged)spark.write() to deltastreamer, you need to provide the checkpoint explicitly to deltastreamer either by passing --initial-checkpoint-provider or --checkpoint. To get an example checkpoint, you can start deltastreamer on a brand new table and have it complete one commit and inspect the .commit/.deltacommit file for the checkpoint ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
