hotienvu commented on issue #778: Fixed TableNotFoundException when write with structured streaming URL: https://github.com/apache/incubator-hudi/pull/778#issuecomment-509995889 > LGTM overall. but is it a requirement to keep the checkpoints under the basePath? In general, would not advise having peripheral data stored with the dataset itself. thoughts? I think it's a matter of convenience/preference. The checkpoint data is an integral part of Spark SS so we like to keep it close to the source/sink unless there is reason not to do so. Also there could be other scenarios where directory is created before hand e.g. setup script
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
