WarFox commented on issue #8258: URL: https://github.com/apache/hudi/issues/8258#issuecomment-1484047309
Thanks @ad1happy2go We are also leaning towards using either Spark Structured streaming or Batch processing as a workaround. We have some working examples for both cases now, thanks again for sharing your example code too Could you confirm if we need to have a separate process for compaction when using Spark Structured streaming for writing to Hudi? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
