nsivabalan commented on pull request #3742:
URL: https://github.com/apache/hudi/pull/3742#issuecomment-933618714
@n3nash @vinothchandar : Wanted to discuss how we can support multi-writer
across deltastreamer and spark-ds. As of now, looks like copying the metadata
from previous commit to current one is missing in spark-ds and I have fixed it
here. But this requires users to set
hoodie.datasource.write.commitmeta.key.prefix="deltastreamer.checkpoint.key"
with spark-ds. wondering if this is the right fix. If yes, do we really need
the user to set this config? can't we infer automatically.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
