sivabalan narayanan created HUDI-2782:
-----------------------------------------
Summary: Fix marker based strategy for structured streaming
Key: HUDI-2782
URL: https://issues.apache.org/jira/browse/HUDI-2782
Project: Apache Hudi
Issue Type: Improvement
Reporter: sivabalan narayanan
As part of [this|https://github.com/apache/hudi/pull/3967] patch, we are making
timeline server based as the default marker type. But we have an issue w/
structured streaming. Looks like after 1st micro batch, the timeline server
gets shutdown and for subsequent micro batches, timeline server is not
available. So, in the patch we have made marker based overridden just for
structured streaming.
We may want to revisit this and see how to go about it.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
