[
https://issues.apache.org/jira/browse/HUDI-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-2782:
--------------------------------------
Fix Version/s: 0.11.0
> Fix marker based strategy for structured streaming
> --------------------------------------------------
>
> Key: HUDI-2782
> URL: https://issues.apache.org/jira/browse/HUDI-2782
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: sivabalan narayanan
> Priority: Major
> Fix For: 0.11.0
>
>
> As part of [this|https://github.com/apache/hudi/pull/3967] patch, we are
> making timeline server based as the default marker type. But we have an issue
> w/ structured streaming. Looks like after 1st micro batch, the timeline
> server gets shutdown and for subsequent micro batches, timeline server is not
> available. So, in the patch we have made marker based overridden just for
> structured streaming.
>
> We may want to revisit this and see how to go about it.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
