sivabalan narayanan created HUDI-5639:
-----------------------------------------
Summary: Ensure for spark streaming, single writer does not need
to set any additional configs with 0.13.0
Key: HUDI-5639
URL: https://issues.apache.org/jira/browse/HUDI-5639
Project: Apache Hudi
Issue Type: Improvement
Components: writer-core
Reporter: sivabalan narayanan
We added multi-writer capability to spark streaming.
[https://github.com/apache/hudi/pull/7383]
this introduced a identifier config that each writer should set. For a single
writer, we should set some default and not ask user to explicitly set the
configs.
for multi-writer scenarios, its fair to expect users to set different
identifiers for diff writers.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)