sivabalan narayanan created HUDI-3367:
-----------------------------------------
Summary: Add spark scheduling configs support to spark data source
writer
Key: HUDI-3367
URL: https://issues.apache.org/jira/browse/HUDI-3367
Project: Apache Hudi
Issue Type: Task
Components: spark
Reporter: sivabalan narayanan
We have support to set scheduling configs in spark for deltastreamer. this was
added so that we can allocate resources efficiently between regular delta syncs
and async table services like compaction. We don't have that support in spark
data source writer. we might need the support to keep it flexible for users.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)