[
https://issues.apache.org/jira/browse/HUDI-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-3367:
--------------------------------------
Summary: Add spark scheduling configs support to spark streaming writes
(was: Add spark scheduling configs support to spark data source writer)
> Add spark scheduling configs support to spark streaming writes
> --------------------------------------------------------------
>
> Key: HUDI-3367
> URL: https://issues.apache.org/jira/browse/HUDI-3367
> Project: Apache Hudi
> Issue Type: Task
> Components: spark
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Blocker
> Fix For: 0.11.0
>
>
> We have support to set scheduling configs in spark for deltastreamer. this
> was added so that we can allocate resources efficiently between regular delta
> syncs and async table services like compaction. We don't have that support in
> spark data source writer. we might need the support to keep it flexible for
> users.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)