[
https://issues.apache.org/jira/browse/HUDI-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379726#comment-17379726
]
ASF GitHub Bot commented on HUDI-2103:
--------------------------------------
SEZ9 commented on pull request #3185:
URL: https://github.com/apache/hudi/pull/3185#issuecomment-878886071
> > index_bootstrap 可否单独设置parallelism，运行初始化用到的资源 比后边流数据的资源大的多
>
> I think index_bootstrap parallelism define by flink parallelism, if need
bootstrap you can set a large parallelism for flink job and narrow flink job
parallelism after bootstrap.
we do this practice now, but it's complex , we need restart the job and
change the configuration 。hopefully bootstrap can auth release the resource
,but it's sound difficult
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Add rebalance before index bootstrap
> ------------------------------------
>
> Key: HUDI-2103
> URL: https://issues.apache.org/jira/browse/HUDI-2103
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Flink Integration
> Reporter: yuzhaojing
> Assignee: yuzhaojing
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
> When use flink sql upsert to hudi, user always set parallelism larger than
> kafak partition num. Now bootstrap operator need at least one element to
> trigger loading.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
