Hi Xia, Thanks for driving this FLIP. +1 from my side.
I have one comment. Could you please mention the default values for the new configurations (e.g., table.exec.hive.infer-source-parallelism.mode, table.exec.hive.infer-source-parallelism.enabled, etc) ? Regards, Jeyhun On Tue, Apr 16, 2024 at 9:46 AM Zhu Zhu <reed...@gmail.com> wrote: > Thanks for creating this FLIP. @Xia > > +1 for this proposal. Dynamic parallelism inference can be helpful > to decide a better parallelism. And it's good to unify the settings > of static & dynamic parallelism inference. > > Thanks, > Zhu > > > Xia Sun <xingbe...@gmail.com> 于2024年4月16日周二 15:12写道： > > > Hi everyone, > > I would like to start a discussion on FLIP-445: Support dynamic > parallelism > > inference for HiveSource[1]. > > > > FLIP-379[2] has introduced dynamic source parallelism inference for batch > > jobs, which can utilize runtime information to more accurately decide the > > source parallelism. As a follow-up task, we plan to implement the dynamic > > parallelism inference interface for HiveSource, and also switch the > default > > static parallelism inference to dynamic parallelism inference. > > > > Looking forward to your feedback and suggestions, thanks. > > > > [1] > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-445%3A+Support+dynamic+parallelism+inference+for+HiveSource > > [2] > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs > > > > Best regards, > > Xia > > >
