Beam doesn't expose such a thing directly but the FlinkRunner may be able to take some pipeline options to configure this.
On Wed, Apr 29, 2020 at 5:51 PM Eleanore Jin <[email protected]> wrote: > Hi Kyle, > > I am using Flink Runner (v1.8.2) > > Thanks! > Eleanore > > On Wed, Apr 29, 2020 at 10:33 AM Kyle Weaver <[email protected]> wrote: > >> Which runner are you using? >> >> On Wed, Apr 29, 2020 at 1:32 PM Eleanore Jin <[email protected]> >> wrote: >> >>> Hi all, >>> >>> I just wonder can Beam allow to set parallelism for each operator >>> (PTransform) separately? Flink provides such feature. >>> >>> The usecase I have is the source is kafka topics, which has less >>> partitions, while we have heavy PTransform and would like to scale it with >>> more parallelism. >>> >>> Thanks a lot! >>> Eleanore >>> >>
