On Fri, Feb 16, 2018 at 9:39 AM, Romain Manni-Bucau <rmannibu...@gmail.com> wrote: > > 2018-02-16 18:18 GMT+01:00 Kenneth Knowles <k...@google.com>: > >> Which runner's bundling are you concerned with? It sounds like the Flink >> runner? >> > > Flink, Spark, DirectRunner, DataFlow at least (others would be good but > are out of scope) >
AFAIK bundling logic/perf is satisfactory on Dataflow, DirectRunner (for testing, so generates medium-sized local bundles) and SparkRunner (one bundle per microbatch when streaming). So what issue did you notice there? IIRC at some point the FlinkRunner had 1 element bundles in streaming. Obviously if that is still the case it has to be fixed. Kenn
