You should also generally expect the DirectRunner to be slower than production runners - the goals of the DirectRunner are primarily ensuring that Pipelines are portable to other production runners and enforcing the Beam Programming Model while enabling local iteration and development, and exposing bugs early. As a result, there is a relatively large amount of additional work done per-element that will slow the Pipeline, and consume additional local resources as the Pipeline executes.
On Mon, Jan 23, 2017 at 11:05 AM, Gareth Western <[email protected]> wrote: > Actually I made a silly mistake in my configuration and had the wrong > topic name. Tired eyes. Thanks for confirming the config! > > On 23. jan. 2017 19:17, Raghu Angadi wrote: > > > On Mon, Jan 23, 2017 at 10:10 AM, Gareth Western < > <[email protected]>[email protected]> wrote: > >> * ConsumerConfig.GROUP_ID_CONFIG, >> UUID.randomUUID().toString(),* >> * ConsumerConfig.CLIENT_ID_CONFIG, "your_client_id",* >> * ConsumerConfig.AUTO_OFFSET_RESET_CONFIG, "earliest"* > > > Out of these three, you only need the last one. It should work, what did > you observe? > > >
