Does an unbounded JdbcIO exist, or would I need to wrap the existing one in a spilttable DoFn? Or maybe there is an easier way to do it?
Thank you again, Eric On Wed, Apr 20, 2022, 21:59 Ahmet Altay <[email protected]> wrote: > /cc @Pablo Estrada <[email protected]> @John Casey > <[email protected]> > > On Wed, Apr 20, 2022 at 6:29 PM Eric Berryman <[email protected]> > wrote: > >> Hello, >> >> I have a rather simple use case where I would like to read a db table, >> which acts as a queue (~ hundreds millions events in initial load, but only >> thousands of events per day), and write that data out to a sink. This >> pipeline would be unbounded. >> >> I'm looking for reading material, and or code, which displays reading >> from the JdbcIO API with checkpoints. I would like to avoid the initial >> load on restarts, upgrades, etc. :) >> >> Thank you for your time! >> Eric >> >
