Re: beam new feature

2021-06-22 Thread Daria Malkova
Hi community! Based on this design doc (https://docs.google.com/document/d/1wBzVhQEhTK23ALzTSZ_CVouEOXTm3w2-LjmO3ieUvFc/edit?usp=sharing) I’ve created a PR https://github.com/apache/beam/pull/15049 . Looking forward to your reviews and please feel free to ask any questions. Best, Daria

Re: beam new feature

2021-06-09 Thread Alexey Romanenko
Thanks, I left my comments as well. — Alexey > On 8 Jun 2021, at 22:21, Luke Cwik wrote: > > Thanks, I left a few comments in the doc. > > On Tue, Jun 8, 2021 at 12:26 PM Daria Malkova > wrote: > > Hi community! > > I've noticed that there is no

Re: beam new feature

2021-06-08 Thread Luke Cwik
Thanks, I left a few comments in the doc. On Tue, Jun 8, 2021 at 12:26 PM Daria Malkova wrote: > Hi community! > > I've noticed that there is no possibility in Beam JDBC to use partitioning > for reading a very large table with millions of rows in parallel (for > example when migrating legacy

beam new feature

2021-06-08 Thread Daria Malkova
Hi community! I've noticed that there is no possibility in Beam JDBC to use partitioning for reading a very large table with millions of rows in parallel (for example when migrating legacy database data to BigQuery). I have some ideas which are decribed here in more detailes: