Re: Python SDK: BigTableIO

2017-06-01 Thread Davor Bonaci
(JIRA role added; reassigned.) On Thu, Jun 1, 2017 at 10:05 AM, Chamikara Jayalath wrote: > Thanks. I added some comments to the doc. > > Davor should be able to assign this JIRA to you. Also, Solomon who > implemented the Java BigTable connector might have more input

Re: Python SDK: BigTableIO

2017-06-01 Thread Chamikara Jayalath
Thanks. I added some comments to the doc. Davor should be able to assign this JIRA to you. Also, Solomon who implemented the Java BigTable connector might have more input here. - Cham On Thu, Jun 1, 2017 at 2:19 AM Matthias Baetens < matthias.baet...@datatonic.com> wrote: > Hi Cham, Stephan, >

Re: Python SDK: BigTableIO

2017-06-01 Thread Matthias Baetens
Hi Cham, Stephan, Thanks a lot for the input, really useful to get started. We'll probably start with implementing the Source (looks the most straightforward). I made a working document to organise

Re: Python SDK: BigTableIO

2017-05-30 Thread Stephen Sisk
Hey Matthias, to add on to what Chamikara mentioned, we have lots of info in the generic IO authoring guide [1], the Python IO authoring guide [2] and the PTransform Style Guide[3]. The PTransform style guide doesn't sound like it applies, but it has a lot of specific tips from lessons we've

Re: Python SDK: BigTableIO

2017-05-28 Thread Chamikara Jayalath
Thanks for offering to help. I would suggest to look into existing Java BigTableIO connector and currently available Python client library for Cloud BigTable to see how feasible it is to develop an efficient BigTable connector at this point. From Python SDK's perspective you can use

Python SDK: BigTableIO

2017-05-28 Thread Matthias Baetens
Hey guys, We have been using Beam for quite a few months now, so we (my colleague Robert & I) thought it might be cool to contribute a bit as well. The challenge we want to take up is writing the BigTableIO for the Python SDK (which is not yet in the works according to the website