Re: Reading from BigTable with Beam Python SDK

Yes but I think it’s caused by the same description for Java and Python SDKs and Java connector supports both - Read and Write. So, we need to reflect this there, thanks for pointing out. — Alexey > On 7 Jan 2022, at 14:50, Pierre Oberholzer > wrote: > > Hi, > > If this discussion

Re: Reading from BigTable with Beam Python SDK

We'd want to avoid the intermediate CSV serialization and directly operate with the BigTable instance instead. And we are using Python SDK so, reading from Java is not an option for us. Sayak Paul | sayak.dev On Fri, Jan 7, 2022 at 2:32 PM Sofia’s World wrote: > Hello, > my 2 cents (and not

Re: Reading from BigTable with Beam Python SDK

Hello, my 2 cents (and not sure if it makes sense for your usecase) What about the python process read from BigTable and store in a bucket as csv? Then you can read the csv from java>? hth marco On Fri, Jan 7, 2022 at 7:31 AM Chamikara Jayalath wrote: > Irrespective of whether the Java

Re: Reading from BigTable with Beam Python SDK

My question still remains same. I am not yet sure how to use an existing Java transform (like BigTable IO reader in Java) from a Python pipeline. The examples take a user-defined sample transform and then show their usage. On Fri, 7 Jan, 2022, 11:10 Chamikara Jayalath, wrote: > Actually this is

Re: Reading from BigTable with Beam Python SDK

Luke, I studied the resources you provided. However, it's still a little unclear to me as to how I could use the BigTableIO in Java from a Python pipeline. The examples and documentation first

Re: Reading from BigTable with Beam Python SDK

Thanks! On Thu, 6 Jan, 2022, 22:27 Luke Cwik, wrote: > +1 on using cross language to get the Java Bigtable connector that > already exists. > > You could also take a look at this other xlang documentation[1] and look > at an existing implementation such as kafka[2] that is xlang. > > Finally

Reading from BigTable with Beam Python SDK

Hi folks, My project needs reading data from Cloud BigTable. We are aware that an IO connector for BigTable is available in the Java SDK. So we could probably make use of the cross-language capabilities