[jira] [Comment Edited] (BEAM-3342) Create a Cloud Bigtable Python connector

2018-08-21 Thread Adam Lugowski (JIRA)


[ 
https://issues.apache.org/jira/browse/BEAM-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587953#comment-16587953
 ] 

Adam Lugowski edited comment on BEAM-3342 at 8/21/18 8:18 PM:
--

I'm happy to help out if you need a hand. I have some relevant experience in 
such things.


was (Author: alugowski):
I'm happy to help out if you need a hand.

> Create a Cloud Bigtable Python connector
> 
>
> Key: BEAM-3342
> URL: https://issues.apache.org/jira/browse/BEAM-3342
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Solomon Duskis
>Assignee: Solomon Duskis
>Priority: Major
>
> I would like to create a Cloud Bigtable python connector.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (BEAM-3342) Create a Cloud Bigtable Python connector

2018-08-21 Thread Adam Lugowski (JIRA)


[ 
https://issues.apache.org/jira/browse/BEAM-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587953#comment-16587953
 ] 

Adam Lugowski commented on BEAM-3342:
-

I'm happy to help out if you need a hand.

> Create a Cloud Bigtable Python connector
> 
>
> Key: BEAM-3342
> URL: https://issues.apache.org/jira/browse/BEAM-3342
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Solomon Duskis
>Assignee: Solomon Duskis
>Priority: Major
>
> I would like to create a Cloud Bigtable python connector.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (BEAM-3342) Create a Cloud Bigtable Python connector

2018-08-21 Thread Adam Lugowski (JIRA)


[ 
https://issues.apache.org/jira/browse/BEAM-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587951#comment-16587951
 ] 

Adam Lugowski commented on BEAM-3342:
-

Glad to hear we're getting close!

It looks like the Java implementation of `BoundedSource`, 
[https://github.com/apache/beam/blob/release-2.6.0/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableIO.java#L786]
 , is just based on sampled row keys which is also available in the Python 
client under `table.sample_row_keys()`. Both Python and Java clients talk to 
the same API, don't they?

> Create a Cloud Bigtable Python connector
> 
>
> Key: BEAM-3342
> URL: https://issues.apache.org/jira/browse/BEAM-3342
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Solomon Duskis
>Assignee: Solomon Duskis
>Priority: Major
>
> I would like to create a Cloud Bigtable python connector.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (BEAM-3342) Create a Cloud Bigtable Python connector

2018-08-18 Thread Adam Lugowski (JIRA)


[ 
https://issues.apache.org/jira/browse/BEAM-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16584948#comment-16584948
 ] 

Adam Lugowski commented on BEAM-3342:
-

What issues are you facing?

I did a quick glance at the Datastore connector and it seems like everything it 
does is already supported by Google's BigTable client.

I ask because my workloads would be much easier to write in Python than Java.

> Create a Cloud Bigtable Python connector
> 
>
> Key: BEAM-3342
> URL: https://issues.apache.org/jira/browse/BEAM-3342
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Solomon Duskis
>Assignee: Solomon Duskis
>Priority: Major
>
> I would like to create a Cloud Bigtable python connector.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)