[jira] [Commented] (BEAM-1269) BigtableIO should make more efficient use of connections

2017-03-29 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947642#comment-15947642 ] Solomon Duskis commented on BEAM-1269: -- Cloud Bigtable client 0.9.6 was just released, and should be

[jira] [Commented] (BEAM-1269) BigtableIO should make more efficient use of connections

2017-03-29 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948013#comment-15948013 ] Solomon Duskis commented on BEAM-1269: -- BigtableIO should not set data channel pool counts for reads.

[jira] [Commented] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

2017-06-29 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069316#comment-16069316 ] Solomon Duskis commented on BEAM-2545: -- I would suggest upgrading to the 1.0.0-pre1 release. We did

[jira] [Commented] (BEAM-2395) BigtableIO for Python SDK

2017-06-20 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056286#comment-16056286 ] Solomon Duskis commented on BEAM-2395: -- The python cloud bigtable client is missing some key features

[jira] [Created] (BEAM-2181) Upgrade Bigtable dependency to 0.9.6.2

2017-05-05 Thread Solomon Duskis (JIRA)
Solomon Duskis created BEAM-2181: Summary: Upgrade Bigtable dependency to 0.9.6.2 Key: BEAM-2181 URL: https://issues.apache.org/jira/browse/BEAM-2181 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-2955) Create a Cloud Bigtable HBase connector

2017-09-13 Thread Solomon Duskis (JIRA)
Solomon Duskis created BEAM-2955: Summary: Create a Cloud Bigtable HBase connector Key: BEAM-2955 URL: https://issues.apache.org/jira/browse/BEAM-2955 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-2955) Create a Cloud Bigtable HBase connector

2017-09-13 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165431#comment-16165431 ] Solomon Duskis commented on BEAM-2955: -- It's awesome that you added the Dynamic rebalancing! I'm ok

[jira] [Commented] (BEAM-2955) Create a Cloud Bigtable HBase connector

2017-09-13 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165523#comment-16165523 ] Solomon Duskis commented on BEAM-2955: -- Chamikra: HBaseIO will have to be extended or wrapped. Cloud

[jira] [Commented] (BEAM-3008) BigtableIO should use ValueProviders

2017-10-02 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188971#comment-16188971 ] Solomon Duskis commented on BEAM-3008: -- Cloud Bigtable is a constrained problem. Writes needs a Cloud

[jira] [Commented] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

2017-09-07 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157488#comment-16157488 ] Solomon Duskis commented on BEAM-2545: -- Yes. 1.0.0-pre3 is the proper version to choose. It should

[jira] [Comment Edited] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

2017-09-07 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157488#comment-16157488 ] Solomon Duskis edited comment on BEAM-2545 at 9/7/17 7:32 PM: -- Yes.

[jira] [Commented] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

2017-09-07 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157507#comment-16157507 ] Solomon Duskis commented on BEAM-2545: -- FYI, the Cloud Bigtable team released a version of

[jira] [Created] (BEAM-3008) BigtableIO should use ValueProviders

2017-10-02 Thread Solomon Duskis (JIRA)
Solomon Duskis created BEAM-3008: Summary: BigtableIO should use ValueProviders Key: BEAM-3008 URL: https://issues.apache.org/jira/browse/BEAM-3008 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-3154) Support multiple KeyRanges when reading from BigTable

2017-11-27 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267732#comment-16267732 ] Solomon Duskis commented on BEAM-3154: -- This is non trivial. We probably won't get to it this year.

[jira] [Created] (BEAM-3246) BigtableIO should merge splits if they exceed 15K

2017-11-24 Thread Solomon Duskis (JIRA)
Solomon Duskis created BEAM-3246: Summary: BigtableIO should merge splits if they exceed 15K Key: BEAM-3246 URL: https://issues.apache.org/jira/browse/BEAM-3246 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-3342) Create a Cloud Bigtable Python connector

2017-12-13 Thread Solomon Duskis (JIRA)
Solomon Duskis created BEAM-3342: Summary: Create a Cloud Bigtable Python connector Key: BEAM-3342 URL: https://issues.apache.org/jira/browse/BEAM-3342 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-3342) Create a Cloud Bigtable Python connector

2017-12-13 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289655#comment-16289655 ] Solomon Duskis commented on BEAM-3342: -- I started with a simple pipeline that writes to Cloud Bigtable

[jira] [Commented] (BEAM-3098) Upgrade Java grpc version

2017-12-07 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282659#comment-16282659 ] Solomon Duskis commented on BEAM-3098: -- grpc 1.7.0+ allows for tcnative to be shaded. Cloud Bigtable

[jira] [Commented] (BEAM-3311) Extend BigTableIO to write Iterable of KV

2017-12-07 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283044#comment-16283044 ] Solomon Duskis commented on BEAM-3311: -- I definitely agree that larger bundles are important. I would

[jira] [Assigned] (BEAM-3311) Extend BigTableIO to write Iterable of KV

2017-12-07 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Solomon Duskis reassigned BEAM-3311: Assignee: Solomon Duskis (was: Chamikara Jayalath) > Extend BigTableIO to write Iterable

[jira] [Created] (BEAM-3098) Upgrade Java grpc version

2017-10-25 Thread Solomon Duskis (JIRA)
Solomon Duskis created BEAM-3098: Summary: Upgrade Java grpc version Key: BEAM-3098 URL: https://issues.apache.org/jira/browse/BEAM-3098 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2955) Create a Cloud Bigtable HBase connector

2017-10-25 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219783#comment-16219783 ] Solomon Duskis commented on BEAM-2955: -- The problem is that Cloud Bigtable needs the following things:

[jira] [Created] (BEAM-4564) Update Bigtable dependencies

2018-06-14 Thread Solomon Duskis (JIRA)
Solomon Duskis created BEAM-4564: Summary: Update Bigtable dependencies Key: BEAM-4564 URL: https://issues.apache.org/jira/browse/BEAM-4564 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-3246) BigtableIO should merge splits if they exceed 15K

2018-06-25 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Solomon Duskis resolved BEAM-3246. -- Resolution: Fixed Fix Version/s: 2.5.0 This issue was fixed with [this

[jira] [Commented] (BEAM-2955) Create a Cloud Bigtable HBase connector

2018-04-30 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458848#comment-16458848 ] Solomon Duskis commented on BEAM-2955: -- [~iemejia], what's going on with HBaseIO these days?  Is it

[jira] [Commented] (BEAM-3311) Extend BigTableIO to write Iterable of KV

2018-01-25 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340124#comment-16340124 ] Solomon Duskis commented on BEAM-3311: -- I spoke quite a bit with the Beam team about this.  BigtableIO

[jira] [Closed] (BEAM-3311) Extend BigTableIO to write Iterable of KV

2018-01-25 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Solomon Duskis closed BEAM-3311. Resolution: Won't Fix Fix Version/s: Not applicable Use Flatten.iterable() instead of 

[jira] [Commented] (BEAM-3342) Create a Cloud Bigtable Python connector

2018-08-21 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587393#comment-16587393 ] Solomon Duskis commented on BEAM-3342: -- The Cloud Bigtable client is just about ready with full

[jira] [Commented] (BEAM-3098) Upgrade Java grpc version

2018-01-22 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335013#comment-16335013 ] Solomon Duskis commented on BEAM-3098: -- Ping. > Upgrade Java grpc version > -

[jira] [Commented] (BEAM-3412) Update BigTable client version to 1.0

2018-01-22 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334635#comment-16334635 ] Solomon Duskis commented on BEAM-3412: -- I submitted [https://github.com/apache/beam/pull/4462]. 

[jira] [Commented] (BEAM-3342) Create a Cloud Bigtable Python connector

2018-01-23 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336429#comment-16336429 ] Solomon Duskis commented on BEAM-3342: -- It turns out that we have quite a bit of work to do on the