Solomon Duskis created BEAM-3246:
------------------------------------
Summary: BigtableIO should merge splits if they exceed 15K
Key: BEAM-3246
URL: https://issues.apache.org/jira/browse/BEAM-3246
Project: Beam
Issue Type: Bug
Components: sdk-java-gcp
Reporter: Solomon Duskis
Assignee: Solomon Duskis
A customer hit a problem with a large number of splits. CloudBitableIO fixes
that here
https://github.com/GoogleCloudPlatform/cloud-bigtable-client/blob/master/bigtable-dataflow-parent/bigtable-hbase-beam/src/main/java/com/google/cloud/bigtable/beam/CloudBigtableIO.java#L241
BigtableIO should have similar logic.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
