[
https://issues.apache.org/jira/browse/BEAM-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949879#comment-15949879
]
ASF GitHub Bot commented on BEAM-1269:
--------------------------------------
GitHub user mdshalda opened a pull request:
https://github.com/apache/beam/pull/2377
BEAM-1269: Update bigtable library dependency and add cached data pools.
Hi @dhalperi,
Can you review these changes to add the new bigtable library and cached
data pools?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mdshalda/beam mshalda/beam-1269
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/2377.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2377
----
commit a9503d0cb973743437f74badaeea2127d176f84a
Author: mdshalda <[email protected]>
Date: 2017-03-30T21:06:03Z
BEAM-1269: Update bigtable library dependency. Enable cached data pools for
efficiency and remove pegging data channel count to 1.
----
> BigtableIO should make more efficient use of connections
> --------------------------------------------------------
>
> Key: BEAM-1269
> URL: https://issues.apache.org/jira/browse/BEAM-1269
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-gcp
> Reporter: Daniel Halperin
> Labels: newbie, starter
>
> RIght now, {{BigtableIO}} opens up a new Bigtable session for every DoFn, in
> the {{@Setup}} function. However, sessions can support multiple connections,
> so perhaps this code should be modified to open up a smaller session pool and
> then allocation connections in {{@StartBundle}}.
> This would likely make more efficient use of resources, especially for highly
> multithreaded workers.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
