[
https://issues.apache.org/jira/browse/BEAM-7230?focusedWorklogId=335780&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-335780
]
ASF GitHub Bot logged work on BEAM-7230:
----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Oct/19 21:37
Start Date: 29/Oct/19 21:37
Worklog Time Spent: 10m
Work Description: iemejia commented on issue #9904: [BEAM-7230] Fixes NPE
When Using JdbcIO.PoolableDataSourceProvider
URL: https://github.com/apache/beam/pull/9904#issuecomment-547640957
Just as a minor comment on this, the reason why the impl went into the
static approach (that now I see has clear issues) was because of the opposite
case the original reported issue happened because JdbcIO was building a pool of
connections per DoFn instantiation which was reported to be overwhelming the
target db on max number of connections on streaming pipelines.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 335780)
Time Spent: 3h 10m (was: 3h)
> Using JdbcIO creates huge amount of connections
> -----------------------------------------------
>
> Key: BEAM-7230
> URL: https://issues.apache.org/jira/browse/BEAM-7230
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Affects Versions: 2.11.0
> Reporter: Brachi Packter
> Assignee: Ismaël Mejía
> Priority: Major
> Fix For: 2.13.0
>
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> I want to write form DataFlow to GCP cloud SQL, I'm using connection pool,
> and still I see huge amount of connections in GCP SQL (4k while I set
> connection pool to 300), and most of them in sleep.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
