Additionally to what Moritz said, I just wanted to give an example of using
JdbcIO.PoolableDataSourceProvider taken from JdbcIO Javadoc:
To customize the building of the DataSource we can provide a
SerializableFunction. For example if you need to provide a PoolingDataSource
from an existing JdbcIO.DataSourceConfiguration: you can use a
JdbcIO.PoolableDataSourceProvider:
pipeline.apply(JdbcIO.<KV<Integer, String>>read()
.withDataSourceProviderFn(JdbcIO.PoolableDataSourceProvider.of(
JdbcIO.DataSourceConfiguration.create(
"com.mysql.jdbc.Driver", "jdbc:mysql://hostname:3306/mydb",
"username", "password")))
// ...
);
Did you try this? If yes, could you provide more details about your error?
—
Alexey
> On 29 Jul 2022, at 10:40, Moritz Mack <mm...@talend.com> wrote:
>
> Could you share some more details what you’ve tried so far?
> I suppose you are using the JdbcIO, right? Have you looked at
> JdbcIO.PoolableDataSourceProvider?
>
> / Moritz
>
>
> On 28.07.22, 17:35, "Koka, Deepthi via dev" <d...@beam.apache.org
> <mailto:d...@beam.apache.org>> wrote:
> Hi Team, We have an issue with the Oracle connections being used up and we
> have tried to implement a pooled data source using PooledDataSourceFactory,
> somehow we are ending up with “Invalid Universal Connection Pool
> Configuration: oracle.ucp.UniversalConnectionPoolException:
> Hi Team,
>
> We have an issue with the Oracle connections being used up and we have tried
> to implement a pooled data source using PooledDataSourceFactory, somehow we
> are ending up with “Invalid Universal Connection Pool Configuration:
> oracle.ucp.UniversalConnectionPoolException: Universal Connection Pool
> already exists in the Universal Connection Pool Manager.
>
> Can you please suggest us a standard way of using Pooled data sources in
> Apache beam?
>
> Regards,
> Deepthi.
> This email and any files transmitted with it are confidential and intended
> solely for the use of the addressee. If you are not the intended addressee,
> then you have received this email in error and any use, dissemination,
> forwarding, printing, or copying of this email is strictly prohibited. Please
> notify us immediately of your unintended receipt by reply and then delete
> this email and your reply. Tyson Foods, Inc. and its subsidiaries and
> affiliates will not be held liable to any person resulting from the
> unintended or unauthorized use of any information contained in this email or
> as a result of any additions or deletions of information originally contained
> in this email.
> As a recipient of an email from Talend, your contact personal data will be on
> our systems. Please see our privacy notice. <https://www.talend.com/privacy/>
